-- Logs begin at Tue 2022-04-05 11:07:19 UTC, end at Tue 2022-04-05 12:41:25 UTC. -- Apr 05 11:41:53.754652 dv-cinder-829565-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 05 11:41:53.764527 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 05 11:41:53.767159 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Apr 5 11:41:53 2022] *** Apr 05 11:41:53.767159 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 05 11:41:53.767159 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 05 11:41:53.767159 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: nodename: dv-cinder-829565-3-iscsi Apr 05 11:41:53.767159 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: machine: x86_64 Apr 05 11:41:53.767159 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: clock source: unix Apr 05 11:41:53.767159 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: pcre jit disabled Apr 05 11:41:53.767159 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: detected number of CPU cores: 4 Apr 05 11:41:53.767159 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: current working directory: / Apr 05 11:41:53.767159 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: detected binary path: /usr/bin/uwsgi-core Apr 05 11:41:53.767159 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: your processes number limit is 47680 Apr 05 11:41:53.767159 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: your memory page size is 4096 bytes Apr 05 11:41:53.767159 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: detected max file descriptor number: 2048 Apr 05 11:41:53.767159 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: lock engine: pthread robust mutexes Apr 05 11:41:53.768175 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: thunder lock: enabled Apr 05 11:41:53.768175 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 05 11:41:53.768175 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 05 11:41:53.811505 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: Python main interpreter initialized at 0x564213e6a9c0 Apr 05 11:41:53.811505 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: python threads support enabled Apr 05 11:41:53.811505 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: your server socket listen backlog is limited to 100 connections Apr 05 11:41:53.811505 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: your mercy for graceful operations on workers is 90 seconds Apr 05 11:41:53.811833 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: mapped 403077 bytes (393 KB) for 2 cores Apr 05 11:41:53.811908 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: *** Operational MODE: preforking *** Apr 05 11:41:53.812176 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: *** uWSGI is running in multiple interpreter mode *** Apr 05 11:41:53.812176 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: spawned uWSGI master process (pid: 108987) Apr 05 11:41:53.812365 dv-cinder-829565-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 05 11:41:53.812876 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: spawned uWSGI worker 1 (pid: 108988, cores: 1) Apr 05 11:41:53.813208 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: spawned uWSGI worker 2 (pid: 108989, cores: 1) Apr 05 11:41:53.815674 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 05 11:41:54.984129 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 05 11:41:54.986058 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 05 11:41:55.838349 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:41:55.838349 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: from cryptography.utils import int_from_bytes Apr 05 11:41:55.838614 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:41:55.838614 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: from cryptography.utils import int_from_bytes Apr 05 11:41:55.840672 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:41:55.840672 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: from cryptography.utils import int_from_bytes Apr 05 11:41:55.840994 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:41:55.840994 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: from cryptography.utils import int_from_bytes Apr 05 11:41:58.366707 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:41:58.367339 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 05 11:41:58.367433 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:41:58.367433 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 05 11:41:58.367844 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 05 11:41:58.367919 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 05 11:41:58.367991 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 05 11:41:58.368065 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 05 11:41:58.368154 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 05 11:41:58.368329 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 05 11:41:58.368427 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.368739 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.368882 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.369043 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.369143 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.369379 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.369524 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.369700 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.369852 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.370003 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.370117 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.370310 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.370457 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.370670 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.370813 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.370906 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.370998 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.371172 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.371269 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.371498 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.371621 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.371777 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.371871 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-829565-3-iscsi {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.372125 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-829565-3-iscsi {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.372247 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.372450 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.372572 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.372727 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.372817 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.373044 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.373171 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.373351 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.373484 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.373642 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.373765 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.373949 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.374072 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.374263 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.374446 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.374904 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.375043 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.375148 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.375254 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.375364 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.375480 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.375771 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.375961 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.376141 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.376324 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.376508 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.376689 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.376863 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.377034 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.377213 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.377383 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.377588 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.377735 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.377913 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.378089 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.378293 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.378492 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-829565-3-iscsi {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.378672 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-829565-3-iscsi {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.378859 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.379048 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.379232 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.379383 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.379554 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.379726 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.379898 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.380227 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.380393 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.380545 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.380667 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.380825 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.380945 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.381073 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.381223 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.381347 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.381481 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.381600 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.381727 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.381879 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.382006 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.382126 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.382261 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.382384 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.382503 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.382620 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.382739 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.382857 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.382984 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.383103 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.383243 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.383373 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.383499 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.383631 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.383751 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.383868 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.383994 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.384152 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.384279 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.384408 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.384527 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.384644 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.384762 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.384887 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.385014 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.385142 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.385261 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.385382 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.385502 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.385628 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.385759 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.385911 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.386065 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.386183 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.386312 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.386439 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.386559 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.386785 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.386961 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.387091 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.387227 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.387362 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.387488 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.387614 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.387732 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.387940 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.388178 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.388328 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.388453 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.388573 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.388691 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.388810 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.389280 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.389504 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.389690 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.389823 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.389954 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.390074 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.390192 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.390411 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.390598 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.390729 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.390851 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.391092 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.391233 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.391356 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.391474 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.391598 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.391719 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.391951 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.392120 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.392256 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.392385 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.392581 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.392711 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.392952 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.393090 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.393274 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.393402 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.393575 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.393706 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.393873 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.394014 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.394187 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.394319 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.394494 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.394626 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.394782 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.394908 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.395025 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.395143 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.395328 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.395454 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.395600 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.395722 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.395915 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.396045 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.396234 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.396359 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.396544 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.396671 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.396847 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.396971 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.397140 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.397266 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.397446 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.397580 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.397706 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.397840 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.398024 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.398157 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.398313 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.398439 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.398626 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.398751 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.398923 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.399059 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.399233 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.399358 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.399513 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.399638 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.399819 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.399959 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.400144 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.400266 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.400449 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.400583 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.400742 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.400875 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.401063 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.401194 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.401345 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.401479 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.401656 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.401839 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.401978 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.402098 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.402246 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.402370 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.402555 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.402688 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.402856 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.402979 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.403160 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.403283 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.403460 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.403662 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.403793 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.403912 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.404029 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.404180 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.404366 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.404501 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.404670 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.404796 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.404969 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.405092 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.405265 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.405390 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.405569 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.405691 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.405870 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.405995 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.406168 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.406300 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.406455 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.406586 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.406764 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.406889 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.407050 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.407171 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.407338 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.407459 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.407634 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.407766 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.407930 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.408061 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.408241 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.408361 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.408564 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.408685 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.408876 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.409006 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.409182 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.409306 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.409485 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.409620 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.409788 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.409916 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.410092 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.410215 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.410408 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:41:58.410538 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.410735 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.410862 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.411064 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.411193 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.411376 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.411505 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.411704 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.411827 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.412030 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.412184 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.412369 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.412492 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.412680 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.412801 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.412987 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.413108 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.413302 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.413426 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.413607 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.413734 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.413914 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.414036 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.414221 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.414351 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.414528 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.414656 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.414841 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.414974 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.415158 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.415292 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.415466 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.415587 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.415776 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.415906 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.416107 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.416233 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.416417 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.416540 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.416722 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.416854 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.417039 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.417162 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.417355 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.417477 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.417662 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.417792 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.417968 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.418088 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.418306 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.418428 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.418621 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.418758 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.418940 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.419063 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.419256 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.419379 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.419562 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.419698 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.419866 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.419988 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.420194 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.420326 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.420505 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.420637 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.420822 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.420944 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.421148 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.421268 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.421458 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.421579 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.421767 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.421887 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.422072 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.422202 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.422375 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.422498 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.422680 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.422801 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.422983 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.423103 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.423289 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.423411 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.423611 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.423739 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.423922 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.424108 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.424303 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.424433 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.424614 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.424735 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.424919 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.425040 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.425228 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.425358 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.425532 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.425655 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.425834 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.426036 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.426157 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.426279 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.426405 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.426529 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.426712 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.426843 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.427012 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.427147 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.427311 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.427432 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.427627 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.427762 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.427925 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.428053 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.428266 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.428389 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.428567 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.428697 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.428874 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.428998 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.429179 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.429306 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.429481 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.429603 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.429780 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.429909 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.430080 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.430200 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.430383 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.430504 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.430685 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.430807 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.430984 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.431105 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.431304 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.431427 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.431604 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.431725 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.431909 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.432029 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.432244 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.432367 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.432546 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.432668 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.432847 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.432976 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.433157 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.433278 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.433465 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.433593 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.433772 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.433905 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.434079 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.434200 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.434389 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.434511 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.434698 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.434831 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.435011 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.435132 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.435322 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.435442 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.435655 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.436351 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.436351 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.436562 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.436663 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.436769 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.436881 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.436985 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.437096 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.437205 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.437307 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.437415 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.437536 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.437639 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.437788 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.437898 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.438090 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.438205 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.438393 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.438510 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.438692 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.438807 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.438990 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.439097 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.439290 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.439411 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.439613 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.439729 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.439916 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.440039 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.440239 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.440357 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.440542 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.440651 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.440852 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.440971 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.441158 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.441281 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.441456 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.441579 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.441756 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.441888 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.442056 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.442178 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.442388 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.442509 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.442689 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.442822 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.443028 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.443157 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.443343 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.443464 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.443698 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.443844 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.443977 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.444129 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.444319 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.444442 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.444608 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.444731 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.444918 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.445039 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.445228 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.445348 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.445532 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.445653 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.445841 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.445961 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.446147 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.446276 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.446455 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.446584 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.446759 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.446882 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.447068 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.447197 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.447376 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.447497 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.447688 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.447811 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.447986 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.448149 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.448319 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.448439 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.448633 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.448755 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.448967 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.449097 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.449280 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.449404 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.449596 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.449719 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.449902 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.450035 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.450210 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.450339 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.450513 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.450643 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.450818 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.450949 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.451127 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.451248 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.451431 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.451559 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.451740 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.451863 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.452042 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.452198 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.452375 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.452495 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.452678 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.452800 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.452984 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.453104 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.453288 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.453411 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.453594 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.453716 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.453889 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.454016 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.454196 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.454328 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.454526 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.454648 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.454817 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.454946 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.455125 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.455287 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.455502 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.455625 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.455824 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.455949 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.456155 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.456296 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.456462 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.456586 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.456768 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.456889 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.457070 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.457202 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.457373 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.457496 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.457675 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.457796 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.457983 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.458119 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.458287 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.458410 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.458593 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.458713 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.458890 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.459013 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.459188 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.459309 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.459494 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.459622 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.459795 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.459919 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.460110 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.460234 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.460419 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.460543 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.460730 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.460863 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.461042 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.461163 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.461351 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.461473 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.461665 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.461787 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.461966 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.462088 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.462266 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.462400 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.462566 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.462710 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.462907 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.463036 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.463156 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.463283 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.463446 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.463569 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.463746 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.463868 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.464048 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.464243 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.464399 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.464521 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.464700 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.464823 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.465006 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.465140 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.465320 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.465461 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.465623 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.465753 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.465931 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.466063 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.466237 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.466360 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.466541 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.466664 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.466846 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.466969 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.467156 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.467277 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.467460 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.467577 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.467764 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.467886 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.468089 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.468213 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.468430 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.468569 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.468699 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.468846 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.468996 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.469127 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.469298 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.469419 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.469606 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.469737 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.469912 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.470033 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.470209 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.470343 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.470508 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.470636 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.470836 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.470987 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.471216 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.471442 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.471773 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.471894 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.472117 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.472236 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.472424 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.472560 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.472740 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.472863 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.473056 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.473195 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.473371 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.473494 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.473694 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.473823 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.474020 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.474145 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.474324 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.474455 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.474632 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.474769 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.474933 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.475056 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.475234 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.475366 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.475542 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.475672 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.475841 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.475962 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.476163 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.476301 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.476466 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.476599 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.476768 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.476897 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.477066 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.477212 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.477366 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.477488 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.477663 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.477785 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.477963 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.478085 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.478283 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.478412 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.478563 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.478684 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.478864 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.478992 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.479163 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.479286 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.479465 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.479586 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.479773 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.479902 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.480098 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.480224 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.480394 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.480516 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.480692 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.480831 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.480991 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.481120 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.481324 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.481447 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.481624 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.481753 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.481960 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.482090 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.482288 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.482410 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.482587 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.482727 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.482887 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.483010 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.483205 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.483333 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.483504 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.483628 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.483804 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.483926 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.484122 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.484247 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.484429 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.484561 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.484730 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.484859 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.485030 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.485152 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.485327 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.485453 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.485627 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.485749 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.485930 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.486038 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.488108 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.488241 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.488241 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.488424 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.488511 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.488606 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.488606 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.488773 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.488773 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.488922 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.489001 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.489088 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.489088 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.489242 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.489242 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.489242 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.489242 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.489242 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.489599 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.489770 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.489971 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.490071 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.490302 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.490412 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.490983 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.491057 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.491124 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.491190 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.491267 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.491332 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.491523 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.491607 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.491829 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.491935 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.492154 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.492257 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.492468 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.492564 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.492774 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.492870 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.493076 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.493168 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.493382 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.493478 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.493684 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.493783 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.493983 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.494077 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.494283 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.494369 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.494598 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.494697 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.494896 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.494980 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.495204 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.495288 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.495509 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.495602 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.495815 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.495905 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.496142 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.496231 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.496450 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.496554 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.496751 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.496846 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.497058 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.497142 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.497358 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.497444 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.497661 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.497745 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.497959 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.498042 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.498262 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.498349 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.498561 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.498653 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.498863 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.498961 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.499167 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.499256 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.499489 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.499579 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.499769 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.499865 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.500090 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.500176 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.500413 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.500497 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.500716 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.500817 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.501024 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.501109 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.501329 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.501415 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.501631 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.501734 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.501970 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.502055 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.502334 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.502423 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.502649 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.502746 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.502960 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.503045 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.503263 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.503347 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.503585 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.503681 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.503896 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.503988 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.504230 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.504317 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.504535 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.504623 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.504837 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.504920 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.505152 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.505236 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.505461 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.505548 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.505769 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.505848 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.506554 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.506668 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.506751 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.506829 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.506913 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.506998 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.507077 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.507234 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.507319 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.507398 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.507566 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.507652 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.507876 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.507969 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.508204 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.508293 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.508506 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.508589 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.508820 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.508919 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.509120 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.509205 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.509426 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.509510 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.509740 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.509833 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.510038 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.510130 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.510340 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.510425 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.510646 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.510738 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.510951 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.511034 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.511252 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.511343 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.511556 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.511642 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.511858 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.511948 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.512177 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.512264 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.512481 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.512566 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.512781 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.512886 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.513085 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.513178 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.513385 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.513478 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.513684 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.513812 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.514352 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.514494 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.514653 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.514803 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.514960 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.515110 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.515259 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.515420 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.515685 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.515782 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.515995 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.516110 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.516327 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.516426 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.516633 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.516743 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.516938 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.517031 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.517243 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.517344 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.517557 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.517647 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.517892 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.517990 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.518192 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.518284 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.518530 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.518672 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.518838 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.518978 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.519156 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.519299 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.519458 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.519599 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.519760 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.519900 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.520054 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.520230 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.520366 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.520500 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.520676 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.520816 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.520968 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.521103 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.521268 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.521410 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.521569 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.521725 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.521868 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.522013 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.522176 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.522359 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.522502 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.522667 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.522866 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.523008 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.523173 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.523315 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.523472 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.523633 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.523883 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.524032 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.524219 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.524354 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.524498 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.524635 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.524800 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.524948 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.525161 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.525306 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.525442 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.525578 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.525711 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.525859 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.526005 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.526147 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.526282 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.526418 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.526596 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.526746 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.526915 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.527057 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.527226 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.527367 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.527537 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.527687 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.527825 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.527970 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.528167 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.528313 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.528488 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.528631 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.528800 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.528942 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.529116 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.529274 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.529480 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.529620 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.529783 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.529924 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.530076 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.530221 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.530379 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.530519 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.530669 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.530805 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.530987 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.531136 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.531279 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.531414 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.531581 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.531730 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.531876 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.532024 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.532196 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.532332 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.532490 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.532632 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.532779 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.532915 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.533087 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.533229 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.533417 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.533557 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.533738 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.533891 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.534035 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.534177 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.534312 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.534447 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.534630 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.534772 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.534930 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.535072 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.535245 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.535386 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.535554 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.535695 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.535841 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.535976 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.536175 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.536319 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.536465 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.536601 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.536787 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.536928 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.537092 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.537241 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.537376 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.537511 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.537681 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.537844 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.537980 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.538124 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.538303 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.538445 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.538588 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.538724 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.538906 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.539057 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.539230 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.539371 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.539552 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.539709 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.539859 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.539995 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.540187 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.540330 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.540491 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.540631 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.540800 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.540941 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.541103 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.541245 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.541405 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.541554 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.541709 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.541844 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.541985 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.542121 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.542282 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.542433 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.542577 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.542721 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.542856 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.542990 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.543157 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.543314 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.543457 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.543613 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.543748 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.543959 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.544126 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.544287 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.544498 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.544638 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.544772 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.544906 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.545040 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.545184 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.545319 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.545463 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.545610 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.545751 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.545886 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.546030 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.546166 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.546300 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.546434 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.546575 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.546719 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.546855 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.546989 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.547124 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.547309 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.547451 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.547621 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.547771 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.547937 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.548135 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.548277 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.548423 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.548567 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.548703 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.548882 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.549057 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.549218 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.549369 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.549513 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.549657 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.549823 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.549962 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.550130 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.550270 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.550441 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.550581 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.550748 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.550897 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.551062 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.551270 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.551422 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.551598 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.551741 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.551910 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.552052 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.552234 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.552372 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.552539 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.552788 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.552931 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.553114 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.553266 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.553427 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.553579 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.553715 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.553849 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.554023 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.554165 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.554329 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.554476 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.554644 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.554787 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.554952 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.555106 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.555243 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.555388 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.555549 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.555690 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.555856 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.555999 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.556203 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.556349 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.556512 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.556665 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.556825 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.556974 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.557153 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.557305 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.557469 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.557619 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.557756 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.557897 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.558069 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.558210 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.558376 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.558517 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.558687 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.558832 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.558981 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.559131 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.559298 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.559440 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.559609 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.559757 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.559919 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.560059 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.560278 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.560425 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.560571 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.560718 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.560861 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.561021 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.561174 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.561315 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.561457 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.561604 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.561754 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.561906 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.562049 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.562192 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.562333 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.562474 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.562613 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.562858 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.563006 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.563149 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.563290 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.563468 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.563625 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.563775 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.563923 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.564102 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.564252 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.564429 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.564632 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.564845 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.565030 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.565178 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.565345 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.565495 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.565672 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.565829 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.565996 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.566144 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.566317 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.566478 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.566620 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.566761 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.566921 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.567064 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.567243 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.567404 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.567549 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.567689 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.567851 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.567994 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.568173 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.568331 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.568508 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.568663 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.568812 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.568965 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.569107 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.569446 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.569609 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.569609 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.569878 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.570020 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.570170 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.570326 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.570468 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.570611 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.570750 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.570915 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.571070 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.571220 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.571362 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.571503 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.571685 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.571834 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.572010 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.572214 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.572396 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.572527 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.572693 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.572825 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.572978 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.573077 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.573271 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.573456 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.573602 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.573753 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.573904 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.574046 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.574197 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.574349 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.574491 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.574639 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.574782 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.574934 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.575075 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.575217 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.575357 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.575506 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.575648 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.575798 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.575939 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.576138 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.576286 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.576505 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.576672 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.576842 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.576998 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.577142 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.577291 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.577435 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.577576 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.577725 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.577867 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.578009 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.578158 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.578300 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.578455 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.578597 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.578768 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.578923 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.579074 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.579225 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.579378 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.579521 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.579662 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.579804 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.579952 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.580118 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.580302 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.580447 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.580588 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.580747 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.580890 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.581031 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.581173 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.581314 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.581455 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.581610 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.581753 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.581894 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.582035 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.582177 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.582324 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.582474 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.582626 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.582774 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.582924 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.583065 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.583207 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.583422 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.583565 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.583714 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.583856 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.584008 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.584221 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.584366 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.584507 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.584660 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.584830 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.584979 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.585160 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.585311 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.585480 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.585640 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.585792 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.585934 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.586122 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.586271 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.586414 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.586565 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.586707 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.586860 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.587010 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.587166 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.587307 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.587450 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.587590 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.587739 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.587881 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.588023 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.588231 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.588342 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.588540 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.588685 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.588854 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.589056 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.589147 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.589226 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.589438 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.589593 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.589717 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.589811 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.590051 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.590183 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.590358 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.590490 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.590660 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.590808 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.590970 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.591103 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.591283 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.591430 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.591593 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.591725 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.591877 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.591969 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.592215 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.592324 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.592521 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.592613 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.592832 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.592935 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.593137 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.593238 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.593448 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.593544 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.593730 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.593896 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.594043 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.594202 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.594345 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.594487 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.594628 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.594785 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.594927 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.595077 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.595227 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.595376 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.595620 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.595812 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.595985 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.596175 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.596321 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.596463 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.596617 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.596760 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.596903 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.597052 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.597193 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.597335 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.597516 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.597667 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.597830 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.597986 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.598139 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.598294 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.598438 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.598587 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.598754 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.598911 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.599062 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.599210 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.599354 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.599503 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.599645 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.599786 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.599939 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.600113 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.600272 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.600415 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.600565 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.600707 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.600848 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.600998 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.601147 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.601290 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.601431 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.601571 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.601720 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.601879 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.602023 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.602176 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.602326 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.602468 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.602623 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.602774 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.602923 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.603067 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.603208 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.603356 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.603506 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.603672 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.603826 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.603978 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.604138 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.604285 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.604438 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.604580 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.604727 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.604871 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.605011 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.605160 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.605303 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.605444 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.605585 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.605743 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.605892 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.606042 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.606190 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.606333 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.606481 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.606623 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.606764 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.606912 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.607054 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.607193 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.607335 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.607500 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.607641 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.607791 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.607933 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.608129 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.608276 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.608419 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.608567 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.608715 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.608857 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.608997 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.609145 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.609298 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.609479 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.609622 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.609763 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.609904 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.610044 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.610185 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.610334 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.610485 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.610626 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.610767 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.610914 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.611054 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.611272 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.611449 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.611604 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.611747 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.611888 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.612038 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.612203 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.612346 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.612487 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.612629 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.612770 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.612923 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.613067 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.613219 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.613370 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.613524 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.613668 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.613825 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.613967 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.614114 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.614256 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.614397 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.614547 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.614690 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.614838 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.614990 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.615140 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.615282 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.615431 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.615579 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.615722 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.615873 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.616014 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.616205 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.616360 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.616510 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.616659 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.616845 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.617015 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.617167 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.617318 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.617461 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.617602 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.617755 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.617897 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.618047 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.618189 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.618330 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.618470 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.618611 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.618769 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.618924 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.619066 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.619209 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.619359 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.619517 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.619659 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 05 11:41:58.619841 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.620196 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.620510 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.620819 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.621124 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:41:58.621365 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 05 11:41:58.643086 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG oslo_db.sqlalchemy.engines [None req-80cb3766-2844-4d0b-a54f-ecbf210a0e0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108988) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:41:58.644505 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG oslo_db.sqlalchemy.engines [None req-57d210c9-1c0d-4d28-84e6-9b8349d19d72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108989) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:41:58.705680 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.context [None req-80cb3766-2844-4d0b-a54f-ecbf210a0e0e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c02b48b4-c051-4569-8fb4-e9dd7f34ad69(cell1) {{(pid=108988) load_cells /opt/stack/nova/nova/context.py:464}} Apr 05 11:41:58.706067 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.context [None req-57d210c9-1c0d-4d28-84e6-9b8349d19d72 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c02b48b4-c051-4569-8fb4-e9dd7f34ad69(cell1) {{(pid=108989) load_cells /opt/stack/nova/nova/context.py:464}} Apr 05 11:41:58.710059 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG oslo_concurrency.lockutils [None req-80cb3766-2844-4d0b-a54f-ecbf210a0e0e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:58.710300 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG oslo_concurrency.lockutils [None req-57d210c9-1c0d-4d28-84e6-9b8349d19d72 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:58.711632 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG oslo_concurrency.lockutils [None req-80cb3766-2844-4d0b-a54f-ecbf210a0e0e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:58.711875 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG oslo_concurrency.lockutils [None req-57d210c9-1c0d-4d28-84e6-9b8349d19d72 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:58.712449 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG oslo_concurrency.lockutils [None req-80cb3766-2844-4d0b-a54f-ecbf210a0e0e None None] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:58.712684 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG oslo_concurrency.lockutils [None req-57d210c9-1c0d-4d28-84e6-9b8349d19d72 None None] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:58.714392 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG oslo_concurrency.lockutils [None req-80cb3766-2844-4d0b-a54f-ecbf210a0e0e None None] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:58.714607 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG oslo_concurrency.lockutils [None req-57d210c9-1c0d-4d28-84e6-9b8349d19d72 None None] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:58.730187 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG oslo_db.sqlalchemy.engines [None req-57d210c9-1c0d-4d28-84e6-9b8349d19d72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108989) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:41:58.731284 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG oslo_db.sqlalchemy.engines [None req-80cb3766-2844-4d0b-a54f-ecbf210a0e0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108988) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:41:58.734070 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG oslo_db.sqlalchemy.engines [None req-80cb3766-2844-4d0b-a54f-ecbf210a0e0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108988) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:41:58.736827 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG oslo_db.sqlalchemy.engines [None req-57d210c9-1c0d-4d28-84e6-9b8349d19d72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108989) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:41:58.888703 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG oslo_db.sqlalchemy.engines [None req-80cb3766-2844-4d0b-a54f-ecbf210a0e0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108988) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:41:58.892059 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG oslo_db.sqlalchemy.engines [None req-57d210c9-1c0d-4d28-84e6-9b8349d19d72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108989) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:41:59.340809 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: WARNING keystonemiddleware.auth_token [None req-57d210c9-1c0d-4d28-84e6-9b8349d19d72 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:41:59.342978 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: WARNING keystonemiddleware.auth_token [None req-80cb3766-2844-4d0b-a54f-ecbf210a0e0e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:41:59.347565 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: WARNING keystonemiddleware.auth_token [None req-57d210c9-1c0d-4d28-84e6-9b8349d19d72 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:41:59.349788 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: WARNING keystonemiddleware.auth_token [None req-80cb3766-2844-4d0b-a54f-ecbf210a0e0e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:41:59.564204 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: WARNING keystonemiddleware.auth_token [None req-57d210c9-1c0d-4d28-84e6-9b8349d19d72 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:41:59.567413 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: WARNING keystonemiddleware.auth_token [None req-80cb3766-2844-4d0b-a54f-ecbf210a0e0e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:41:59.569399 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: WARNING keystonemiddleware.auth_token [None req-57d210c9-1c0d-4d28-84e6-9b8349d19d72 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:41:59.572619 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: WARNING keystonemiddleware.auth_token [None req-80cb3766-2844-4d0b-a54f-ecbf210a0e0e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:41:59.574730 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564213e6a9c0 pid: 108989 (default app) Apr 05 11:41:59.576812 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-57d210c9-1c0d-4d28-84e6-9b8349d19d72 None None] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:59.577944 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564213e6a9c0 pid: 108988 (default app) Apr 05 11:41:59.578096 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-57d210c9-1c0d-4d28-84e6-9b8349d19d72 None None] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001745 Apr 05 11:41:59.578413 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 788 bytes} [Tue Apr 5 11:41:59 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:43:17.868990 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-80cb3766-2844-4d0b-a54f-ecbf210a0e0e None None] Calling method '>' {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:17.870193 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-80cb3766-2844-4d0b-a54f-ecbf210a0e0e None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002057 Apr 05 11:43:17.870777 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 1/2] 10.222.0.61 () {54 vars in 930 bytes} [Tue Apr 5 11:43:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:43:18.300556 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-861eb2ee-899e-462c-bd82-a33501890af6 admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:18.329399 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-861eb2ee-899e-462c-bd82-a33501890af6 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.450993 Apr 05 11:43:18.330259 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 2/3] 10.222.0.61 () {60 vars in 1291 bytes} [Tue Apr 5 11:43:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:20.648340 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-80cb3766-2844-4d0b-a54f-ecbf210a0e0e None None] Calling method '>' {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:20.649351 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-80cb3766-2844-4d0b-a54f-ecbf210a0e0e None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Apr 05 11:43:20.649748 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 2/4] 10.222.0.61 () {54 vars in 930 bytes} [Tue Apr 5 11:43:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:43:20.708773 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-52960656-67b8-4ab5-a196-8a19e49828e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "id": "c1", "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "rxtx_factor": 1.0}} {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:43:20.727473 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:43:20.727473 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: warnings.warn(msg) Apr 05 11:43:20.757892 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-52960656-67b8-4ab5-a196-8a19e49828e7 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.101990 Apr 05 11:43:20.758419 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 3/5] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Apr 5 11:43:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:43:20.979364 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-5a881556-cde1-4ad5-ad55-6445a4297eba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:43:20.982018 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:43:20.982018 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: warnings.warn(msg) Apr 05 11:43:21.031403 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-5a881556-cde1-4ad5-ad55-6445a4297eba admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.264397 Apr 05 11:43:21.035892 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 3/6] 10.222.0.61 () {64 vars in 1335 bytes} [Tue Apr 5 11:43:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:23.390587 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-52960656-67b8-4ab5-a196-8a19e49828e7 admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:23.391611 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-52960656-67b8-4ab5-a196-8a19e49828e7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Apr 05 11:43:23.392018 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 4/7] 10.222.0.61 () {54 vars in 930 bytes} [Tue Apr 5 11:43:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:43:23.527310 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-60d1542d-9387-4b55-9bbc-1a8e45d8639a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "id": "d1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "swap": 0}} {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:43:23.546750 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:43:23.546750 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: warnings.warn(msg) Apr 05 11:43:23.568281 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-60d1542d-9387-4b55-9bbc-1a8e45d8639a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.170249 Apr 05 11:43:23.568939 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 4/8] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Apr 5 11:43:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:43:23.581469 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-af489ea0-0c2b-4dac-8c8c-f30b6e1f9de6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:43:23.582898 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:43:23.582898 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: warnings.warn(msg) Apr 05 11:43:23.617559 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-af489ea0-0c2b-4dac-8c8c-f30b6e1f9de6 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040022 Apr 05 11:43:23.618722 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 5/9] 10.222.0.61 () {64 vars in 1335 bytes} [Tue Apr 5 11:43:23 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:43:25.933687 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-60d1542d-9387-4b55-9bbc-1a8e45d8639a admin admin] Calling method '>' {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:25.934659 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-60d1542d-9387-4b55-9bbc-1a8e45d8639a admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Apr 05 11:43:25.935499 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 5/10] 10.222.0.61 () {54 vars in 930 bytes} [Tue Apr 5 11:43:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:43:25.997330 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-63ca5627-e1dd-4a51-bb4d-f8dd17e6c90e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "name": "ds1G", "id": "d2", "os-flavor-access:is_public": true, "ram": 1024, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:43:26.017119 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-63ca5627-e1dd-4a51-bb4d-f8dd17e6c90e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075599 Apr 05 11:43:26.024976 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 6/11] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Apr 5 11:43:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 11:43:26.029666 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-f7d74c1e-c179-457f-a7c3-f43525591b0c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:43:26.053513 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-f7d74c1e-c179-457f-a7c3-f43525591b0c admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027345 Apr 05 11:43:26.060239 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 6/12] 10.222.0.61 () {64 vars in 1335 bytes} [Tue Apr 5 11:43:26 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:28.390296 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-63ca5627-e1dd-4a51-bb4d-f8dd17e6c90e admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:28.391339 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-63ca5627-e1dd-4a51-bb4d-f8dd17e6c90e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Apr 05 11:43:28.391902 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 7/13] 10.222.0.61 () {54 vars in 930 bytes} [Tue Apr 5 11:43:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:43:28.449832 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-f2690785-8112-41d5-8557-9db792a1b3fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "swap": 0, "name": "ds2G", "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "disk": 10}} {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:43:28.468373 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-f2690785-8112-41d5-8557-9db792a1b3fd admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070792 Apr 05 11:43:28.468929 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 7/14] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Apr 5 11:43:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 11:43:28.481131 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-a5b01dce-9042-476a-9ec5-d11002c8a9d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:43:28.504303 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-a5b01dce-9042-476a-9ec5-d11002c8a9d0 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026829 Apr 05 11:43:28.504901 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 8/15] 10.222.0.61 () {64 vars in 1335 bytes} [Tue Apr 5 11:43:28 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:43:30.843125 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-f2690785-8112-41d5-8557-9db792a1b3fd admin admin] Calling method '>' {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:30.844225 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-f2690785-8112-41d5-8557-9db792a1b3fd admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Apr 05 11:43:30.844593 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 8/16] 10.222.0.61 () {54 vars in 930 bytes} [Tue Apr 5 11:43:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:43:30.907849 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-cf98a865-5eea-461c-88f3-a1700c9e5cb0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "id": "d4", "disk": 20, "ram": 4096}} {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:43:30.926301 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-cf98a865-5eea-461c-88f3-a1700c9e5cb0 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075925 Apr 05 11:43:30.926837 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 9/17] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Apr 5 11:43:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:43:30.938933 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-bbc7429d-dae0-45e5-bbde-00865c735005 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:43:30.961505 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-bbc7429d-dae0-45e5-bbde-00865c735005 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026619 Apr 05 11:43:30.970867 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 9/18] 10.222.0.61 () {64 vars in 1335 bytes} [Tue Apr 5 11:43:30 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:33.263326 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-cf98a865-5eea-461c-88f3-a1700c9e5cb0 admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:33.264373 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-cf98a865-5eea-461c-88f3-a1700c9e5cb0 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Apr 05 11:43:33.264751 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 10/19] 10.222.0.61 () {54 vars in 930 bytes} [Tue Apr 5 11:43:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:43:33.331908 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-c0e62a64-5fc7-43f8-b640-fbc238e2ffe5 admin admin] Calling method '>' {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:33.355439 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-c0e62a64-5fc7-43f8-b640-fbc238e2ffe5 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083044 Apr 05 11:43:33.356103 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 10/20] 10.222.0.61 () {60 vars in 1291 bytes} [Tue Apr 5 11:43:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:43:35.723873 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-cf98a865-5eea-461c-88f3-a1700c9e5cb0 admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:35.725546 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-cf98a865-5eea-461c-88f3-a1700c9e5cb0 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002293 Apr 05 11:43:35.726192 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 11/21] 10.222.0.61 () {54 vars in 930 bytes} [Tue Apr 5 11:43:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:43:35.788845 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-d816a4c9-64cf-4833-bd3e-638804019a73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "id": "1"}} {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:43:35.809693 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-d816a4c9-64cf-4833-bd3e-638804019a73 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075464 Apr 05 11:43:35.810304 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 11/22] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Apr 5 11:43:35 2022] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 11:43:35.822738 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-3be629c7-6044-41f1-985f-860fb275e3c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:43:35.847615 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-3be629c7-6044-41f1-985f-860fb275e3c9 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028771 Apr 05 11:43:35.848409 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 12/23] 10.222.0.61 () {64 vars in 1332 bytes} [Tue Apr 5 11:43:35 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:38.191815 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-d816a4c9-64cf-4833-bd3e-638804019a73 admin admin] Calling method '>' {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:38.192993 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-d816a4c9-64cf-4833-bd3e-638804019a73 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001673 Apr 05 11:43:38.193553 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 12/24] 10.222.0.61 () {54 vars in 930 bytes} [Tue Apr 5 11:43:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:43:38.266695 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-ab90b9af-21bd-44d5-857f-d8eb8c5b45cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "disk": 20, "swap": 0, "id": "2", "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:43:38.297946 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-ab90b9af-21bd-44d5-857f-d8eb8c5b45cd admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.098057 Apr 05 11:43:38.299781 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 13/25] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Apr 5 11:43:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:43:38.315306 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-e1374863-0f47-46cf-b0c2-d26190613175 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:43:38.341485 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-e1374863-0f47-46cf-b0c2-d26190613175 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033283 Apr 05 11:43:38.342124 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 13/26] 10.222.0.61 () {64 vars in 1332 bytes} [Tue Apr 5 11:43:38 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:43:40.697361 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-ab90b9af-21bd-44d5-857f-d8eb8c5b45cd admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:40.698369 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-ab90b9af-21bd-44d5-857f-d8eb8c5b45cd admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Apr 05 11:43:40.698770 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 14/27] 10.222.0.61 () {54 vars in 930 bytes} [Tue Apr 5 11:43:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:43:40.758984 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-c6c4e67f-2cb3-45d5-b825-45cbfe6384d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "disk": 40, "rxtx_factor": 1.0, "id": "3", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:43:40.777419 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-c6c4e67f-2cb3-45d5-b825-45cbfe6384d7 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072938 Apr 05 11:43:40.778043 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 14/28] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Apr 5 11:43:40 2022] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:43:40.789915 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-10a622cb-3695-4ebd-98a4-11bb085f3677 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:43:40.813463 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-10a622cb-3695-4ebd-98a4-11bb085f3677 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027212 Apr 05 11:43:40.814277 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 15/29] 10.222.0.61 () {64 vars in 1332 bytes} [Tue Apr 5 11:43:40 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:43.115215 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-c6c4e67f-2cb3-45d5-b825-45cbfe6384d7 admin admin] Calling method '>' {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:43.116269 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-c6c4e67f-2cb3-45d5-b825-45cbfe6384d7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Apr 05 11:43:43.116695 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 15/30] 10.222.0.61 () {54 vars in 930 bytes} [Tue Apr 5 11:43:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:43:43.175911 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-79207d99-3760-4bcb-a2fc-478152bc5f39 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192, "id": "4", "name": "m1.large", "vcpus": 4, "disk": 80}} {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:43:43.194715 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-79207d99-3760-4bcb-a2fc-478152bc5f39 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072186 Apr 05 11:43:43.195281 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 16/31] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Apr 5 11:43:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:43:43.207408 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-bac2ebf7-d101-48a9-8c75-aa508c7e8de4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:43:43.229467 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-bac2ebf7-d101-48a9-8c75-aa508c7e8de4 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025820 Apr 05 11:43:43.230191 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 16/32] 10.222.0.61 () {64 vars in 1332 bytes} [Tue Apr 5 11:43:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:45.615449 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-79207d99-3760-4bcb-a2fc-478152bc5f39 admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:45.616568 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-79207d99-3760-4bcb-a2fc-478152bc5f39 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Apr 05 11:43:45.617133 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 17/33] 10.222.0.61 () {54 vars in 930 bytes} [Tue Apr 5 11:43:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:43:45.676225 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-9f68674b-937a-4be4-a42b-8617ec21de1a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 16384, "id": "5", "disk": 160, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0}} {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:43:45.695029 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-9f68674b-937a-4be4-a42b-8617ec21de1a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.071966 Apr 05 11:43:45.695732 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 17/34] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Apr 5 11:43:45 2022] POST /compute/v2.1/flavors => generated 408 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:43:45.709818 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-1f9c37c2-6cfd-421d-874e-8e032a8c5ac4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:43:45.732532 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-1f9c37c2-6cfd-421d-874e-8e032a8c5ac4 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026614 Apr 05 11:43:45.733129 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 18/35] 10.222.0.61 () {64 vars in 1332 bytes} [Tue Apr 5 11:43:45 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:09.591856 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-9f68674b-937a-4be4-a42b-8617ec21de1a admin admin] Calling method '>' {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:09.592976 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-9f68674b-937a-4be4-a42b-8617ec21de1a admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002105 Apr 05 11:44:09.593425 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 18/36] 10.222.0.61 () {54 vars in 930 bytes} [Tue Apr 5 11:44:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:44:09.653254 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-798db372-7b54-4caf-9515-3328552074dd admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:09.672242 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-798db372-7b54-4caf-9515-3328552074dd admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072634 Apr 05 11:44:09.672797 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 19/37] 10.222.0.61 () {60 vars in 1291 bytes} [Tue Apr 5 11:44:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:44:11.061776 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-9f68674b-937a-4be4-a42b-8617ec21de1a admin admin] Calling method '>' {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:11.062915 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-9f68674b-937a-4be4-a42b-8617ec21de1a admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001933 Apr 05 11:44:11.063403 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 19/38] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Apr 5 11:44:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:44:11.278312 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-327ebdcf-40f6-4544-b6d7-7af38c50c15d admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:11.284596 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.wsgi [None req-327ebdcf-40f6-4544-b6d7-7af38c50c15d admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 05 11:44:11.285164 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-327ebdcf-40f6-4544-b6d7-7af38c50c15d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108989) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:44:11.285961 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-327ebdcf-40f6-4544-b6d7-7af38c50c15d admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.066691 Apr 05 11:44:11.286474 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 20/39] 10.222.0.61 () {60 vars in 1190 bytes} [Tue Apr 5 11:44:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 11:44:11.296131 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-513b5091-5fdb-4432-b396-be1ebfcde079 admin admin] Calling method '>' {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:11.317575 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-513b5091-5fdb-4432-b396-be1ebfcde079 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025050 Apr 05 11:44:11.318149 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 20/40] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Apr 5 11:44:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:44:11.330839 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-70dbdafb-cb1e-4743-9926-a917d98909ba admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:11.354618 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-70dbdafb-cb1e-4743-9926-a917d98909ba admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027635 Apr 05 11:44:11.355177 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 21/41] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Apr 5 11:44:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:44:11.364931 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-b18eaf08-258c-44c4-ab1e-b41c8403df4c admin admin] Calling method '>' {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:11.371489 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.wsgi [None req-b18eaf08-258c-44c4-ab1e-b41c8403df4c admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 05 11:44:11.372065 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-b18eaf08-258c-44c4-ab1e-b41c8403df4c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108988) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:44:11.372882 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-b18eaf08-258c-44c4-ab1e-b41c8403df4c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011667 Apr 05 11:44:11.373357 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 21/42] 10.222.0.61 () {60 vars in 1190 bytes} [Tue Apr 5 11:44:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Apr 05 11:44:12.641773 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-70dbdafb-cb1e-4743-9926-a917d98909ba admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:12.643061 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-70dbdafb-cb1e-4743-9926-a917d98909ba admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001968 Apr 05 11:44:12.643542 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 22/43] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Apr 5 11:44:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:44:12.844552 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-f37199b1-ed66-4e2a-961c-0e4582c18d41 admin admin] Calling method '>' {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:12.850249 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.wsgi [None req-f37199b1-ed66-4e2a-961c-0e4582c18d41 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 05 11:44:12.850818 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-f37199b1-ed66-4e2a-961c-0e4582c18d41 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108988) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:44:12.851624 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-f37199b1-ed66-4e2a-961c-0e4582c18d41 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.071120 Apr 05 11:44:12.852348 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 22/44] 10.222.0.61 () {60 vars in 1190 bytes} [Tue Apr 5 11:44:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 11:44:12.861861 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-77f91df0-acaa-44e5-b1f3-768445d27880 admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:12.876302 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-77f91df0-acaa-44e5-b1f3-768445d27880 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018080 Apr 05 11:44:12.876846 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 23/45] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Apr 5 11:44:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:44:12.887168 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-83b7ce63-ecdd-41c9-9883-50dd90b234fa admin admin] Calling method '>' {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:12.900890 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-83b7ce63-ecdd-41c9-9883-50dd90b234fa admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017521 Apr 05 11:44:12.901427 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 23/46] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Apr 5 11:44:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:44:12.911054 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-66f86597-a324-4a10-a084-9a73edbe0bad admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:12.916399 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.wsgi [None req-66f86597-a324-4a10-a084-9a73edbe0bad admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 05 11:44:12.916967 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-66f86597-a324-4a10-a084-9a73edbe0bad admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108989) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:44:12.917751 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-66f86597-a324-4a10-a084-9a73edbe0bad admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010299 Apr 05 11:44:12.918241 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 24/47] 10.222.0.61 () {60 vars in 1190 bytes} [Tue Apr 5 11:44:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 11:44:14.194513 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-83b7ce63-ecdd-41c9-9883-50dd90b234fa admin admin] Calling method '>' {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:14.196030 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-83b7ce63-ecdd-41c9-9883-50dd90b234fa admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Apr 05 11:44:14.196491 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 24/48] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Apr 5 11:44:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:44:14.403391 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-06f68559-c9c3-4493-94b5-e3e83d81b0c3 admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:14.408843 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.wsgi [None req-06f68559-c9c3-4493-94b5-e3e83d81b0c3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 05 11:44:14.409397 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-06f68559-c9c3-4493-94b5-e3e83d81b0c3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108989) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:44:14.410182 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-06f68559-c9c3-4493-94b5-e3e83d81b0c3 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.075996 Apr 05 11:44:14.410692 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 25/49] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Apr 5 11:44:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 11:44:14.420440 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-c373ba8f-0e33-4922-9979-b5f8f06f8ef2 admin admin] Calling method '>' {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:14.434341 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-c373ba8f-0e33-4922-9979-b5f8f06f8ef2 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017563 Apr 05 11:44:14.434855 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 25/50] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Apr 5 11:44:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:44:14.444608 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-606ddd2f-cac7-41b1-98df-8a1b079f2b1b admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:14.457691 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-606ddd2f-cac7-41b1-98df-8a1b079f2b1b admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017085 Apr 05 11:44:14.458199 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 26/51] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Apr 5 11:44:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:44:14.467442 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-50deefbc-cbce-471d-aea4-c01a0a4433f2 admin admin] Calling method '>' {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:14.473085 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.wsgi [None req-50deefbc-cbce-471d-aea4-c01a0a4433f2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 05 11:44:14.473639 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-50deefbc-cbce-471d-aea4-c01a0a4433f2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108988) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:44:14.474411 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-50deefbc-cbce-471d-aea4-c01a0a4433f2 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010702 Apr 05 11:44:14.474896 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 26/52] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Apr 5 11:44:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 11:44:15.738095 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-606ddd2f-cac7-41b1-98df-8a1b079f2b1b admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:15.739100 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-606ddd2f-cac7-41b1-98df-8a1b079f2b1b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Apr 05 11:44:15.739492 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 27/53] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Apr 5 11:44:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:44:15.946230 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-85298cb3-8d3e-4c5c-b9cc-9939649ea691 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:44:15.966624 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-85298cb3-8d3e-4c5c-b9cc-9939649ea691 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.081593 Apr 05 11:44:15.967152 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 27/54] 10.222.0.61 () {64 vars in 1235 bytes} [Tue Apr 5 11:44:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:44:17.217128 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-606ddd2f-cac7-41b1-98df-8a1b079f2b1b admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:17.218168 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-606ddd2f-cac7-41b1-98df-8a1b079f2b1b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Apr 05 11:44:17.218593 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 28/55] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Apr 5 11:44:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:44:17.416108 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-dc6f8d0b-a8f2-4321-a3d2-49e45f29448d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:44:17.436049 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-dc6f8d0b-a8f2-4321-a3d2-49e45f29448d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.080780 Apr 05 11:44:17.436631 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 28/56] 10.222.0.61 () {64 vars in 1235 bytes} [Tue Apr 5 11:44:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:44:18.698152 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-606ddd2f-cac7-41b1-98df-8a1b079f2b1b admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:18.699458 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-606ddd2f-cac7-41b1-98df-8a1b079f2b1b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001768 Apr 05 11:44:18.699997 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 29/57] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Apr 5 11:44:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:44:18.903145 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-41acb709-ebcb-4d68-b324-1461f93e8d66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:44:18.927959 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-41acb709-ebcb-4d68-b324-1461f93e8d66 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.092150 Apr 05 11:44:18.928726 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 29/58] 10.222.0.61 () {64 vars in 1235 bytes} [Tue Apr 5 11:44:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:44:20.179270 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-606ddd2f-cac7-41b1-98df-8a1b079f2b1b admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:20.180304 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-606ddd2f-cac7-41b1-98df-8a1b079f2b1b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Apr 05 11:44:20.180704 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 30/59] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Apr 5 11:44:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:44:20.380518 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-1b42c7cc-0be2-4603-862c-e87312ffa9e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:44:20.400519 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-1b42c7cc-0be2-4603-862c-e87312ffa9e3 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.082581 Apr 05 11:44:20.401067 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 30/60] 10.222.0.61 () {64 vars in 1235 bytes} [Tue Apr 5 11:44:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 11:44:21.640586 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-606ddd2f-cac7-41b1-98df-8a1b079f2b1b admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:21.641634 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-606ddd2f-cac7-41b1-98df-8a1b079f2b1b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Apr 05 11:44:21.642016 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 31/61] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Apr 5 11:44:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:44:21.839853 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-83f969a6-3d0a-4185-b546-d984976871e0 admin admin] Calling method '>' {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:21.859829 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-83f969a6-3d0a-4185-b546-d984976871e0 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.078859 Apr 05 11:44:21.860409 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 31/62] 10.222.0.61 () {60 vars in 1202 bytes} [Tue Apr 5 11:44:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:45:15.300751 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-606ddd2f-cac7-41b1-98df-8a1b079f2b1b admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:15.302067 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-606ddd2f-cac7-41b1-98df-8a1b079f2b1b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002020 Apr 05 11:45:15.302562 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 32/63] 10.222.0.61 () {54 vars in 930 bytes} [Tue Apr 5 11:45:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:45:15.365485 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-243e0a12-4798-446b-8785-119e7c58f20a admin admin] Calling method '>' {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:15.385327 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-243e0a12-4798-446b-8785-119e7c58f20a admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.076777 Apr 05 11:45:15.385858 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 32/64] 10.222.0.61 () {60 vars in 1291 bytes} [Tue Apr 5 11:45:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:45:15.408270 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-8f091ac4-4f4c-49df-9d1e-17f5f29211b7 admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:15.416343 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-8f091ac4-4f4c-49df-9d1e-17f5f29211b7 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012309 Apr 05 11:45:15.416858 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 33/65] 10.222.0.61 () {60 vars in 1282 bytes} [Tue Apr 5 11:45:15 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:45:15.428240 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-cd85d747-e4f6-4b6e-b0ab-d53e28bae9ea admin admin] Calling method '>' {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:15.435979 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-cd85d747-e4f6-4b6e-b0ab-d53e28bae9ea admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011282 Apr 05 11:45:15.436709 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 33/66] 10.222.0.61 () {60 vars in 1285 bytes} [Tue Apr 5 11:45:15 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:45:15.448060 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-96176dc3-3181-423f-8e55-fd04cd94bb7f admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:15.455823 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-96176dc3-3181-423f-8e55-fd04cd94bb7f admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011492 Apr 05 11:45:15.456355 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 34/67] 10.222.0.61 () {60 vars in 1285 bytes} [Tue Apr 5 11:45:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:45:15.467441 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-46b57043-86bf-4068-99b7-d8fb89daed60 admin admin] Calling method '>' {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:15.475552 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-46b57043-86bf-4068-99b7-d8fb89daed60 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011694 Apr 05 11:45:15.476083 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 34/68] 10.222.0.61 () {60 vars in 1282 bytes} [Tue Apr 5 11:45:15 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:47:02.583711 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-bcb43c37-3d83-4403-8128-baeda568f88c tempest-verify_tempest_config-355146263 tempest-verify_tempest_config-355146263-project] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:47:02.585720 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-bcb43c37-3d83-4403-8128-baeda568f88c tempest-verify_tempest_config-355146263 tempest-verify_tempest_config-355146263-project] 10.222.0.61 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.111259 Apr 05 11:47:02.586273 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 35/69] 10.222.0.61 () {58 vars in 1133 bytes} [Tue Apr 5 11:47:02 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:48:44.107823 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-46b57043-86bf-4068-99b7-d8fb89daed60 admin admin] Calling method '>' {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:48:44.108899 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-46b57043-86bf-4068-99b7-d8fb89daed60 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Apr 05 11:48:44.109258 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 35/70] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Apr 5 11:48:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:48:44.377942 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-29d257cc-3a8b-4414-b434-a2f8a351cd70 admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:48:44.379143 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:48:44.379143 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: warnings.warn(msg) Apr 05 11:48:44.380450 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG oslo_concurrency.lockutils [None req-29d257cc-3a8b-4414-b434-a2f8a351cd70 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:48:44.380916 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG oslo_concurrency.lockutils [None req-29d257cc-3a8b-4414-b434-a2f8a351cd70 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:48:44.381697 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG oslo_concurrency.lockutils [None req-29d257cc-3a8b-4414-b434-a2f8a351cd70 admin admin] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:48:44.382130 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG oslo_concurrency.lockutils [None req-29d257cc-3a8b-4414-b434-a2f8a351cd70 admin admin] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:48:44.414808 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-29d257cc-3a8b-4414-b434-a2f8a351cd70 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.166172 Apr 05 11:48:44.415357 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 36/71] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Apr 5 11:48:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:48:45.665966 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-46b57043-86bf-4068-99b7-d8fb89daed60 admin admin] Calling method '>' {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:48:45.666977 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-46b57043-86bf-4068-99b7-d8fb89daed60 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Apr 05 11:48:45.667370 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 36/72] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Apr 5 11:48:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:48:45.864916 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-92b106a1-9f31-4490-b77a-dda7dc1b4ac7 admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:48:45.866131 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:48:45.866131 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: warnings.warn(msg) Apr 05 11:48:45.867318 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG oslo_concurrency.lockutils [None req-92b106a1-9f31-4490-b77a-dda7dc1b4ac7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:48:45.868137 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG oslo_concurrency.lockutils [None req-92b106a1-9f31-4490-b77a-dda7dc1b4ac7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:48:45.868951 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG oslo_concurrency.lockutils [None req-92b106a1-9f31-4490-b77a-dda7dc1b4ac7 admin admin] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:48:45.869386 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG oslo_concurrency.lockutils [None req-92b106a1-9f31-4490-b77a-dda7dc1b4ac7 admin admin] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:48:45.889096 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-92b106a1-9f31-4490-b77a-dda7dc1b4ac7 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.082763 Apr 05 11:48:45.889643 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 37/73] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Apr 5 11:48:45 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:48:57.596304 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-46b57043-86bf-4068-99b7-d8fb89daed60 admin admin] Calling method '>' {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:48:57.597313 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-46b57043-86bf-4068-99b7-d8fb89daed60 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Apr 05 11:48:57.597712 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 37/74] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Apr 5 11:48:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:48:57.803170 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-8efe9bef-844f-4258-9728-b16370e797f4 admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:48:57.804441 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:48:57.804441 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: warnings.warn(msg) Apr 05 11:48:57.805650 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG oslo_concurrency.lockutils [None req-8efe9bef-844f-4258-9728-b16370e797f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:48:57.806095 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG oslo_concurrency.lockutils [None req-8efe9bef-844f-4258-9728-b16370e797f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:48:57.806904 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG oslo_concurrency.lockutils [None req-8efe9bef-844f-4258-9728-b16370e797f4 admin admin] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:48:57.807333 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG oslo_concurrency.lockutils [None req-8efe9bef-844f-4258-9728-b16370e797f4 admin admin] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:48:57.831249 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-8efe9bef-844f-4258-9728-b16370e797f4 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087644 Apr 05 11:48:57.831791 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 38/75] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Apr 5 11:48:57 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:48:59.100674 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: DEBUG nova.api.openstack.wsgi [None req-46b57043-86bf-4068-99b7-d8fb89daed60 admin admin] Calling method '>' {{(pid=108988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:48:59.101697 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: INFO nova.api.openstack.requestlog [None req-46b57043-86bf-4068-99b7-d8fb89daed60 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Apr 05 11:48:59.102120 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: [pid: 108988|app: 0|req: 38/76] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Apr 5 11:48:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:48:59.295830 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG nova.api.openstack.wsgi [None req-fc67555e-e5e5-4e62-9143-fe5d7fe778a6 admin admin] Calling method '>' {{(pid=108989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:48:59.297031 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:48:59.297031 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: warnings.warn(msg) Apr 05 11:48:59.298214 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG oslo_concurrency.lockutils [None req-fc67555e-e5e5-4e62-9143-fe5d7fe778a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:48:59.298648 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG oslo_concurrency.lockutils [None req-fc67555e-e5e5-4e62-9143-fe5d7fe778a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:48:59.299423 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG oslo_concurrency.lockutils [None req-fc67555e-e5e5-4e62-9143-fe5d7fe778a6 admin admin] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:48:59.299843 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: DEBUG oslo_concurrency.lockutils [None req-fc67555e-e5e5-4e62-9143-fe5d7fe778a6 admin admin] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:48:59.320613 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: INFO nova.api.openstack.requestlog [None req-fc67555e-e5e5-4e62-9143-fe5d7fe778a6 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082003 Apr 05 11:48:59.321092 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: [pid: 108989|app: 0|req: 39/77] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Apr 5 11:48:59 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:49:59.473587 dv-cinder-829565-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 05 11:49:59.474251 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: Tue Apr 5 11:49:59 2022 - graceful shutdown triggered... Apr 05 11:49:59.474728 dv-cinder-829565-3-iscsi devstack@n-api.service[108989]: Gracefully killing worker 2 (pid: 108989)... Apr 05 11:49:59.475094 dv-cinder-829565-3-iscsi devstack@n-api.service[108988]: Gracefully killing worker 1 (pid: 108988)... Apr 05 11:50:00.475199 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: worker 1 buried after 1 seconds Apr 05 11:50:00.475199 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: worker 2 buried after 1 seconds Apr 05 11:50:00.475199 dv-cinder-829565-3-iscsi devstack@n-api.service[108987]: goodbye to uWSGI. Apr 05 11:50:00.477805 dv-cinder-829565-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Apr 05 11:50:00.479153 dv-cinder-829565-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 05 11:50:00.483959 dv-cinder-829565-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 05 11:50:00.511257 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 05 11:50:00.535786 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Apr 5 11:50:00 2022] *** Apr 05 11:50:00.535786 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 05 11:50:00.535786 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 05 11:50:00.535786 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: nodename: dv-cinder-829565-3-iscsi Apr 05 11:50:00.535786 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: machine: x86_64 Apr 05 11:50:00.535786 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: clock source: unix Apr 05 11:50:00.535786 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: pcre jit disabled Apr 05 11:50:00.535786 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: detected number of CPU cores: 4 Apr 05 11:50:00.535786 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: current working directory: / Apr 05 11:50:00.535786 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: detected binary path: /usr/bin/uwsgi-core Apr 05 11:50:00.535786 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: your processes number limit is 47680 Apr 05 11:50:00.535786 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: your memory page size is 4096 bytes Apr 05 11:50:00.535786 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: detected max file descriptor number: 2048 Apr 05 11:50:00.535786 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: lock engine: pthread robust mutexes Apr 05 11:50:00.536975 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: thunder lock: enabled Apr 05 11:50:00.536975 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 05 11:50:00.536975 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 05 11:50:00.580379 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: Python main interpreter initialized at 0x56195d28d9c0 Apr 05 11:50:00.580379 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: python threads support enabled Apr 05 11:50:00.580379 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: your server socket listen backlog is limited to 100 connections Apr 05 11:50:00.580379 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: your mercy for graceful operations on workers is 90 seconds Apr 05 11:50:00.580766 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: mapped 403077 bytes (393 KB) for 2 cores Apr 05 11:50:00.580766 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: *** Operational MODE: preforking *** Apr 05 11:50:00.581043 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: *** uWSGI is running in multiple interpreter mode *** Apr 05 11:50:00.581043 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: spawned uWSGI master process (pid: 123342) Apr 05 11:50:00.581277 dv-cinder-829565-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 05 11:50:00.581766 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: spawned uWSGI worker 1 (pid: 123357, cores: 1) Apr 05 11:50:00.583018 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: spawned uWSGI worker 2 (pid: 123358, cores: 1) Apr 05 11:50:00.583018 dv-cinder-829565-3-iscsi devstack@n-api.service[123342]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 05 11:50:01.766317 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 05 11:50:01.766958 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 05 11:50:02.669943 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:50:02.669943 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: from cryptography.utils import int_from_bytes Apr 05 11:50:02.670292 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:50:02.670292 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: from cryptography.utils import int_from_bytes Apr 05 11:50:02.670423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:50:02.670423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: from cryptography.utils import int_from_bytes Apr 05 11:50:02.670556 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:50:02.670556 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: from cryptography.utils import int_from_bytes Apr 05 11:50:04.985697 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:50:04.986389 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 05 11:50:04.986484 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 05 11:50:04.986825 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 05 11:50:04.987058 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 05 11:50:04.987477 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.987805 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.988133 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.988474 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.989164 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.989477 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.989800 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.990091 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.990423 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.990701 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.991000 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.991397 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-829565-3-iscsi {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.991676 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.992014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.992359 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.992662 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.992964 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.993291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.993598 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.994095 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.995655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.995655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.995655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.995655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.996580 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.996580 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.996580 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.997224 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.997224 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.997672 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.997672 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-829565-3-iscsi {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.998085 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.998290 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.998594 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.998994 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.999308 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.999619 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:04.999944 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.000371 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.000691 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.001021 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.001345 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.001693 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.001988 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.002291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.002616 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.002925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.003235 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.003543 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.003850 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.004106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.004439 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.004761 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.005083 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.005404 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.005650 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.005918 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.006262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.006539 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.006869 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.007207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.007510 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.007818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.008148 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.008453 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.008760 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.009068 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.009381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.009695 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.010020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.010319 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.010634 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.011067 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.011275 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.011581 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.011917 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.012255 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.012568 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.012883 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.013203 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.013509 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.013817 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.014123 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.014442 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.014776 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.015081 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.015332 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.015632 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.015941 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.016282 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.016586 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.016891 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.017197 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.017498 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.017801 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.018105 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.018408 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.018710 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.019013 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.019316 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.019620 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.019924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.020254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.020570 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.020885 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.021257 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.021481 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.021782 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.022077 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.022388 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.022719 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.023019 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.023337 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.023643 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.023947 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.024286 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.024623 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.024887 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.025205 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.025504 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.025815 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.026132 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.026437 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.026742 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.027105 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.027344 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.027648 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.027951 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.028277 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.028582 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.028880 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.029202 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.029507 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.029813 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.030118 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.030444 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.030736 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.031075 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.031405 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.031814 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.032100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.032402 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.032797 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.033046 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.033360 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.033673 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.033997 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.034312 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.034620 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.034932 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.035260 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.035566 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.035899 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.036236 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.036556 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.036879 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.037210 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.037503 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.037831 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.038202 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.038514 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.038853 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.039195 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.039507 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.039830 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.040183 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.040492 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.040801 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.041117 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.041440 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.041773 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.042306 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.042471 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.042685 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.042996 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.043306 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.043617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.043928 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.044286 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.044602 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.044916 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.045226 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.045541 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.045857 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.046167 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.046476 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.046778 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.047080 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.047386 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.047692 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.047995 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.048338 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.049220 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.049220 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.053262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.053262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.053262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.053262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.053262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.053262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.053262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.053262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.056207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.056207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.056207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.056207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.056207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.056207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.056207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.056207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.057381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.057381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.057381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.057381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.057381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.057381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.057381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.057381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.058483 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.058483 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.058483 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.058483 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.058483 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.059212 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:50:05.059703 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.059850 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 05 11:50:05.060001 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.060001 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.060867 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 05 11:50:05.061040 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.061188 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 05 11:50:05.061373 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.061530 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 05 11:50:05.061684 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.063458 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.063634 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.063634 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.063927 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.064111 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.064287 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.064446 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.064621 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.064818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.064988 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.065143 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.065299 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.065454 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.065605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.065767 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.065913 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.066057 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.066215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.066361 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.066506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.066506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.066506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-829565-3-iscsi {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.066972 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.067132 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.067285 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.067429 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.070325 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.070521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.070708 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.070871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.071021 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.071178 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.071334 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.071490 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.071490 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.071793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.071793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.072146 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.072336 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.072482 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.072640 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.072784 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.072934 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.073086 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.073241 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.073433 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.073583 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.073728 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.073879 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.074031 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.074194 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.074356 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.074501 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.074644 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.074787 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.074937 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.075092 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.075239 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.075353 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.075435 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-829565-3-iscsi {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.075514 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.075598 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.075692 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.075777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.075861 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.075956 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.076041 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.076154 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.076260 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.076355 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.076441 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.076532 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.076628 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.076726 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.076822 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.076920 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.077007 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.077102 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.077197 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.077288 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.077382 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.077469 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.077566 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.077677 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.077792 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.077898 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.077999 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.078086 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.078170 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.078254 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.078344 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.078436 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.078535 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.078628 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.078799 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.078894 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.078989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.078989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.078989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.078989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.078989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.079390 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.079482 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.079482 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.079482 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.079482 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.079801 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.079888 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.079888 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.079888 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.079888 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.080262 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.080355 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.080355 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.080355 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.080355 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.080355 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.080750 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.080909 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.080998 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.083854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.083991 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.084110 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.084214 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.084318 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.084416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.084630 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.084807 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.084897 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.085034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.085034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.085034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.085343 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.085516 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.085607 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.085704 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.085789 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.085882 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.085983 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.085983 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.086145 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.086229 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.086229 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.086229 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.086229 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.086605 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.086854 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.087050 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.087366 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.087492 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.087674 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.087995 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.088137 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.088363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.088652 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.091347 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.091347 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.091565 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.091565 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.091748 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.092410 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.092594 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.092594 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.092793 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.092888 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.093029 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.093029 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.093224 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.093311 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.093402 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.093402 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.093557 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.093656 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.093656 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.095927 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.096032 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.096032 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.096292 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.096387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.096387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.096387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.096387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.096387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.096387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.096387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.096387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.096963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.096963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.096963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.097205 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.097486 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.097786 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.097891 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.098100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.098195 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.098460 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.098752 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.098963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.099230 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.099344 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.099606 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.099870 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.099988 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.100372 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.100545 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.100928 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.101108 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.101256 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.101409 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.101767 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.101871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.102126 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.102302 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.102461 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.102801 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.102906 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.103112 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.103378 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.103483 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.103763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.103989 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.104137 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.104446 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.104569 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.105438 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.105581 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.105789 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.105894 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.106024 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.106024 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.106186 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.106276 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.106276 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.106623 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.106726 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.106930 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.107229 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.107324 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.107549 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.107806 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.107904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.108166 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.108427 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.108535 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.108770 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.109014 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.109109 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.109372 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.109591 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.109724 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.109976 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.110191 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.110289 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.110585 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.110759 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.110863 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.111165 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.111342 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.111469 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.111783 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.112449 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.112581 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.112672 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.112763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.112763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.112986 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.113083 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.113296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.113570 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.114052 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.114262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.114526 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.114625 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.114903 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.115613 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.115710 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.115804 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.115895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.115895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.116097 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.116219 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.116389 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.116693 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.116785 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.117015 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.117292 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.117383 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.117616 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.117867 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.117957 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.118215 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.118452 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.118633 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.118806 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.119059 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.119156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.119427 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.119643 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.119742 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.120035 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.120243 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.120371 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.120678 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.120837 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.120985 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.121291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.121389 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.121603 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.121903 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.121993 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.122189 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.122490 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.122587 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.122791 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.123067 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.123165 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.123404 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.123659 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.123749 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.124006 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.124250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.124347 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.124629 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.124826 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.125011 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.125703 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.125818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.125818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.125991 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.126075 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.126245 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.126436 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.126541 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.126837 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.127025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.127148 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.127461 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.127587 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.127766 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.128584 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.128678 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.128762 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.128861 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.128952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.129041 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.129276 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.129423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.129595 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.130054 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.130159 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.130253 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.130471 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.130577 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.130845 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.131084 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:50:05.131185 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.131431 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.131695 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.131809 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.132135 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.132419 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.132511 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.132728 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.133029 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.133167 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.133338 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.133635 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.133728 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.133944 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.134240 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.134356 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.134551 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.134860 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.134949 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.135809 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.136029 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.136156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.136284 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.136405 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.136405 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.136563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.136646 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.136731 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.136973 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.137177 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.137267 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.137573 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.137758 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.137877 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.138291 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.138427 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.138615 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.138875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.138979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.139222 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.139473 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.139563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.139827 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.140059 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.140177 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.140488 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.140685 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.140784 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.141207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.141343 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.141519 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.141754 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.141893 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.142127 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.142265 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.142436 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.142621 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.142744 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.142947 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.143074 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.143476 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.143636 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.143636 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.143885 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.144025 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.144193 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.144333 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.145069 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.145227 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.145601 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.146236 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.146368 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.146533 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.146678 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.146805 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.146939 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.147072 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.147197 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.147313 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.147453 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.147634 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.147745 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.147852 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.147960 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.148151 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.148290 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.148416 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.148549 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.148675 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.148807 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.148946 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.149072 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.149203 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.149328 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.149452 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.149584 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.149724 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.149857 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.149991 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.150123 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.150247 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.150371 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.150504 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.150696 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.150825 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.150957 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.151090 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.151223 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.151348 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.151474 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.151607 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.151739 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.151865 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.151997 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.152138 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.152264 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.152387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.152554 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.152687 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.152822 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.152955 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.153088 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.153212 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.153336 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.153467 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.153605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.153731 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.153862 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.153996 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.154136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.154270 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.154402 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.154559 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.154837 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.154975 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.155102 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.155304 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.155653 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.155797 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.156407 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.156542 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.156669 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.156804 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.156930 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.157063 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.157188 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.157320 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.157446 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.157579 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.157713 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.157839 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.157963 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.158096 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.158241 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.158367 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.158500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.158634 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.158798 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.158924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.159057 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.159193 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.159319 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.159442 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.159566 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.159699 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.159833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.159966 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.160120 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.160250 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.160387 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.160514 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.160677 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.160807 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.160933 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.161066 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.161199 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.161334 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.161460 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.161639 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.161768 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.161893 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.162054 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.162192 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.162364 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.162501 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.162775 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.162941 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.163142 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.163290 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.163426 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.163561 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.163686 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.163812 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.163984 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.164201 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.164334 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.164461 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.164585 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.164710 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.164895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.165025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.165204 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.165363 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.165516 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.165834 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.166231 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.166446 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.166655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.166838 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.166955 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.167072 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.167192 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.167301 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.167416 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.167526 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.167634 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.167741 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.167860 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.167977 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.168118 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.168232 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.168341 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.168467 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.168586 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.168696 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.168804 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.168919 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.169035 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.169187 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.169360 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.169527 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.169665 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.169854 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.169997 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.170184 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.170315 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.170528 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.170659 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.170853 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.170989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.171172 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.171309 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.171490 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.171618 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.171808 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.172023 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.172231 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.172358 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.172472 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.172648 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.173301 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.173430 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.173559 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.173700 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.173843 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.173970 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.174105 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.174240 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.174374 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.174508 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.174645 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.174843 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.174982 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.175127 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.175261 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.175386 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.175510 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.175643 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.175992 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.175992 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.176590 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.176739 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.176868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.176980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.177105 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.177229 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.177451 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.177612 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.177743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.177869 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.178006 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.178140 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.178266 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.178402 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.178536 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.178713 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.178853 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.178989 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.179117 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.179250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.179375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.179507 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.179633 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.179758 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.179890 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.180018 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.180184 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.180324 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.180450 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.180584 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.180709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.180833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.180958 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.181168 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.181307 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.181518 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.181660 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.181824 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.181966 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.182143 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.182273 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.182472 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.182600 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.182787 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.182954 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.183090 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.183223 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.183392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.183521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.183700 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.183911 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.184039 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.184203 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.184342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.184467 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.184632 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.184763 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.184944 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.185074 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.185256 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.185384 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.185573 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.185710 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.185898 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.186029 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.186212 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.186333 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.186519 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.186653 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.186832 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.187106 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.187238 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.187448 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.187562 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.187835 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.187969 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.188184 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.188326 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.188519 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.188659 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.188848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.188989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.189161 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.189297 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.189476 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.189607 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.189803 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.189932 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.190121 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.190258 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.190436 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.190567 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.190741 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.190908 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.191062 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.191196 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.191335 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.191467 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.191633 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.191769 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.191956 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.192148 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.192276 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.192413 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.192577 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.192715 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.192898 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.193036 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.193208 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.193346 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.193522 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.193740 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.193880 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.194094 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.194224 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.194441 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.194579 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.194777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.194926 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.195096 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.195199 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.195410 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.195511 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.195718 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.195827 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.196028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.196215 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.196360 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.196472 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.196665 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.196918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.197052 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.197184 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.197317 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.197442 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.197582 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.197841 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.197841 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.198086 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.198210 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.198334 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.198470 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.198729 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.198857 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.199038 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.199176 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.199342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.199480 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.199667 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.199803 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.199972 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.200145 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.200288 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.200423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.200591 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.200727 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.200901 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.201045 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.201205 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.201334 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.201510 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.201661 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.201815 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.201944 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.202117 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.202277 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.202412 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.202547 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.202715 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.202843 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.203022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.203161 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.203325 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.203463 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.203634 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.203770 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.203937 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.204106 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.204335 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.204480 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.204606 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.204737 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.204863 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.204995 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.205166 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.205297 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.205489 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.205617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.205797 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.205926 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.206108 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.206216 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.206414 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.206507 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.206739 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.206840 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.207113 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.207222 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.207508 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.207618 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.207821 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.207929 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.208151 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.208432 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.208535 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.208774 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.208861 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.209098 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.209185 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.209434 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.209515 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.209767 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.209866 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.210097 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.210196 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.210404 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.210502 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.210712 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.210810 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.211020 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.211117 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.211327 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.211415 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.211632 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.211730 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.211940 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.212037 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.212276 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.212375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.212583 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.212688 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.212894 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.212988 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.213201 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.213290 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.213508 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.213607 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.213818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.213915 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.214125 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.214223 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.214430 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.214521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.214734 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.214831 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.215046 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.215135 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.215352 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.215442 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.215662 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.215752 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.215966 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.216100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.216309 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.216411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.216622 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.216721 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.216928 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.217033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.217237 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.217326 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.217541 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.217632 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.217847 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.217950 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.218152 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.218241 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.218456 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.218545 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.218765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.218862 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.219074 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.219173 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.219382 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.219495 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.219688 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.219811 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.220015 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.220173 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.220372 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.220464 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.220682 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.220786 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.220989 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.221095 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.221304 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.221393 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.221615 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.221796 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.221948 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.222096 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.222240 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.222382 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.222540 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.222693 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.222844 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.223029 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.223219 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.223376 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.223530 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.223680 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.223822 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.223963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.224135 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.224296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.224439 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.224591 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.224733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.224917 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.225064 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.225220 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.225382 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.225538 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.225747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.225891 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.226049 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.226195 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.226354 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.226711 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.227113 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.227358 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.227516 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.227662 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.227802 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.227954 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.228122 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.228269 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.228433 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.228584 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.228734 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.228884 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.229025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.229166 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.229368 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.229521 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.229669 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.229818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.229818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.230124 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.230267 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.230417 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.230565 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.230714 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.230855 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.231004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.231145 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.231286 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.231433 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.231576 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.231717 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.231880 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.232023 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.232208 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.232362 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.232506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.232649 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.232799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.232940 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.233089 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.233239 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.233388 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.233543 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.233821 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.233981 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.234122 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.234270 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.234414 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.234569 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.234720 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.234862 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.235015 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.235168 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.235318 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.235488 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.235735 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.235906 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.236067 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.236243 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.236387 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.236788 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.236959 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.237380 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.237613 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.237771 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.237913 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.238069 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.238220 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.238362 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.238521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.239033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.239246 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.239246 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.239524 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.239524 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.239795 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.239795 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.240091 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.240251 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.240401 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.240544 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.240695 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.240836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.240988 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.241137 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.241343 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.241493 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.241647 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.241798 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.241946 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.242088 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.242240 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.242381 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.242528 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.242694 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.242844 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.242844 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.243123 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.243266 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.243408 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.243563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.243706 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.243928 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.244092 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.244251 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.244467 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.244467 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.244757 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.244907 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.245056 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.245198 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.245347 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.245489 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.245630 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.245630 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.245906 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.246062 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.246214 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.246356 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.246506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.246653 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.246927 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.247097 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.247494 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.247657 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 05 11:50:05.247882 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.247882 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.247882 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.247882 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.247882 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.247882 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.247882 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.247882 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.249004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.249004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.249004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.249429 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.249571 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.249840 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.250154 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.250480 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.250805 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.251130 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.251440 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.251755 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.252067 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.252417 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.252749 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.253067 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.253387 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.253695 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.254021 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.254344 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.254662 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.254988 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.255423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.255750 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.256067 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.256458 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.256750 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.257120 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.257471 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.257713 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.258025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.258333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.258660 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.258970 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.259285 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.259600 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.259916 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.260252 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.260561 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.260888 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.261194 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.261521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.261840 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.262166 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.262490 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.262799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.263122 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.263470 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.263993 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.264134 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.264543 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.264905 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.265028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.267694 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.267694 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.267694 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.268056 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.268204 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.271331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.271331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.271331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.271331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.271331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.272125 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_db.sqlalchemy.engines [None req-b2b2ecdb-e553-4e0d-9ae6-3cd19c4c249a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:50:05.272243 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.272243 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.272243 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.272243 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.272243 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.272243 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.272243 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.272243 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.272950 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.272950 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.273111 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.273439 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.273756 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.274069 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.274383 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.274691 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.275034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.275343 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.275682 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.276015 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.276377 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.276714 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.277030 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.277357 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.277680 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.278001 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.278322 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.278644 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.278961 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.279278 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.279593 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.279908 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.280259 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.280579 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.280900 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.281471 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.281802 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.282120 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.282439 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.282755 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.283071 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.283387 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.283700 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.284014 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.284360 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.284675 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.285008 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.285331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.285656 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.285996 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.286313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.286630 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.286945 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.287260 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.287619 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.287938 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.288302 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.288616 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.288932 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.289245 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.289562 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.289876 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.290194 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.290507 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.290819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.291134 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.291446 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.291760 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.292114 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.292452 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.292774 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.293089 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.293405 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.293720 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.294239 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.294556 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.294891 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.295213 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.295541 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.295866 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.296215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.296546 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.296853 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.297159 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.297472 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.297785 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.298094 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.298417 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.298730 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.299035 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.299356 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.299668 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.300238 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.300595 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.300914 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.301245 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.301571 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.301891 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.302201 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.302528 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.302837 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.303145 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.303462 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.303819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.304145 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.304455 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.304772 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.305085 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.305388 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.305705 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.306010 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.306336 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.306653 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.306960 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.307266 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.307577 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.307884 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.308214 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.308521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.308829 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.309141 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.309443 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.309754 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.310056 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.310369 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.310673 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.310982 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.311332 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.311657 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.311963 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.312297 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.312616 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.312929 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.313270 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.313584 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.313897 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.314243 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.314562 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.315099 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.315434 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.315761 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.316116 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.316454 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.316763 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.317068 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.317372 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.317703 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.318016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.318330 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.318642 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.318956 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.319268 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.319597 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.319911 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.320250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.320563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.320873 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.321212 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.321492 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.321806 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.322151 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.322475 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.322795 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.323115 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.323434 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.323747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.324106 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.324427 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.324736 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.325051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.325385 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.325705 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.326009 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.326400 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.326714 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.327035 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.327357 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.327702 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.328028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.328347 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.328680 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.328984 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.329312 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.329640 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.329978 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.330301 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.330623 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.330928 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.331232 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.331487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.context [None req-b2b2ecdb-e553-4e0d-9ae6-3cd19c4c249a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c02b48b4-c051-4569-8fb4-e9dd7f34ad69(cell1) {{(pid=123358) load_cells /opt/stack/nova/nova/context.py:464}} Apr 05 11:50:05.331665 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.331820 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.332165 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.332477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.332777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.333082 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.333391 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.333699 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.334004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.334308 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.334611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.334941 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.335254 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.335561 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.335873 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.336063 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b2b2ecdb-e553-4e0d-9ae6-3cd19c4c249a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:50:05.336259 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.336492 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.336799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.337109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.337413 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.337580 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b2b2ecdb-e553-4e0d-9ae6-3cd19c4c249a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:50:05.337746 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.338009 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.338318 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.338486 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b2b2ecdb-e553-4e0d-9ae6-3cd19c4c249a None None] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:50:05.338682 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.338947 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.339309 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.339610 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.339940 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.340277 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.340438 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b2b2ecdb-e553-4e0d-9ae6-3cd19c4c249a None None] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:50:05.340619 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.340898 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.341220 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.341543 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.341858 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.342171 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.342505 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.342816 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.343128 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.343529 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.343848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.344180 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.344495 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.344824 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.345150 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.345460 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.345790 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.346201 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.346529 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.346855 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.347167 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.347496 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.347811 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.348145 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.348463 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.348781 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.349237 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.349487 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.349726 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.350052 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.350957 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.350957 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.351160 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.351388 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.351704 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.352051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.352411 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.352547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_db.sqlalchemy.engines [None req-b2b2ecdb-e553-4e0d-9ae6-3cd19c4c249a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:50:05.352727 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.353037 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.353345 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:50:05.353444 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_db.sqlalchemy.engines [None req-b2b2ecdb-e553-4e0d-9ae6-3cd19c4c249a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:50:05.353592 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 05 11:50:05.377217 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_db.sqlalchemy.engines [None req-321531d6-ce83-4450-a72c-741049fdfb41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:50:05.439727 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.context [None req-321531d6-ce83-4450-a72c-741049fdfb41 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c02b48b4-c051-4569-8fb4-e9dd7f34ad69(cell1) {{(pid=123357) load_cells /opt/stack/nova/nova/context.py:464}} Apr 05 11:50:05.444156 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-321531d6-ce83-4450-a72c-741049fdfb41 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:50:05.445833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-321531d6-ce83-4450-a72c-741049fdfb41 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:50:05.446647 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-321531d6-ce83-4450-a72c-741049fdfb41 None None] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:50:05.448671 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-321531d6-ce83-4450-a72c-741049fdfb41 None None] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:50:05.459447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_db.sqlalchemy.engines [None req-321531d6-ce83-4450-a72c-741049fdfb41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:50:05.461344 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_db.sqlalchemy.engines [None req-321531d6-ce83-4450-a72c-741049fdfb41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:50:05.511757 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_db.sqlalchemy.engines [None req-b2b2ecdb-e553-4e0d-9ae6-3cd19c4c249a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:50:05.613373 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_db.sqlalchemy.engines [None req-321531d6-ce83-4450-a72c-741049fdfb41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:50:05.969495 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: WARNING keystonemiddleware.auth_token [None req-b2b2ecdb-e553-4e0d-9ae6-3cd19c4c249a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:50:05.976673 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: WARNING keystonemiddleware.auth_token [None req-b2b2ecdb-e553-4e0d-9ae6-3cd19c4c249a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:50:06.048604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: WARNING keystonemiddleware.auth_token [None req-321531d6-ce83-4450-a72c-741049fdfb41 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:50:06.055638 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: WARNING keystonemiddleware.auth_token [None req-321531d6-ce83-4450-a72c-741049fdfb41 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:50:06.219925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: WARNING keystonemiddleware.auth_token [None req-b2b2ecdb-e553-4e0d-9ae6-3cd19c4c249a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:50:06.225377 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: WARNING keystonemiddleware.auth_token [None req-b2b2ecdb-e553-4e0d-9ae6-3cd19c4c249a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:50:06.230733 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56195d28d9c0 pid: 123358 (default app) Apr 05 11:50:06.277544 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: WARNING keystonemiddleware.auth_token [None req-321531d6-ce83-4450-a72c-741049fdfb41 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:50:06.282773 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: WARNING keystonemiddleware.auth_token [None req-321531d6-ce83-4450-a72c-741049fdfb41 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:50:06.288179 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56195d28d9c0 pid: 123357 (default app) Apr 05 11:50:48.680103 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1415379c-e38f-409e-91ea-d256c5abecc5 tempest-VolumesNegativeTest-491450141 tempest-VolumesNegativeTest-491450141-project] Action: 'create', calling method: .version_select at 0x7f161d0ac310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1481873290", "metadata": {"Type": "work"}}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:50:48.684038 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1415379c-e38f-409e-91ea-d256c5abecc5 tempest-VolumesNegativeTest-491450141 tempest-VolumesNegativeTest-491450141-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:50:48.685167 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1415379c-e38f-409e-91ea-d256c5abecc5 tempest-VolumesNegativeTest-491450141 tempest-VolumesNegativeTest-491450141-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.452298 Apr 05 11:50:48.690234 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1/1] 10.222.0.61 () {60 vars in 1155 bytes} [Tue Apr 5 11:50:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1459 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 05 11:50:48.979951 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-368c359c-6885-4d9a-bbf2-f1bb9e2abe54 tempest-VolumesNegativeTest-491450141 tempest-VolumesNegativeTest-491450141-project] Action: 'create', calling method: .version_select at 0x7f161d1350d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-618003687", "metadata": {"Type": "work"}}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:50:48.982604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-368c359c-6885-4d9a-bbf2-f1bb9e2abe54 tempest-VolumesNegativeTest-491450141 tempest-VolumesNegativeTest-491450141-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:50:48.984170 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-368c359c-6885-4d9a-bbf2-f1bb9e2abe54 tempest-VolumesNegativeTest-491450141 tempest-VolumesNegativeTest-491450141-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.291106 Apr 05 11:50:48.999409 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b3058c40-5917-4f39-8cea-5e2380d20021 tempest-VolumesNegativeTest-491450141 tempest-VolumesNegativeTest-491450141-project] Action: 'create', calling method: .version_select at 0x7f161cfd8160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1395296210", "metadata": {"Type": "work"}}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:50:49.001437 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b3058c40-5917-4f39-8cea-5e2380d20021 tempest-VolumesNegativeTest-491450141 tempest-VolumesNegativeTest-491450141-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:50:49.002360 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b3058c40-5917-4f39-8cea-5e2380d20021 tempest-VolumesNegativeTest-491450141 tempest-VolumesNegativeTest-491450141-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010919 Apr 05 11:50:49.002917 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2/2] 10.222.0.61 () {60 vars in 1155 bytes} [Tue Apr 5 11:50:48 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 05 11:50:49.004817 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1/3] 10.222.0.61 () {60 vars in 1155 bytes} [Tue Apr 5 11:50:48 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 314 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 05 11:50:49.015960 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a1ab1bea-fb3b-432a-9d1b-7941131d0a97 tempest-VolumesNegativeTest-491450141 tempest-VolumesNegativeTest-491450141-project] Calling method '.version_select at 0x7f161d0ac940>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:50:49.427453 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.wsgi [None req-a1ab1bea-fb3b-432a-9d1b-7941131d0a97 tempest-VolumesNegativeTest-491450141 tempest-VolumesNegativeTest-491450141-project] HTTP exception thrown: Volume tempest-invalid-222212523 could not be found. Apr 05 11:50:49.428511 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a1ab1bea-fb3b-432a-9d1b-7941131d0a97 tempest-VolumesNegativeTest-491450141 tempest-VolumesNegativeTest-491450141-project] Returning 404 to user: Volume tempest-invalid-222212523 could not be found. {{(pid=123358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:50:49.430241 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a1ab1bea-fb3b-432a-9d1b-7941131d0a97 tempest-VolumesNegativeTest-491450141 tempest-VolumesNegativeTest-491450141-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/tempest-invalid-222212523" status: 404 len: 98 microversion: 2.1 time: 0.419633 Apr 05 11:50:49.430906 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 3/4] 10.222.0.61 () {58 vars in 1214 bytes} [Tue Apr 5 11:50:49 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-222212523 => generated 98 bytes in 421 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 05 11:50:49.444606 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0d4445ef-681b-4955-8209-ded5e88da792 tempest-VolumesNegativeTest-491450141 tempest-VolumesNegativeTest-491450141-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005271 Apr 05 11:50:49.448979 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 2/5] 10.222.0.61 () {58 vars in 1139 bytes} [Tue Apr 5 11:50:49 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 05 11:50:49.461747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c675f97b-387e-4d67-bf12-8b6be393e70f tempest-VolumesNegativeTest-491450141 tempest-VolumesNegativeTest-491450141-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007092 Apr 05 11:50:49.462567 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 4/6] 10.222.0.61 () {58 vars in 1136 bytes} [Tue Apr 5 11:50:49 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 05 11:50:49.472980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2571ac39-443f-4f04-943c-8eb9a92b8c80 tempest-VolumesNegativeTest-491450141 tempest-VolumesNegativeTest-491450141-project] Calling method '.version_select at 0x7f161d8d6af0>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:50:49.807191 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-2571ac39-443f-4f04-943c-8eb9a92b8c80 tempest-VolumesNegativeTest-491450141 tempest-VolumesNegativeTest-491450141-project] HTTP exception thrown: Volume a44c9485-5ca2-4832-bddf-971afaffe4da could not be found. Apr 05 11:50:49.808948 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2571ac39-443f-4f04-943c-8eb9a92b8c80 tempest-VolumesNegativeTest-491450141 tempest-VolumesNegativeTest-491450141-project] Returning 404 to user: Volume a44c9485-5ca2-4832-bddf-971afaffe4da could not be found. {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:50:49.811604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2571ac39-443f-4f04-943c-8eb9a92b8c80 tempest-VolumesNegativeTest-491450141 tempest-VolumesNegativeTest-491450141-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/a44c9485-5ca2-4832-bddf-971afaffe4da" status: 404 len: 109 microversion: 2.1 time: 0.341735 Apr 05 11:50:49.812899 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 3/7] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Apr 5 11:50:49 2022] DELETE /compute/v2.1/os-volumes/a44c9485-5ca2-4832-bddf-971afaffe4da => generated 109 bytes in 345 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:50:49.822833 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4697931d-010f-463c-94f9-349d3b615868 tempest-VolumesNegativeTest-491450141 tempest-VolumesNegativeTest-491450141-project] Calling method '.version_select at 0x7f161cf80f70>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:50:49.853569 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.wsgi [None req-4697931d-010f-463c-94f9-349d3b615868 tempest-VolumesNegativeTest-491450141 tempest-VolumesNegativeTest-491450141-project] HTTP exception thrown: Volume bb7d4889-dd70-46a3-b6f9-75b16f805189 could not be found. Apr 05 11:50:49.854233 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4697931d-010f-463c-94f9-349d3b615868 tempest-VolumesNegativeTest-491450141 tempest-VolumesNegativeTest-491450141-project] Returning 404 to user: Volume bb7d4889-dd70-46a3-b6f9-75b16f805189 could not be found. {{(pid=123358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:50:49.855469 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4697931d-010f-463c-94f9-349d3b615868 tempest-VolumesNegativeTest-491450141 tempest-VolumesNegativeTest-491450141-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/bb7d4889-dd70-46a3-b6f9-75b16f805189" status: 404 len: 109 microversion: 2.1 time: 0.036620 Apr 05 11:50:49.856106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 5/8] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Apr 5 11:50:49 2022] GET /compute/v2.1/os-volumes/bb7d4889-dd70-46a3-b6f9-75b16f805189 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:50:50.914250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a5bcfa5b-afad-4d72-b376-0a4df6c69e60 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2146344995", "imageRef": "2b657785-cb0b-43ba-956c-1564c27fd10a", "flavorRef": "452", "networks": [{"uuid": "b5c0e6b0-5f91-4707-9127-f2e2dbac9a7d"}]}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:50:51.134205 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.network.neutron [None req-a5bcfa5b-afad-4d72-b376-0a4df6c69e60 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] validate_networks() for [('b5c0e6b0-5f91-4707-9127-f2e2dbac9a7d', None, None, None, None, None)] {{(pid=123357) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:50:53.407258 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-a5bcfa5b-afad-4d72-b376-0a4df6c69e60 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Flavor limits 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:50:53.412177 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-a5bcfa5b-afad-4d72-b376-0a4df6c69e60 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Image limits 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:50:53.412991 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-a5bcfa5b-afad-4d72-b376-0a4df6c69e60 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Flavor pref 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:50:53.413593 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-a5bcfa5b-afad-4d72-b376-0a4df6c69e60 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Image pref 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:50:53.414163 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-a5bcfa5b-afad-4d72-b376-0a4df6c69e60 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:50:53.445581 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a5bcfa5b-afad-4d72-b376-0a4df6c69e60 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:50:53.446299 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a5bcfa5b-afad-4d72-b376-0a4df6c69e60 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:50:53.447414 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a5bcfa5b-afad-4d72-b376-0a4df6c69e60 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:50:53.447949 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a5bcfa5b-afad-4d72-b376-0a4df6c69e60 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:50:53.524514 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-a5bcfa5b-afad-4d72-b376-0a4df6c69e60 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Getting quotas for project 87d637e376f54d94a08bd30f6d5c1a3d. Resources: {'ram', 'instances', 'cores'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:50:53.532132 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-a5bcfa5b-afad-4d72-b376-0a4df6c69e60 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Getting quotas for user 677b8494bd4f4d06b44219b3d1f89ece and project 87d637e376f54d94a08bd30f6d5c1a3d. Resources: {'ram', 'instances', 'cores'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:50:53.557181 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a5bcfa5b-afad-4d72-b376-0a4df6c69e60 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Going to run 1 instances... {{(pid=123357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:50:53.566424 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a5bcfa5b-afad-4d72-b376-0a4df6c69e60 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b657785-cb0b-43ba-956c-1564c27fd10a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:50:53.716936 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a5bcfa5b-afad-4d72-b376-0a4df6c69e60 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.085990 Apr 05 11:50:53.717611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 4/9] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Apr 5 11:50:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:50:53.728385 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0367042f-3cbf-4a3e-a35f-72cf52979e96 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:50:53.729821 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0367042f-3cbf-4a3e-a35f-72cf52979e96 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:50:54.020000 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0367042f-3cbf-4a3e-a35f-72cf52979e96 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:50:54.047457 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0367042f-3cbf-4a3e-a35f-72cf52979e96 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1215 microversion: 2.1 time: 0.322961 Apr 05 11:50:54.051079 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 6/10] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:50:53 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1215 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:50:55.068705 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a02c8dbd-12ab-4748-bda4-c0be7266825f tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:50:55.069780 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a02c8dbd-12ab-4748-bda4-c0be7266825f tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:50:55.632926 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a02c8dbd-12ab-4748-bda4-c0be7266825f tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:50:55.659254 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a02c8dbd-12ab-4748-bda4-c0be7266825f tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1215 microversion: 2.1 time: 0.594592 Apr 05 11:50:55.659887 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 5/11] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:50:55 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1215 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:50:56.677696 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-338ee2ee-a7df-4982-ba67-23afd41ccf11 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:50:56.678378 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-338ee2ee-a7df-4982-ba67-23afd41ccf11 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:50:56.694935 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-338ee2ee-a7df-4982-ba67-23afd41ccf11 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:50:56.695568 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-338ee2ee-a7df-4982-ba67-23afd41ccf11 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:50:56.696518 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-338ee2ee-a7df-4982-ba67-23afd41ccf11 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:50:56.700468 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-338ee2ee-a7df-4982-ba67-23afd41ccf11 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:50:57.403340 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-338ee2ee-a7df-4982-ba67-23afd41ccf11 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:50:57.432478 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-338ee2ee-a7df-4982-ba67-23afd41ccf11 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1219 microversion: 2.1 time: 0.759205 Apr 05 11:50:57.441872 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 7/12] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:50:56 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1219 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:50:58.458448 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f49eb138-36c9-4d2a-99ff-cc859229db2a tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:50:58.459930 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f49eb138-36c9-4d2a-99ff-cc859229db2a tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:50:58.477430 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f49eb138-36c9-4d2a-99ff-cc859229db2a tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:50:58.480660 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f49eb138-36c9-4d2a-99ff-cc859229db2a tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:50:58.481836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f49eb138-36c9-4d2a-99ff-cc859229db2a tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:50:58.482466 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f49eb138-36c9-4d2a-99ff-cc859229db2a tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:50:58.941428 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f49eb138-36c9-4d2a-99ff-cc859229db2a tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:50:58.992644 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f49eb138-36c9-4d2a-99ff-cc859229db2a tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1273 microversion: 2.1 time: 0.538127 Apr 05 11:50:58.993333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 6/13] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:50:58 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1273 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:00.014418 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-97a705cd-2f6f-4a3a-a70f-c263fecb8ffa tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:00.017032 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-97a705cd-2f6f-4a3a-a70f-c263fecb8ffa tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:00.030205 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-97a705cd-2f6f-4a3a-a70f-c263fecb8ffa tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:00.030994 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-97a705cd-2f6f-4a3a-a70f-c263fecb8ffa tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:00.031980 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-97a705cd-2f6f-4a3a-a70f-c263fecb8ffa tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:00.032649 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-97a705cd-2f6f-4a3a-a70f-c263fecb8ffa tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:00.917843 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-97a705cd-2f6f-4a3a-a70f-c263fecb8ffa tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:00.929505 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-97a705cd-2f6f-4a3a-a70f-c263fecb8ffa tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1273 microversion: 2.1 time: 0.920418 Apr 05 11:51:00.947625 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 8/14] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:00 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1273 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:01.949063 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1f3cf4c7-8bb7-44b8-88de-e8136942e2e2 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:01.950452 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1f3cf4c7-8bb7-44b8-88de-e8136942e2e2 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:01.958979 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1f3cf4c7-8bb7-44b8-88de-e8136942e2e2 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:01.962579 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1f3cf4c7-8bb7-44b8-88de-e8136942e2e2 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:01.964106 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1f3cf4c7-8bb7-44b8-88de-e8136942e2e2 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:01.966879 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1f3cf4c7-8bb7-44b8-88de-e8136942e2e2 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:02.288569 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1f3cf4c7-8bb7-44b8-88de-e8136942e2e2 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:02.306521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1f3cf4c7-8bb7-44b8-88de-e8136942e2e2 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1273 microversion: 2.1 time: 0.356106 Apr 05 11:51:02.317065 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 7/15] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:01 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1273 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:03.324413 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3889ad3b-ae57-43cd-86a5-64b69ad906c6 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:03.325197 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3889ad3b-ae57-43cd-86a5-64b69ad906c6 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:03.347628 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3889ad3b-ae57-43cd-86a5-64b69ad906c6 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:03.347628 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3889ad3b-ae57-43cd-86a5-64b69ad906c6 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:03.351608 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3889ad3b-ae57-43cd-86a5-64b69ad906c6 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:03.353919 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3889ad3b-ae57-43cd-86a5-64b69ad906c6 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:03.906487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3889ad3b-ae57-43cd-86a5-64b69ad906c6 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:03.936595 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3889ad3b-ae57-43cd-86a5-64b69ad906c6 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1273 microversion: 2.1 time: 0.595177 Apr 05 11:51:03.951210 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 9/16] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:03 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1273 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:04.353770 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-80cb8cca-6777-4beb-bcd9-6604bf48329c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Action: 'create', calling method: .version_select at 0x7f161c579a60>, body: {"keypair": {"name": "tempest-keypair-228865684"}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:51:04.415547 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-80cb8cca-6777-4beb-bcd9-6604bf48329c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Getting quotas for project e3713b85b0994fa58ad2bc1e17407387. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:51:04.451322 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-80cb8cca-6777-4beb-bcd9-6604bf48329c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Getting quotas for user 88cd8fe1bb69438bace9d89ee9b5e88c and project e3713b85b0994fa58ad2bc1e17407387. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:51:04.960830 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1cbf9883-fe05-4753-b540-29755c467865 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:04.966799 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1cbf9883-fe05-4753-b540-29755c467865 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:04.996599 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1cbf9883-fe05-4753-b540-29755c467865 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:05.000209 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1cbf9883-fe05-4753-b540-29755c467865 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:05.008855 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1cbf9883-fe05-4753-b540-29755c467865 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:05.009743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1cbf9883-fe05-4753-b540-29755c467865 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:05.218235 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-80cb8cca-6777-4beb-bcd9-6604bf48329c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Getting quotas for project e3713b85b0994fa58ad2bc1e17407387. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:51:05.233282 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-80cb8cca-6777-4beb-bcd9-6604bf48329c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Getting quotas for user 88cd8fe1bb69438bace9d89ee9b5e88c and project e3713b85b0994fa58ad2bc1e17407387. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:51:05.304186 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-80cb8cca-6777-4beb-bcd9-6604bf48329c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.782627 Apr 05 11:51:05.306094 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 8/17] 10.222.0.61 () {62 vars in 1198 bytes} [Tue Apr 5 11:51:03 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1789 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 05 11:51:06.753080 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6bd63d69-71e5-4feb-a089-bcb61559f76f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-612504056", "imageRef": "2b657785-cb0b-43ba-956c-1564c27fd10a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:51:06.823299 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.network.neutron [None req-6bd63d69-71e5-4feb-a089-bcb61559f76f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] validate_networks() for [('dc0532d2-42df-4cc1-ab69-ba84b5a7e573', None, None, None, None, None)] {{(pid=123357) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:51:07.816622 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1cbf9883-fe05-4753-b540-29755c467865 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:07.833513 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1cbf9883-fe05-4753-b540-29755c467865 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 2.881232 Apr 05 11:51:07.839108 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 10/18] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:04 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 2888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:08.601400 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-6bd63d69-71e5-4feb-a089-bcb61559f76f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Flavor limits 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:51:08.601875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-6bd63d69-71e5-4feb-a089-bcb61559f76f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Image limits 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:51:08.602401 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-6bd63d69-71e5-4feb-a089-bcb61559f76f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Flavor pref 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:51:08.602817 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-6bd63d69-71e5-4feb-a089-bcb61559f76f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Image pref 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:51:08.603290 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-6bd63d69-71e5-4feb-a089-bcb61559f76f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:51:08.669124 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6bd63d69-71e5-4feb-a089-bcb61559f76f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:08.669613 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6bd63d69-71e5-4feb-a089-bcb61559f76f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:08.677472 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6bd63d69-71e5-4feb-a089-bcb61559f76f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:08.677949 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6bd63d69-71e5-4feb-a089-bcb61559f76f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:08.785978 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-6bd63d69-71e5-4feb-a089-bcb61559f76f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Getting quotas for project 08d2f825a8f74e66b348121301942a89. Resources: {'ram', 'instances', 'cores'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:51:08.791634 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-6bd63d69-71e5-4feb-a089-bcb61559f76f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Getting quotas for user 947e4bea28244cfb8a2b1be51c639815 and project 08d2f825a8f74e66b348121301942a89. Resources: {'ram', 'instances', 'cores'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:51:08.851504 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6bd63d69-71e5-4feb-a089-bcb61559f76f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Going to run 1 instances... {{(pid=123357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:51:08.858917 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6bd63d69-71e5-4feb-a089-bcb61559f76f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b657785-cb0b-43ba-956c-1564c27fd10a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:51:08.863094 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4e568ba8-3286-44e2-824a-7adab8abec77 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:08.863761 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4e568ba8-3286-44e2-824a-7adab8abec77 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:08.884504 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e568ba8-3286-44e2-824a-7adab8abec77 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:08.884965 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e568ba8-3286-44e2-824a-7adab8abec77 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:08.890430 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e568ba8-3286-44e2-824a-7adab8abec77 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:08.903253 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e568ba8-3286-44e2-824a-7adab8abec77 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:09.053858 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6bd63d69-71e5-4feb-a089-bcb61559f76f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.508915 Apr 05 11:51:09.053858 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 9/19] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Apr 5 11:51:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 2514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:51:09.080522 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b8556a4e-01c5-4277-b84f-98830f80bf3f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:09.081187 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b8556a4e-01c5-4277-b84f-98830f80bf3f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:09.256557 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b8556a4e-01c5-4277-b84f-98830f80bf3f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:09.269764 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b8556a4e-01c5-4277-b84f-98830f80bf3f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1221 microversion: 2.1 time: 0.209732 Apr 05 11:51:09.287068 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 10/20] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:09 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1221 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:09.421997 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a29a71eb-e90a-49ba-b640-a12779937986 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1318240483", "imageRef": "2b657785-cb0b-43ba-956c-1564c27fd10a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:51:09.574552 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.network.neutron [None req-a29a71eb-e90a-49ba-b640-a12779937986 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] validate_networks() for [('dc0532d2-42df-4cc1-ab69-ba84b5a7e573', None, None, None, None, None)] {{(pid=123357) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:51:10.592352 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4e568ba8-3286-44e2-824a-7adab8abec77 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:10.602276 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4e568ba8-3286-44e2-824a-7adab8abec77 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 1.750395 Apr 05 11:51:10.605121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 11/21] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:08 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:11.399790 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-a29a71eb-e90a-49ba-b640-a12779937986 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Flavor limits 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:51:11.400874 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-a29a71eb-e90a-49ba-b640-a12779937986 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Image limits 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:51:11.401518 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-a29a71eb-e90a-49ba-b640-a12779937986 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Flavor pref 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:51:11.402077 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-a29a71eb-e90a-49ba-b640-a12779937986 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Image pref 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:51:11.402776 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-a29a71eb-e90a-49ba-b640-a12779937986 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:51:11.427374 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a29a71eb-e90a-49ba-b640-a12779937986 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:11.430482 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a29a71eb-e90a-49ba-b640-a12779937986 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:11.431959 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a29a71eb-e90a-49ba-b640-a12779937986 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:11.436887 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a29a71eb-e90a-49ba-b640-a12779937986 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:11.552193 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-a29a71eb-e90a-49ba-b640-a12779937986 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Getting quotas for project 08d2f825a8f74e66b348121301942a89. Resources: {'ram', 'instances', 'cores'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:51:11.572924 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-a29a71eb-e90a-49ba-b640-a12779937986 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Getting quotas for user 947e4bea28244cfb8a2b1be51c639815 and project 08d2f825a8f74e66b348121301942a89. Resources: {'ram', 'instances', 'cores'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:51:11.609233 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a29a71eb-e90a-49ba-b640-a12779937986 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Going to run 1 instances... {{(pid=123357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:51:11.621784 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f4770813-d44a-426f-b508-b0734508b65c tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:11.622627 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f4770813-d44a-426f-b508-b0734508b65c tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:11.642458 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a29a71eb-e90a-49ba-b640-a12779937986 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b657785-cb0b-43ba-956c-1564c27fd10a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:51:11.660893 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f4770813-d44a-426f-b508-b0734508b65c tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:11.664622 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f4770813-d44a-426f-b508-b0734508b65c tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:11.665505 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f4770813-d44a-426f-b508-b0734508b65c tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:11.666055 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f4770813-d44a-426f-b508-b0734508b65c tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:11.818214 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a29a71eb-e90a-49ba-b640-a12779937986 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.400339 Apr 05 11:51:11.826006 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 11/22] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Apr 5 11:51:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 2409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:51:11.835919 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f94dbb81-11aa-4c36-809f-f225d07c2e03 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:11.839258 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f94dbb81-11aa-4c36-809f-f225d07c2e03 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:12.045553 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f94dbb81-11aa-4c36-809f-f225d07c2e03 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:12.064320 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f94dbb81-11aa-4c36-809f-f225d07c2e03 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1222 microversion: 2.1 time: 0.230135 Apr 05 11:51:12.066960 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 12/23] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:11 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1222 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:13.082538 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-78750358-4549-426d-977b-40ff489cdf3e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:13.083740 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-78750358-4549-426d-977b-40ff489cdf3e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:13.477960 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-78750358-4549-426d-977b-40ff489cdf3e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:13.478455 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-78750358-4549-426d-977b-40ff489cdf3e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:13.480440 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-78750358-4549-426d-977b-40ff489cdf3e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:13.481190 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-78750358-4549-426d-977b-40ff489cdf3e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:13.609041 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-78750358-4549-426d-977b-40ff489cdf3e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:13.624564 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-78750358-4549-426d-977b-40ff489cdf3e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1218 microversion: 2.1 time: 0.545788 Apr 05 11:51:13.625163 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 13/24] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:13 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1218 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:51:13.718465 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f4770813-d44a-426f-b508-b0734508b65c tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:13.730636 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f4770813-d44a-426f-b508-b0734508b65c tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 2.112687 Apr 05 11:51:13.735800 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 12/25] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:11 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 2118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:13.763687 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-431a6ba6-771f-4f6c-9efc-667fc423f3cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Action: 'create', calling method: .version_select at 0x7f161c5164c0>, body: {"keypair": {"name": "tempest-keypair-1508803354"}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:51:13.812103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-431a6ba6-771f-4f6c-9efc-667fc423f3cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Getting quotas for project b7234d9802a44102946fc7fcb9b9a502. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:51:13.820722 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-431a6ba6-771f-4f6c-9efc-667fc423f3cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Getting quotas for user 1f5873fd4faf41e98bd9123b44dabb0b and project b7234d9802a44102946fc7fcb9b9a502. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:51:13.950061 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-3f06d3d2-7ab0-4689-a17a-b461baf6994f req-b974aea2-b0af-4724-acc5-e95ec7c3b28c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c40921-bbb6-432b-8308-99fd88f854ac", "tag": "39140efd-8940-42ae-a018-b8973cfd3a44"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:51:13.990534 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-3f06d3d2-7ab0-4689-a17a-b461baf6994f req-b974aea2-b0af-4724-acc5-e95ec7c3b28c service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:13.990991 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-3f06d3d2-7ab0-4689-a17a-b461baf6994f req-b974aea2-b0af-4724-acc5-e95ec7c3b28c service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:14.053169 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-3f06d3d2-7ab0-4689-a17a-b461baf6994f req-b974aea2-b0af-4724-acc5-e95ec7c3b28c service nova] Creating event network-changed:39140efd-8940-42ae-a018-b8973cfd3a44 for instance 30c40921-bbb6-432b-8308-99fd88f854ac on hv-cinder-82956 Apr 05 11:51:14.054159 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-3f06d3d2-7ab0-4689-a17a-b461baf6994f req-b974aea2-b0af-4724-acc5-e95ec7c3b28c service nova] Acquired lock "compute-rpcapi-router" {{(pid=123358) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 05 11:51:14.059846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9cc03d8b-8480-4732-9e03-b0c4305ede81 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:14.060528 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9cc03d8b-8480-4732-9e03-b0c4305ede81 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:14.061459 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9cc03d8b-8480-4732-9e03-b0c4305ede81 None None] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:14.062028 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9cc03d8b-8480-4732-9e03-b0c4305ede81 None None] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:14.082994 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.compute.rpcapi [None req-9cc03d8b-8480-4732-9e03-b0c4305ede81 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 05 11:51:14.083902 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9cc03d8b-8480-4732-9e03-b0c4305ede81 None None] Releasing lock "compute-rpcapi-router" {{(pid=123358) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 05 11:51:14.114240 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-431a6ba6-771f-4f6c-9efc-667fc423f3cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Getting quotas for project b7234d9802a44102946fc7fcb9b9a502. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:51:14.127526 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-431a6ba6-771f-4f6c-9efc-667fc423f3cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Getting quotas for user 1f5873fd4faf41e98bd9123b44dabb0b and project b7234d9802a44102946fc7fcb9b9a502. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:51:14.167722 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-431a6ba6-771f-4f6c-9efc-667fc423f3cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.528735 Apr 05 11:51:14.168727 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 14/26] 10.222.0.61 () {60 vars in 1157 bytes} [Tue Apr 5 11:51:13 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:14.173683 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9cc03d8b-8480-4732-9e03-b0c4305ede81 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.436160 Apr 05 11:51:14.175883 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 13/27] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:51:14.643019 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-06e29456-c60c-4de7-ba5e-823460f54cfb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:14.643812 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-06e29456-c60c-4de7-ba5e-823460f54cfb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:14.664550 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-06e29456-c60c-4de7-ba5e-823460f54cfb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:14.665053 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-06e29456-c60c-4de7-ba5e-823460f54cfb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:14.665900 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-06e29456-c60c-4de7-ba5e-823460f54cfb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:14.666340 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-06e29456-c60c-4de7-ba5e-823460f54cfb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:14.751862 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-45e16630-8ea6-4d18-a615-841d388a5051 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:14.753244 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-45e16630-8ea6-4d18-a615-841d388a5051 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:14.785846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-45e16630-8ea6-4d18-a615-841d388a5051 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:14.785846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-45e16630-8ea6-4d18-a615-841d388a5051 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:14.785846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-45e16630-8ea6-4d18-a615-841d388a5051 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:14.785846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-45e16630-8ea6-4d18-a615-841d388a5051 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:15.161886 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-06e29456-c60c-4de7-ba5e-823460f54cfb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:15.170258 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-06e29456-c60c-4de7-ba5e-823460f54cfb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1292 microversion: 2.1 time: 0.531806 Apr 05 11:51:15.185407 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 15/28] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:14 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1292 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:16.194981 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3f50fc08-6e10-4021-b48f-60cc816c2387 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:16.196323 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3f50fc08-6e10-4021-b48f-60cc816c2387 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:16.208033 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f50fc08-6e10-4021-b48f-60cc816c2387 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:16.208397 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-45e16630-8ea6-4d18-a615-841d388a5051 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:16.211363 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f50fc08-6e10-4021-b48f-60cc816c2387 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:16.213362 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f50fc08-6e10-4021-b48f-60cc816c2387 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:16.214888 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f50fc08-6e10-4021-b48f-60cc816c2387 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:16.219708 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-45e16630-8ea6-4d18-a615-841d388a5051 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 1.474902 Apr 05 11:51:16.230578 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 14/29] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:14 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:51:16.408945 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3f50fc08-6e10-4021-b48f-60cc816c2387 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:16.426229 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3f50fc08-6e10-4021-b48f-60cc816c2387 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1280 microversion: 2.1 time: 0.237911 Apr 05 11:51:16.429491 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 16/30] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:16 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1280 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:16.600795 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e5db8cc5-594d-4ed2-aa17-d43d00f25c55 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Action: 'create', calling method: .version_select at 0x7f161ce01a60>, body: {"keypair": {"name": "tempest-keypair-420995151"}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:51:16.763996 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-026e8b2d-1ed2-4a5c-ad5d-c47822c7259e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-382166003", "imageRef": "2b657785-cb0b-43ba-956c-1564c27fd10a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98e4aa45-646e-4c26-89eb-8bdac048f25a"}], "security_groups": [{"name": "tempest-securitygroup--1128800548"}], "key_name": "tempest-keypair-228865684", "user_data": "}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:51:16.962415 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-e5db8cc5-594d-4ed2-aa17-d43d00f25c55 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Getting quotas for project 0f6e126c0851462ca2607a90c7581616. Resources: {'key_pairs'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:51:16.987336 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-e5db8cc5-594d-4ed2-aa17-d43d00f25c55 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Getting quotas for user e5ae307df96e45ec9ac6d4b383c84abb and project 0f6e126c0851462ca2607a90c7581616. Resources: {'key_pairs'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:51:17.423584 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-e5db8cc5-594d-4ed2-aa17-d43d00f25c55 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Getting quotas for project 0f6e126c0851462ca2607a90c7581616. Resources: {'key_pairs'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:51:17.435892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-e5db8cc5-594d-4ed2-aa17-d43d00f25c55 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Getting quotas for user e5ae307df96e45ec9ac6d4b383c84abb and project 0f6e126c0851462ca2607a90c7581616. Resources: {'key_pairs'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:51:17.473892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e5db8cc5-594d-4ed2-aa17-d43d00f25c55 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.079316 Apr 05 11:51:17.480325 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 15/31] 10.222.0.61 () {60 vars in 1157 bytes} [Tue Apr 5 11:51:16 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:17.506212 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-24a0500a-3c9a-4201-bb40-8ea146029dc2 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:17.507203 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-24a0500a-3c9a-4201-bb40-8ea146029dc2 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:17.510293 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.network.neutron [None req-026e8b2d-1ed2-4a5c-ad5d-c47822c7259e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] validate_networks() for [('98e4aa45-646e-4c26-89eb-8bdac048f25a', None, None, None, None, None)] {{(pid=123357) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:51:17.524730 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24a0500a-3c9a-4201-bb40-8ea146029dc2 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:17.526135 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24a0500a-3c9a-4201-bb40-8ea146029dc2 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:17.528303 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24a0500a-3c9a-4201-bb40-8ea146029dc2 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:17.529940 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24a0500a-3c9a-4201-bb40-8ea146029dc2 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:18.443190 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-24a0500a-3c9a-4201-bb40-8ea146029dc2 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:18.461611 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-24a0500a-3c9a-4201-bb40-8ea146029dc2 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 0.961998 Apr 05 11:51:18.462956 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 16/32] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:17 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:18.484177 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5b0156c6-3cd4-429d-9653-f8f8a2a030a1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:18.485399 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5b0156c6-3cd4-429d-9653-f8f8a2a030a1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:18.497618 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5b0156c6-3cd4-429d-9653-f8f8a2a030a1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:18.500710 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5b0156c6-3cd4-429d-9653-f8f8a2a030a1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:18.502156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5b0156c6-3cd4-429d-9653-f8f8a2a030a1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:18.504896 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5b0156c6-3cd4-429d-9653-f8f8a2a030a1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:19.861611 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5b0156c6-3cd4-429d-9653-f8f8a2a030a1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:19.871256 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5b0156c6-3cd4-429d-9653-f8f8a2a030a1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1322 microversion: 2.1 time: 1.406925 Apr 05 11:51:19.880430 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 17/33] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:18 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1322 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:19.891070 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b5acb9b9-fb89-4c19-934e-c8edbcea0f7d tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:19.893542 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b5acb9b9-fb89-4c19-934e-c8edbcea0f7d tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:19.917127 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b5acb9b9-fb89-4c19-934e-c8edbcea0f7d tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:19.919037 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b5acb9b9-fb89-4c19-934e-c8edbcea0f7d tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:19.927537 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b5acb9b9-fb89-4c19-934e-c8edbcea0f7d tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:19.931840 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b5acb9b9-fb89-4c19-934e-c8edbcea0f7d tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:20.180670 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-026e8b2d-1ed2-4a5c-ad5d-c47822c7259e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Flavor limits 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:51:20.182362 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-026e8b2d-1ed2-4a5c-ad5d-c47822c7259e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Image limits 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:51:20.183134 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-026e8b2d-1ed2-4a5c-ad5d-c47822c7259e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Flavor pref 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:51:20.183555 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-026e8b2d-1ed2-4a5c-ad5d-c47822c7259e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Image pref 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:51:20.183971 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-026e8b2d-1ed2-4a5c-ad5d-c47822c7259e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:51:20.201837 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-026e8b2d-1ed2-4a5c-ad5d-c47822c7259e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:20.202299 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-026e8b2d-1ed2-4a5c-ad5d-c47822c7259e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:20.203119 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-026e8b2d-1ed2-4a5c-ad5d-c47822c7259e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:20.208839 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-026e8b2d-1ed2-4a5c-ad5d-c47822c7259e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:20.284870 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-026e8b2d-1ed2-4a5c-ad5d-c47822c7259e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Getting quotas for project e3713b85b0994fa58ad2bc1e17407387. Resources: {'ram', 'instances', 'cores'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:51:20.294037 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-026e8b2d-1ed2-4a5c-ad5d-c47822c7259e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Getting quotas for user 88cd8fe1bb69438bace9d89ee9b5e88c and project e3713b85b0994fa58ad2bc1e17407387. Resources: {'ram', 'instances', 'cores'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:51:20.315522 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-026e8b2d-1ed2-4a5c-ad5d-c47822c7259e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Going to run 1 instances... {{(pid=123357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:51:20.318202 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-026e8b2d-1ed2-4a5c-ad5d-c47822c7259e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b657785-cb0b-43ba-956c-1564c27fd10a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:51:20.408987 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-026e8b2d-1ed2-4a5c-ad5d-c47822c7259e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.650389 Apr 05 11:51:20.410344 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 17/34] 10.222.0.61 () {62 vars in 1187 bytes} [Tue Apr 5 11:51:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 3652 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 05 11:51:20.421887 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ce5edb76-d1c2-4766-88aa-e088c7119edc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:20.422978 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ce5edb76-d1c2-4766-88aa-e088c7119edc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:20.559424 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b5acb9b9-fb89-4c19-934e-c8edbcea0f7d tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:20.584753 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b5acb9b9-fb89-4c19-934e-c8edbcea0f7d tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 0.703165 Apr 05 11:51:20.596527 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 18/35] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:19 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:20.744455 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ce5edb76-d1c2-4766-88aa-e088c7119edc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:20.759083 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ce5edb76-d1c2-4766-88aa-e088c7119edc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:20.761845 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ce5edb76-d1c2-4766-88aa-e088c7119edc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:20.765108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ce5edb76-d1c2-4766-88aa-e088c7119edc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1280 microversion: 2.20 time: 0.348306 Apr 05 11:51:20.766861 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 18/36] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:20 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1280 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:20.889495 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-530bd76a-04d5-44ac-bc6c-7966578c2545 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:20.890282 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-530bd76a-04d5-44ac-bc6c-7966578c2545 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:20.902251 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-530bd76a-04d5-44ac-bc6c-7966578c2545 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:20.902723 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-530bd76a-04d5-44ac-bc6c-7966578c2545 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:20.906330 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-530bd76a-04d5-44ac-bc6c-7966578c2545 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:20.906981 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-530bd76a-04d5-44ac-bc6c-7966578c2545 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:21.531422 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-863eee08-a66e-4a99-bd07-476330663bd8 req-0ffa69fa-f8f8-4652-975f-30ee90f734ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "590c9148-99a5-4120-8b46-235860f6eca2", "tag": "55b22dff-98f7-484a-a01e-41c558cf7a2f"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:51:21.561170 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-863eee08-a66e-4a99-bd07-476330663bd8 req-0ffa69fa-f8f8-4652-975f-30ee90f734ec service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:21.561951 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-863eee08-a66e-4a99-bd07-476330663bd8 req-0ffa69fa-f8f8-4652-975f-30ee90f734ec service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:21.607444 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-863eee08-a66e-4a99-bd07-476330663bd8 req-0ffa69fa-f8f8-4652-975f-30ee90f734ec service nova] Creating event network-changed:55b22dff-98f7-484a-a01e-41c558cf7a2f for instance 590c9148-99a5-4120-8b46-235860f6eca2 on hv-cinder-82956 Apr 05 11:51:21.608402 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-863eee08-a66e-4a99-bd07-476330663bd8 req-0ffa69fa-f8f8-4652-975f-30ee90f734ec service nova] Acquired lock "compute-rpcapi-router" {{(pid=123357) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 05 11:51:21.610535 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64b2bd5b-5e35-4ade-ad97-74ed87f401d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:21.611192 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64b2bd5b-5e35-4ade-ad97-74ed87f401d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:21.612264 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64b2bd5b-5e35-4ade-ad97-74ed87f401d5 None None] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:21.613231 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64b2bd5b-5e35-4ade-ad97-74ed87f401d5 None None] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:21.625460 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.compute.rpcapi [None req-64b2bd5b-5e35-4ade-ad97-74ed87f401d5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 05 11:51:21.626683 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64b2bd5b-5e35-4ade-ad97-74ed87f401d5 None None] Releasing lock "compute-rpcapi-router" {{(pid=123357) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 05 11:51:21.651421 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-64b2bd5b-5e35-4ade-ad97-74ed87f401d5 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.277163 Apr 05 11:51:21.653006 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 19/37] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:51:21.662411 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-792cd6ec-77c6-4289-94f6-49f517f69075 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:21.665125 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-792cd6ec-77c6-4289-94f6-49f517f69075 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:21.678278 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-792cd6ec-77c6-4289-94f6-49f517f69075 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:21.681210 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-792cd6ec-77c6-4289-94f6-49f517f69075 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:21.682905 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-792cd6ec-77c6-4289-94f6-49f517f69075 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:21.684747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-792cd6ec-77c6-4289-94f6-49f517f69075 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:22.000121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-530bd76a-04d5-44ac-bc6c-7966578c2545 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:22.012231 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-530bd76a-04d5-44ac-bc6c-7966578c2545 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1322 microversion: 2.1 time: 1.123333 Apr 05 11:51:22.012231 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 19/38] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:20 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1322 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:22.021866 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ad0ae7a8-a08b-4832-823e-901ee9d37ec8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:22.033053 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ad0ae7a8-a08b-4832-823e-901ee9d37ec8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:22.044396 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ad0ae7a8-a08b-4832-823e-901ee9d37ec8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:22.049074 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ad0ae7a8-a08b-4832-823e-901ee9d37ec8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:22.050480 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ad0ae7a8-a08b-4832-823e-901ee9d37ec8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:22.057236 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ad0ae7a8-a08b-4832-823e-901ee9d37ec8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:22.239571 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ad0ae7a8-a08b-4832-823e-901ee9d37ec8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:22.252956 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ad0ae7a8-a08b-4832-823e-901ee9d37ec8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:22.257583 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ad0ae7a8-a08b-4832-823e-901ee9d37ec8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:22.259710 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ad0ae7a8-a08b-4832-823e-901ee9d37ec8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1332 microversion: 2.20 time: 0.246266 Apr 05 11:51:22.266545 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 20/39] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:22 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1332 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:22.522057 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-792cd6ec-77c6-4289-94f6-49f517f69075 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:22.538116 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-792cd6ec-77c6-4289-94f6-49f517f69075 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 0.883485 Apr 05 11:51:22.540109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 20/40] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:21 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:22.632454 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4738414b-88a0-4e1b-aa36-244e2bd72baf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-932960712", "imageRef": "2b657785-cb0b-43ba-956c-1564c27fd10a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "74281bd4-2cd1-4cd5-90f9-3eec19d74c11"}], "security_groups": [{"name": "tempest-securitygroup--419809956"}], "key_name": "tempest-keypair-1508803354", "user_data": "}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:51:22.809496 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.network.neutron [None req-4738414b-88a0-4e1b-aa36-244e2bd72baf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] validate_networks() for [('74281bd4-2cd1-4cd5-90f9-3eec19d74c11', None, None, None, None, None)] {{(pid=123358) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:51:23.025213 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-476c3a29-d7f9-4517-ae3f-da2389f03b99 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:23.026288 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-476c3a29-d7f9-4517-ae3f-da2389f03b99 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:23.042055 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-476c3a29-d7f9-4517-ae3f-da2389f03b99 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:23.044795 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-476c3a29-d7f9-4517-ae3f-da2389f03b99 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:23.045867 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-476c3a29-d7f9-4517-ae3f-da2389f03b99 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:23.048401 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-476c3a29-d7f9-4517-ae3f-da2389f03b99 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:23.458666 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-476c3a29-d7f9-4517-ae3f-da2389f03b99 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:23.476942 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-476c3a29-d7f9-4517-ae3f-da2389f03b99 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1322 microversion: 2.1 time: 0.456115 Apr 05 11:51:23.488024 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 21/41] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:23 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1322 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:23.493085 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a4540e41-55ee-4941-8327-d311e6839939 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:23.493701 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a4540e41-55ee-4941-8327-d311e6839939 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:23.507334 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a4540e41-55ee-4941-8327-d311e6839939 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:23.507793 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a4540e41-55ee-4941-8327-d311e6839939 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:23.519382 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a4540e41-55ee-4941-8327-d311e6839939 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:23.519894 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a4540e41-55ee-4941-8327-d311e6839939 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:23.719209 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a4540e41-55ee-4941-8327-d311e6839939 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:23.739131 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a4540e41-55ee-4941-8327-d311e6839939 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:23.749619 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a4540e41-55ee-4941-8327-d311e6839939 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:23.752445 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a4540e41-55ee-4941-8327-d311e6839939 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1340 microversion: 2.20 time: 0.263150 Apr 05 11:51:23.756146 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 22/42] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:23 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1340 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:23.766365 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-24397fa4-6a2e-4f26-aaa8-5dc74f6112ee tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:23.768972 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-24397fa4-6a2e-4f26-aaa8-5dc74f6112ee tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:23.789835 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-24397fa4-6a2e-4f26-aaa8-5dc74f6112ee tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:23.794110 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-24397fa4-6a2e-4f26-aaa8-5dc74f6112ee tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:23.795406 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-24397fa4-6a2e-4f26-aaa8-5dc74f6112ee tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:23.795848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-24397fa4-6a2e-4f26-aaa8-5dc74f6112ee tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:23.872535 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-4738414b-88a0-4e1b-aa36-244e2bd72baf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Flavor limits 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:51:23.873543 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-4738414b-88a0-4e1b-aa36-244e2bd72baf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Image limits 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:51:23.874280 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-4738414b-88a0-4e1b-aa36-244e2bd72baf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Flavor pref 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:51:23.874845 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-4738414b-88a0-4e1b-aa36-244e2bd72baf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Image pref 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:51:23.875402 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-4738414b-88a0-4e1b-aa36-244e2bd72baf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:51:23.892329 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4738414b-88a0-4e1b-aa36-244e2bd72baf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:23.893010 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4738414b-88a0-4e1b-aa36-244e2bd72baf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:23.894051 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4738414b-88a0-4e1b-aa36-244e2bd72baf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:23.895003 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4738414b-88a0-4e1b-aa36-244e2bd72baf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:23.923204 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-4738414b-88a0-4e1b-aa36-244e2bd72baf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Getting quotas for project b7234d9802a44102946fc7fcb9b9a502. Resources: {'ram', 'instances', 'cores'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:51:23.930727 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-4738414b-88a0-4e1b-aa36-244e2bd72baf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Getting quotas for user 1f5873fd4faf41e98bd9123b44dabb0b and project b7234d9802a44102946fc7fcb9b9a502. Resources: {'ram', 'instances', 'cores'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:51:23.952306 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4738414b-88a0-4e1b-aa36-244e2bd72baf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Going to run 1 instances... {{(pid=123358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:51:23.958044 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4738414b-88a0-4e1b-aa36-244e2bd72baf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b657785-cb0b-43ba-956c-1564c27fd10a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:51:24.089161 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4738414b-88a0-4e1b-aa36-244e2bd72baf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.461265 Apr 05 11:51:24.090081 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 21/43] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Apr 5 11:51:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 1463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:51:24.095912 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-347ec3a7-5e74-4841-9185-644cce9affab req-8ee30628-ed81-462f-9b8b-0d092f01e4e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "159c0fda-d790-488a-bbdc-a3b9ee6174d1", "tag": "baa72685-1fff-4499-bff9-2ee7cbb1dcf5"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:51:24.115844 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-347ec3a7-5e74-4841-9185-644cce9affab req-8ee30628-ed81-462f-9b8b-0d092f01e4e5 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:24.116846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-347ec3a7-5e74-4841-9185-644cce9affab req-8ee30628-ed81-462f-9b8b-0d092f01e4e5 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:24.131463 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-347ec3a7-5e74-4841-9185-644cce9affab req-8ee30628-ed81-462f-9b8b-0d092f01e4e5 service nova] Creating event network-changed:baa72685-1fff-4499-bff9-2ee7cbb1dcf5 for instance 159c0fda-d790-488a-bbdc-a3b9ee6174d1 on hv-cinder-82956 Apr 05 11:51:24.136884 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-347ec3a7-5e74-4841-9185-644cce9affab req-8ee30628-ed81-462f-9b8b-0d092f01e4e5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045115 Apr 05 11:51:24.138124 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 22/44] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:51:24.157344 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3eea7dc0-2577-40bd-818a-7d68d6577c03 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:24.158066 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3eea7dc0-2577-40bd-818a-7d68d6577c03 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:24.327937 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3eea7dc0-2577-40bd-818a-7d68d6577c03 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:24.349037 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3eea7dc0-2577-40bd-818a-7d68d6577c03 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1237 microversion: 2.1 time: 0.209463 Apr 05 11:51:24.377513 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 23/45] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:24 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1237 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:24.494439 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2907a7ce-a238-4503-9324-da527a7d0361 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:24.495300 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2907a7ce-a238-4503-9324-da527a7d0361 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:24.511381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2907a7ce-a238-4503-9324-da527a7d0361 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:24.513886 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2907a7ce-a238-4503-9324-da527a7d0361 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:24.515855 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2907a7ce-a238-4503-9324-da527a7d0361 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:24.516979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2907a7ce-a238-4503-9324-da527a7d0361 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:24.555822 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-24397fa4-6a2e-4f26-aaa8-5dc74f6112ee tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:24.569250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-24397fa4-6a2e-4f26-aaa8-5dc74f6112ee tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 0.810374 Apr 05 11:51:24.570041 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 23/46] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:23 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:24.775589 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-55ada65c-cd93-408b-88f2-435590f57090 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:24.777200 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-55ada65c-cd93-408b-88f2-435590f57090 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:24.784493 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-55ada65c-cd93-408b-88f2-435590f57090 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:24.785436 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-55ada65c-cd93-408b-88f2-435590f57090 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:24.787448 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-55ada65c-cd93-408b-88f2-435590f57090 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:24.788040 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-55ada65c-cd93-408b-88f2-435590f57090 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:24.811968 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2907a7ce-a238-4503-9324-da527a7d0361 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:24.829010 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2907a7ce-a238-4503-9324-da527a7d0361 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1322 microversion: 2.1 time: 0.338475 Apr 05 11:51:24.829803 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 24/47] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:24 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:51:24.865619 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-55ada65c-cd93-408b-88f2-435590f57090 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:24.873909 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-55ada65c-cd93-408b-88f2-435590f57090 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:24.875585 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-55ada65c-cd93-408b-88f2-435590f57090 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:24.877018 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-55ada65c-cd93-408b-88f2-435590f57090 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1340 microversion: 2.20 time: 0.107166 Apr 05 11:51:24.877741 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 24/48] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:24 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1340 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:51:24.888946 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4e26450e-9c35-4cfe-a96a-79674529f5e8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1530900690", "imageRef": "2b657785-cb0b-43ba-956c-1564c27fd10a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "655b7336-f06e-410c-ae4e-8aa6ab359991"}], "security_groups": [{"name": "tempest-securitygroup--406148966"}], "key_name": "tempest-keypair-420995151", "user_data": "}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:51:24.988420 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.network.neutron [None req-4e26450e-9c35-4cfe-a96a-79674529f5e8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] validate_networks() for [('655b7336-f06e-410c-ae4e-8aa6ab359991', None, None, None, None, None)] {{(pid=123358) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:51:25.375080 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d772dc40-eea1-463b-9827-6df5e5b29aa3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:25.375921 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d772dc40-eea1-463b-9827-6df5e5b29aa3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:25.382182 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d772dc40-eea1-463b-9827-6df5e5b29aa3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:25.382860 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d772dc40-eea1-463b-9827-6df5e5b29aa3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:25.384169 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d772dc40-eea1-463b-9827-6df5e5b29aa3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:25.384806 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d772dc40-eea1-463b-9827-6df5e5b29aa3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:25.431959 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-4e26450e-9c35-4cfe-a96a-79674529f5e8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Flavor limits 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:51:25.432649 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-4e26450e-9c35-4cfe-a96a-79674529f5e8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Image limits 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:51:25.433171 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-4e26450e-9c35-4cfe-a96a-79674529f5e8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Flavor pref 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:51:25.433687 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-4e26450e-9c35-4cfe-a96a-79674529f5e8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Image pref 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:51:25.434107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-4e26450e-9c35-4cfe-a96a-79674529f5e8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:51:25.446046 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e26450e-9c35-4cfe-a96a-79674529f5e8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:25.446532 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e26450e-9c35-4cfe-a96a-79674529f5e8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:25.447292 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e26450e-9c35-4cfe-a96a-79674529f5e8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:25.448039 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e26450e-9c35-4cfe-a96a-79674529f5e8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:25.467686 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-4e26450e-9c35-4cfe-a96a-79674529f5e8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Getting quotas for project 0f6e126c0851462ca2607a90c7581616. Resources: {'ram', 'instances', 'cores'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:51:25.467806 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d772dc40-eea1-463b-9827-6df5e5b29aa3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:25.472437 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-4e26450e-9c35-4cfe-a96a-79674529f5e8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Getting quotas for user e5ae307df96e45ec9ac6d4b383c84abb and project 0f6e126c0851462ca2607a90c7581616. Resources: {'ram', 'instances', 'cores'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:51:25.484275 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4e26450e-9c35-4cfe-a96a-79674529f5e8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Going to run 1 instances... {{(pid=123358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:51:25.486006 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d772dc40-eea1-463b-9827-6df5e5b29aa3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1241 microversion: 2.1 time: 0.114815 Apr 05 11:51:25.487160 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 25/49] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:25 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1241 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:51:25.489118 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4e26450e-9c35-4cfe-a96a-79674529f5e8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b657785-cb0b-43ba-956c-1564c27fd10a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:51:25.573061 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4e26450e-9c35-4cfe-a96a-79674529f5e8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.698112 Apr 05 11:51:25.584648 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5d891285-401f-42a0-a10f-1844301eb3a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:25.585427 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5d891285-401f-42a0-a10f-1844301eb3a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:25.587121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 25/50] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Apr 5 11:51:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:51:25.592451 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e0ad52c7-1ec0-4b26-add9-da5bddfb715e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:25.604951 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e0ad52c7-1ec0-4b26-add9-da5bddfb715e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:25.630830 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0ad52c7-1ec0-4b26-add9-da5bddfb715e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:25.631609 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0ad52c7-1ec0-4b26-add9-da5bddfb715e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:25.632913 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0ad52c7-1ec0-4b26-add9-da5bddfb715e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:25.637308 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0ad52c7-1ec0-4b26-add9-da5bddfb715e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:25.778390 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5d891285-401f-42a0-a10f-1844301eb3a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:25.786743 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5d891285-401f-42a0-a10f-1844301eb3a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1241 microversion: 2.1 time: 0.205108 Apr 05 11:51:25.787810 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 26/51] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:25 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1241 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:51:25.846532 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ccb2561a-d32f-42bc-bbfa-d682aa8ad85f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:25.847338 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ccb2561a-d32f-42bc-bbfa-d682aa8ad85f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:25.870522 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ccb2561a-d32f-42bc-bbfa-d682aa8ad85f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:25.871123 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ccb2561a-d32f-42bc-bbfa-d682aa8ad85f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:25.882133 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ccb2561a-d32f-42bc-bbfa-d682aa8ad85f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:25.884195 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ccb2561a-d32f-42bc-bbfa-d682aa8ad85f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:26.059612 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e0ad52c7-1ec0-4b26-add9-da5bddfb715e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:26.075336 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e0ad52c7-1ec0-4b26-add9-da5bddfb715e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 0.479772 Apr 05 11:51:26.076033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 26/52] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:25 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:26.080986 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-adb20d85-c144-4854-85e5-a1aa0390321a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:26.081591 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-adb20d85-c144-4854-85e5-a1aa0390321a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:26.099204 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-adb20d85-c144-4854-85e5-a1aa0390321a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:26.099646 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-adb20d85-c144-4854-85e5-a1aa0390321a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:26.100456 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-adb20d85-c144-4854-85e5-a1aa0390321a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:26.100884 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-adb20d85-c144-4854-85e5-a1aa0390321a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:26.213315 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-adb20d85-c144-4854-85e5-a1aa0390321a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:26.223936 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-adb20d85-c144-4854-85e5-a1aa0390321a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:26.225479 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-adb20d85-c144-4854-85e5-a1aa0390321a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:26.230566 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-adb20d85-c144-4854-85e5-a1aa0390321a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1338 microversion: 2.20 time: 0.153478 Apr 05 11:51:26.232271 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 27/53] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:26 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1338 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:26.293057 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ccb2561a-d32f-42bc-bbfa-d682aa8ad85f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:26.304563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ccb2561a-d32f-42bc-bbfa-d682aa8ad85f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1322 microversion: 2.1 time: 0.459982 Apr 05 11:51:26.305681 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 27/54] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:25 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1322 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:26.503527 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ea43cb86-4c05-4386-bc19-7c2b740224d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:26.504230 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ea43cb86-4c05-4386-bc19-7c2b740224d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:26.510363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea43cb86-4c05-4386-bc19-7c2b740224d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:26.510810 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea43cb86-4c05-4386-bc19-7c2b740224d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:26.511601 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea43cb86-4c05-4386-bc19-7c2b740224d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:26.512183 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea43cb86-4c05-4386-bc19-7c2b740224d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:26.574325 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ea43cb86-4c05-4386-bc19-7c2b740224d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:26.582917 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ea43cb86-4c05-4386-bc19-7c2b740224d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1233 microversion: 2.1 time: 0.083241 Apr 05 11:51:26.583497 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 28/55] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:26 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1233 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:26.805474 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-33e14824-bc57-4be4-bf76-1b192f7815db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:26.806078 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-33e14824-bc57-4be4-bf76-1b192f7815db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:26.813686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-33e14824-bc57-4be4-bf76-1b192f7815db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:26.814752 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-33e14824-bc57-4be4-bf76-1b192f7815db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:26.815998 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-33e14824-bc57-4be4-bf76-1b192f7815db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:26.816873 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-33e14824-bc57-4be4-bf76-1b192f7815db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:26.895763 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-33e14824-bc57-4be4-bf76-1b192f7815db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:26.903373 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-33e14824-bc57-4be4-bf76-1b192f7815db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1245 microversion: 2.1 time: 0.102506 Apr 05 11:51:26.904333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 28/56] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:26 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1245 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:27.096778 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7d11d1fc-c155-4f0c-804d-8e7376e0271a tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:27.097767 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7d11d1fc-c155-4f0c-804d-8e7376e0271a tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:27.107139 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7d11d1fc-c155-4f0c-804d-8e7376e0271a tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:27.107589 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7d11d1fc-c155-4f0c-804d-8e7376e0271a tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:27.108416 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7d11d1fc-c155-4f0c-804d-8e7376e0271a tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:27.108844 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7d11d1fc-c155-4f0c-804d-8e7376e0271a tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:27.248809 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-611b5d58-8617-4a12-8327-de293f3ba3c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:27.249414 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-611b5d58-8617-4a12-8327-de293f3ba3c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:27.249940 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7d11d1fc-c155-4f0c-804d-8e7376e0271a tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:27.255735 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-611b5d58-8617-4a12-8327-de293f3ba3c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:27.256208 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-611b5d58-8617-4a12-8327-de293f3ba3c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:27.256968 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-611b5d58-8617-4a12-8327-de293f3ba3c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:27.257397 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-611b5d58-8617-4a12-8327-de293f3ba3c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:27.257831 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7d11d1fc-c155-4f0c-804d-8e7376e0271a tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 0.167632 Apr 05 11:51:27.258418 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 29/57] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:27 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:27.316621 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-611b5d58-8617-4a12-8327-de293f3ba3c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:27.322393 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f9dd7976-2269-45df-b885-3f448cc5b215 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:27.323010 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f9dd7976-2269-45df-b885-3f448cc5b215 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:27.325282 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-611b5d58-8617-4a12-8327-de293f3ba3c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:27.326788 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-611b5d58-8617-4a12-8327-de293f3ba3c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:27.327880 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-611b5d58-8617-4a12-8327-de293f3ba3c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1338 microversion: 2.20 time: 0.083104 Apr 05 11:51:27.328473 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 29/58] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:27 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1338 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:27.329527 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9dd7976-2269-45df-b885-3f448cc5b215 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:27.329977 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9dd7976-2269-45df-b885-3f448cc5b215 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:27.330755 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9dd7976-2269-45df-b885-3f448cc5b215 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:27.331196 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9dd7976-2269-45df-b885-3f448cc5b215 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:27.466653 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f9dd7976-2269-45df-b885-3f448cc5b215 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:27.475221 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f9dd7976-2269-45df-b885-3f448cc5b215 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1322 microversion: 2.1 time: 0.156666 Apr 05 11:51:27.475833 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 30/59] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:27 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:27.605448 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9f6f65ad-57f0-48eb-a0c7-1cbb7d8269bd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:27.606509 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9f6f65ad-57f0-48eb-a0c7-1cbb7d8269bd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:27.615871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9f6f65ad-57f0-48eb-a0c7-1cbb7d8269bd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:27.616356 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9f6f65ad-57f0-48eb-a0c7-1cbb7d8269bd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:27.617126 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9f6f65ad-57f0-48eb-a0c7-1cbb7d8269bd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:27.617565 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9f6f65ad-57f0-48eb-a0c7-1cbb7d8269bd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:27.690324 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9f6f65ad-57f0-48eb-a0c7-1cbb7d8269bd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:27.700526 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9f6f65ad-57f0-48eb-a0c7-1cbb7d8269bd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1233 microversion: 2.1 time: 0.101555 Apr 05 11:51:27.701280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 30/60] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:27 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1233 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:27.920403 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f2935434-a565-40a8-86d7-3f86356036d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:27.921210 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f2935434-a565-40a8-86d7-3f86356036d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:27.927482 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f2935434-a565-40a8-86d7-3f86356036d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:27.927935 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f2935434-a565-40a8-86d7-3f86356036d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:27.928753 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f2935434-a565-40a8-86d7-3f86356036d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:27.929189 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f2935434-a565-40a8-86d7-3f86356036d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:27.992582 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f2935434-a565-40a8-86d7-3f86356036d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:28.000161 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f2935434-a565-40a8-86d7-3f86356036d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1245 microversion: 2.1 time: 0.083642 Apr 05 11:51:28.000727 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 31/61] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:27 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:28.275541 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e0456c3e-e6e5-49dc-bda6-52dd96727209 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:28.276187 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e0456c3e-e6e5-49dc-bda6-52dd96727209 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:28.282599 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0456c3e-e6e5-49dc-bda6-52dd96727209 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:28.283046 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0456c3e-e6e5-49dc-bda6-52dd96727209 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:28.283822 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0456c3e-e6e5-49dc-bda6-52dd96727209 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:28.284295 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0456c3e-e6e5-49dc-bda6-52dd96727209 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:28.346302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6905d65b-089a-4287-8f94-e4e3098fed15 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:28.346878 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6905d65b-089a-4287-8f94-e4e3098fed15 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:28.353597 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6905d65b-089a-4287-8f94-e4e3098fed15 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:28.354115 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6905d65b-089a-4287-8f94-e4e3098fed15 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:28.355155 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6905d65b-089a-4287-8f94-e4e3098fed15 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:28.355776 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6905d65b-089a-4287-8f94-e4e3098fed15 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:28.416623 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6905d65b-089a-4287-8f94-e4e3098fed15 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:28.423381 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e0456c3e-e6e5-49dc-bda6-52dd96727209 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:28.424854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6905d65b-089a-4287-8f94-e4e3098fed15 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:28.426454 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6905d65b-089a-4287-8f94-e4e3098fed15 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:28.427562 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6905d65b-089a-4287-8f94-e4e3098fed15 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1338 microversion: 2.20 time: 0.085977 Apr 05 11:51:28.428190 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 32/62] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:28 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1338 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:28.430673 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e0456c3e-e6e5-49dc-bda6-52dd96727209 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 0.159096 Apr 05 11:51:28.431216 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 31/63] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:28 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:28.494478 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1df9667e-bd29-4d86-9c52-6dc92281c075 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:28.495410 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1df9667e-bd29-4d86-9c52-6dc92281c075 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:28.503726 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1df9667e-bd29-4d86-9c52-6dc92281c075 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:28.504447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1df9667e-bd29-4d86-9c52-6dc92281c075 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:28.505241 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1df9667e-bd29-4d86-9c52-6dc92281c075 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:28.505661 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1df9667e-bd29-4d86-9c52-6dc92281c075 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:28.645554 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1df9667e-bd29-4d86-9c52-6dc92281c075 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:28.653497 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1df9667e-bd29-4d86-9c52-6dc92281c075 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1322 microversion: 2.1 time: 0.164265 Apr 05 11:51:28.654073 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 33/64] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:28 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:28.722844 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3540e680-ffed-4fe7-8f35-ce91ca5abf76 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:28.723468 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3540e680-ffed-4fe7-8f35-ce91ca5abf76 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:28.729872 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3540e680-ffed-4fe7-8f35-ce91ca5abf76 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:28.730345 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3540e680-ffed-4fe7-8f35-ce91ca5abf76 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:28.731112 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3540e680-ffed-4fe7-8f35-ce91ca5abf76 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:28.731544 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3540e680-ffed-4fe7-8f35-ce91ca5abf76 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:28.833873 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3540e680-ffed-4fe7-8f35-ce91ca5abf76 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:28.849526 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3540e680-ffed-4fe7-8f35-ce91ca5abf76 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1233 microversion: 2.1 time: 0.133212 Apr 05 11:51:28.861686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 32/65] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:28 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1233 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:29.017648 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f79488d2-79ef-4ef2-b23c-f7e524805aa6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:29.018504 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f79488d2-79ef-4ef2-b23c-f7e524805aa6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:29.025569 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f79488d2-79ef-4ef2-b23c-f7e524805aa6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:29.026254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f79488d2-79ef-4ef2-b23c-f7e524805aa6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:29.027175 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f79488d2-79ef-4ef2-b23c-f7e524805aa6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:29.027760 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f79488d2-79ef-4ef2-b23c-f7e524805aa6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:29.095413 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f79488d2-79ef-4ef2-b23c-f7e524805aa6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:29.103952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f79488d2-79ef-4ef2-b23c-f7e524805aa6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1237 microversion: 2.1 time: 0.090161 Apr 05 11:51:29.112115 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 34/66] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:29 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1237 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:29.393765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-78e24d0b-4130-4685-8b92-9d36e9724cd3 req-dc2f41f6-998a-4b2d-8986-a3d3440cfb65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c40921-bbb6-432b-8308-99fd88f854ac", "name": "network-vif-plugged", "status": "completed", "tag": "39140efd-8940-42ae-a018-b8973cfd3a44"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:51:29.409436 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-78e24d0b-4130-4685-8b92-9d36e9724cd3 req-dc2f41f6-998a-4b2d-8986-a3d3440cfb65 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:29.412818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-78e24d0b-4130-4685-8b92-9d36e9724cd3 req-dc2f41f6-998a-4b2d-8986-a3d3440cfb65 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:29.437071 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-78e24d0b-4130-4685-8b92-9d36e9724cd3 req-dc2f41f6-998a-4b2d-8986-a3d3440cfb65 service nova] Creating event network-vif-plugged:39140efd-8940-42ae-a018-b8973cfd3a44 for instance 30c40921-bbb6-432b-8308-99fd88f854ac on hv-cinder-82956 Apr 05 11:51:29.448432 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bf9e292f-001c-4646-914a-c335b295b2fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:29.450374 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bf9e292f-001c-4646-914a-c335b295b2fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:29.456871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-78e24d0b-4130-4685-8b92-9d36e9724cd3 req-dc2f41f6-998a-4b2d-8986-a3d3440cfb65 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174719 Apr 05 11:51:29.460259 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 33/67] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:51:29.469529 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bf9e292f-001c-4646-914a-c335b295b2fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:29.470704 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bf9e292f-001c-4646-914a-c335b295b2fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:29.472975 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bf9e292f-001c-4646-914a-c335b295b2fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:29.473419 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bf9e292f-001c-4646-914a-c335b295b2fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:29.477310 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1a2c7e07-9a6a-4956-993d-8bad411591ce tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:29.478134 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1a2c7e07-9a6a-4956-993d-8bad411591ce tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:29.498244 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1a2c7e07-9a6a-4956-993d-8bad411591ce tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:29.498949 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1a2c7e07-9a6a-4956-993d-8bad411591ce tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:29.499975 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1a2c7e07-9a6a-4956-993d-8bad411591ce tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:29.500662 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1a2c7e07-9a6a-4956-993d-8bad411591ce tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:29.600951 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bf9e292f-001c-4646-914a-c335b295b2fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:29.626510 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bf9e292f-001c-4646-914a-c335b295b2fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:29.631508 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bf9e292f-001c-4646-914a-c335b295b2fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:29.634396 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bf9e292f-001c-4646-914a-c335b295b2fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1338 microversion: 2.20 time: 0.191037 Apr 05 11:51:29.637457 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 35/68] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:29 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1338 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:29.676620 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-af4c26e2-e23d-4a1a-a795-78f6d3bf59d8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:29.677232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-af4c26e2-e23d-4a1a-a795-78f6d3bf59d8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:29.683760 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-af4c26e2-e23d-4a1a-a795-78f6d3bf59d8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:29.684250 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-af4c26e2-e23d-4a1a-a795-78f6d3bf59d8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:29.685009 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-af4c26e2-e23d-4a1a-a795-78f6d3bf59d8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:29.685665 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-af4c26e2-e23d-4a1a-a795-78f6d3bf59d8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:29.854121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-af4c26e2-e23d-4a1a-a795-78f6d3bf59d8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:29.862699 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-af4c26e2-e23d-4a1a-a795-78f6d3bf59d8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1322 microversion: 2.1 time: 0.190214 Apr 05 11:51:29.864024 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 36/69] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:29 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:29.871371 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c8fcdb78-0de6-4af4-a7a5-b9f38ca58e30 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:29.872190 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c8fcdb78-0de6-4af4-a7a5-b9f38ca58e30 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:29.882167 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c8fcdb78-0de6-4af4-a7a5-b9f38ca58e30 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:29.883456 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c8fcdb78-0de6-4af4-a7a5-b9f38ca58e30 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:29.884772 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c8fcdb78-0de6-4af4-a7a5-b9f38ca58e30 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:29.885230 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c8fcdb78-0de6-4af4-a7a5-b9f38ca58e30 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:29.887121 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1a2c7e07-9a6a-4956-993d-8bad411591ce tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:29.919894 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1a2c7e07-9a6a-4956-993d-8bad411591ce tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 0.453896 Apr 05 11:51:29.920528 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 34/70] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:29 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:29.994802 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c8fcdb78-0de6-4af4-a7a5-b9f38ca58e30 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:30.002832 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c8fcdb78-0de6-4af4-a7a5-b9f38ca58e30 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1307 microversion: 2.1 time: 0.137407 Apr 05 11:51:30.003818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 37/71] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:29 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1307 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:30.125271 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f4b48fd7-c6e9-46e4-9749-4cbe81763b46 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:30.126351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f4b48fd7-c6e9-46e4-9749-4cbe81763b46 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:30.134517 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f4b48fd7-c6e9-46e4-9749-4cbe81763b46 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:30.135233 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f4b48fd7-c6e9-46e4-9749-4cbe81763b46 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:30.136220 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f4b48fd7-c6e9-46e4-9749-4cbe81763b46 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:30.136862 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f4b48fd7-c6e9-46e4-9749-4cbe81763b46 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:30.229125 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f4b48fd7-c6e9-46e4-9749-4cbe81763b46 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:30.237290 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f4b48fd7-c6e9-46e4-9749-4cbe81763b46 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1301 microversion: 2.1 time: 0.116065 Apr 05 11:51:30.237912 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 35/72] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:30 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1301 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:30.653810 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3a7d24bb-6ca0-4549-8f50-0a3675514f7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:30.654493 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3a7d24bb-6ca0-4549-8f50-0a3675514f7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:30.660745 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a7d24bb-6ca0-4549-8f50-0a3675514f7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:30.661215 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a7d24bb-6ca0-4549-8f50-0a3675514f7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:30.661970 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a7d24bb-6ca0-4549-8f50-0a3675514f7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:30.662399 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a7d24bb-6ca0-4549-8f50-0a3675514f7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:30.797075 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3a7d24bb-6ca0-4549-8f50-0a3675514f7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:30.804926 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3a7d24bb-6ca0-4549-8f50-0a3675514f7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:30.806528 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3a7d24bb-6ca0-4549-8f50-0a3675514f7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:30.807627 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3a7d24bb-6ca0-4549-8f50-0a3675514f7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.158393 Apr 05 11:51:30.808170 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 38/73] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:30 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:30.880902 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5abf077d-b9d4-4eaf-85b8-f4301a30cb1c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:30.881530 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5abf077d-b9d4-4eaf-85b8-f4301a30cb1c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:30.887975 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5abf077d-b9d4-4eaf-85b8-f4301a30cb1c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:30.888472 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5abf077d-b9d4-4eaf-85b8-f4301a30cb1c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:30.889239 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5abf077d-b9d4-4eaf-85b8-f4301a30cb1c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:30.889666 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5abf077d-b9d4-4eaf-85b8-f4301a30cb1c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:30.936375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d52a4147-61e4-4b1c-8e2b-766216903e7e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:30.937259 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d52a4147-61e4-4b1c-8e2b-766216903e7e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:30.943582 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d52a4147-61e4-4b1c-8e2b-766216903e7e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:30.944033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d52a4147-61e4-4b1c-8e2b-766216903e7e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:30.944823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d52a4147-61e4-4b1c-8e2b-766216903e7e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:30.945279 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d52a4147-61e4-4b1c-8e2b-766216903e7e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:31.031799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5abf077d-b9d4-4eaf-85b8-f4301a30cb1c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:31.039656 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5abf077d-b9d4-4eaf-85b8-f4301a30cb1c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1322 microversion: 2.1 time: 0.162576 Apr 05 11:51:31.043103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 36/74] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:30 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:31.046260 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-680e3ef4-c98b-4ec2-bbb4-c692d96b4050 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:31.046885 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-680e3ef4-c98b-4ec2-bbb4-c692d96b4050 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:31.053992 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-680e3ef4-c98b-4ec2-bbb4-c692d96b4050 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:31.054454 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-680e3ef4-c98b-4ec2-bbb4-c692d96b4050 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:31.055669 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-680e3ef4-c98b-4ec2-bbb4-c692d96b4050 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:31.056136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-680e3ef4-c98b-4ec2-bbb4-c692d96b4050 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:31.085886 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d52a4147-61e4-4b1c-8e2b-766216903e7e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:31.093164 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d52a4147-61e4-4b1c-8e2b-766216903e7e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 0.160649 Apr 05 11:51:31.093778 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 39/75] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:30 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:51:31.117254 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-680e3ef4-c98b-4ec2-bbb4-c692d96b4050 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:31.124604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-680e3ef4-c98b-4ec2-bbb4-c692d96b4050 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1295 microversion: 2.1 time: 0.083213 Apr 05 11:51:31.125176 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 37/76] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:31 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1295 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:31.255280 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9260160d-3eb0-4c8a-8256-fca6d0992333 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:31.255883 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9260160d-3eb0-4c8a-8256-fca6d0992333 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:31.262333 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9260160d-3eb0-4c8a-8256-fca6d0992333 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:31.262799 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9260160d-3eb0-4c8a-8256-fca6d0992333 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:31.263548 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9260160d-3eb0-4c8a-8256-fca6d0992333 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:31.263978 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9260160d-3eb0-4c8a-8256-fca6d0992333 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:31.330607 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9260160d-3eb0-4c8a-8256-fca6d0992333 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:31.338430 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9260160d-3eb0-4c8a-8256-fca6d0992333 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1301 microversion: 2.1 time: 0.087109 Apr 05 11:51:31.339012 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 40/77] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:31 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1301 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:31.826556 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-619c26f9-504e-423f-9d75-f888b3a6233a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:31.827170 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-619c26f9-504e-423f-9d75-f888b3a6233a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:31.835803 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-619c26f9-504e-423f-9d75-f888b3a6233a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:31.836503 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-619c26f9-504e-423f-9d75-f888b3a6233a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:31.837690 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-619c26f9-504e-423f-9d75-f888b3a6233a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:31.838301 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-619c26f9-504e-423f-9d75-f888b3a6233a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:31.984010 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-619c26f9-504e-423f-9d75-f888b3a6233a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:31.992849 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-619c26f9-504e-423f-9d75-f888b3a6233a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:31.994360 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-619c26f9-504e-423f-9d75-f888b3a6233a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:31.995469 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-619c26f9-504e-423f-9d75-f888b3a6233a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.172918 Apr 05 11:51:31.996052 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 38/78] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:31 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:32.059985 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1396c64a-0f2e-4dc3-8d61-230a7b1e0f91 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:32.060923 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1396c64a-0f2e-4dc3-8d61-230a7b1e0f91 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:32.071288 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1396c64a-0f2e-4dc3-8d61-230a7b1e0f91 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:32.072038 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1396c64a-0f2e-4dc3-8d61-230a7b1e0f91 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:32.073365 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1396c64a-0f2e-4dc3-8d61-230a7b1e0f91 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:32.074092 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1396c64a-0f2e-4dc3-8d61-230a7b1e0f91 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:32.110576 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1fc67f71-14ee-4b2b-85f6-0be554f9b5f7 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:32.111180 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1fc67f71-14ee-4b2b-85f6-0be554f9b5f7 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:32.117582 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1fc67f71-14ee-4b2b-85f6-0be554f9b5f7 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:32.118029 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1fc67f71-14ee-4b2b-85f6-0be554f9b5f7 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:32.118794 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1fc67f71-14ee-4b2b-85f6-0be554f9b5f7 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:32.119639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1fc67f71-14ee-4b2b-85f6-0be554f9b5f7 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:32.222880 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1396c64a-0f2e-4dc3-8d61-230a7b1e0f91 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:32.230048 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1396c64a-0f2e-4dc3-8d61-230a7b1e0f91 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1322 microversion: 2.1 time: 0.176669 Apr 05 11:51:32.230614 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 41/79] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:32 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:32.235517 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6f17e2f6-7330-4195-add4-25af01eac384 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:32.236225 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6f17e2f6-7330-4195-add4-25af01eac384 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:32.243311 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f17e2f6-7330-4195-add4-25af01eac384 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:32.243751 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f17e2f6-7330-4195-add4-25af01eac384 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:32.244538 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f17e2f6-7330-4195-add4-25af01eac384 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:32.244965 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f17e2f6-7330-4195-add4-25af01eac384 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:32.265900 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1fc67f71-14ee-4b2b-85f6-0be554f9b5f7 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:32.273100 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1fc67f71-14ee-4b2b-85f6-0be554f9b5f7 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 0.166733 Apr 05 11:51:32.273666 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 39/80] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:32 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:32.305867 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6f17e2f6-7330-4195-add4-25af01eac384 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:32.313051 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6f17e2f6-7330-4195-add4-25af01eac384 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1295 microversion: 2.1 time: 0.081464 Apr 05 11:51:32.313589 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 42/81] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:32 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1295 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:32.355299 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-726d8917-f567-431a-aa9c-90bb33ab0b04 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:32.355904 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-726d8917-f567-431a-aa9c-90bb33ab0b04 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:32.363107 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-726d8917-f567-431a-aa9c-90bb33ab0b04 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:32.363549 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-726d8917-f567-431a-aa9c-90bb33ab0b04 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:32.364369 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-726d8917-f567-431a-aa9c-90bb33ab0b04 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:32.364804 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-726d8917-f567-431a-aa9c-90bb33ab0b04 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:32.424642 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-726d8917-f567-431a-aa9c-90bb33ab0b04 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:32.432032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-726d8917-f567-431a-aa9c-90bb33ab0b04 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1301 microversion: 2.1 time: 0.080677 Apr 05 11:51:32.432660 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 40/82] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:32 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1301 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:33.018023 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-046d1170-3b05-4cd4-997a-095231f5e8dc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:33.019033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-046d1170-3b05-4cd4-997a-095231f5e8dc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:33.029431 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-046d1170-3b05-4cd4-997a-095231f5e8dc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:33.030174 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-046d1170-3b05-4cd4-997a-095231f5e8dc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:33.031421 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-046d1170-3b05-4cd4-997a-095231f5e8dc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:33.032233 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-046d1170-3b05-4cd4-997a-095231f5e8dc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:33.171158 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-046d1170-3b05-4cd4-997a-095231f5e8dc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:33.179786 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-046d1170-3b05-4cd4-997a-095231f5e8dc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:33.181370 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-046d1170-3b05-4cd4-997a-095231f5e8dc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:33.182502 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-046d1170-3b05-4cd4-997a-095231f5e8dc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.171099 Apr 05 11:51:33.183071 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 43/83] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:33 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:33.246820 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2ba51a51-ce5e-437b-96ba-887cb19255c9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:33.247828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2ba51a51-ce5e-437b-96ba-887cb19255c9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:33.253715 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ba51a51-ce5e-437b-96ba-887cb19255c9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:33.254218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ba51a51-ce5e-437b-96ba-887cb19255c9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:33.254983 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ba51a51-ce5e-437b-96ba-887cb19255c9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:33.255423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ba51a51-ce5e-437b-96ba-887cb19255c9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:33.290106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-993b08ad-8ea6-4a54-bd9f-aab57948608e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:33.290717 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-993b08ad-8ea6-4a54-bd9f-aab57948608e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:33.296635 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-993b08ad-8ea6-4a54-bd9f-aab57948608e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:33.297115 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-993b08ad-8ea6-4a54-bd9f-aab57948608e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:33.297873 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-993b08ad-8ea6-4a54-bd9f-aab57948608e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:33.298307 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-993b08ad-8ea6-4a54-bd9f-aab57948608e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:33.392833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2ba51a51-ce5e-437b-96ba-887cb19255c9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:33.400151 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2ba51a51-ce5e-437b-96ba-887cb19255c9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1322 microversion: 2.1 time: 0.157163 Apr 05 11:51:33.400757 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 41/84] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:33 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:33.405320 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-02d74889-3a2c-4d6c-a115-00f0f39c2f31 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:33.405918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-02d74889-3a2c-4d6c-a115-00f0f39c2f31 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:33.412095 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02d74889-3a2c-4d6c-a115-00f0f39c2f31 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:33.412548 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02d74889-3a2c-4d6c-a115-00f0f39c2f31 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:33.413375 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02d74889-3a2c-4d6c-a115-00f0f39c2f31 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:33.413799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02d74889-3a2c-4d6c-a115-00f0f39c2f31 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:33.430078 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-993b08ad-8ea6-4a54-bd9f-aab57948608e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:33.437840 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-993b08ad-8ea6-4a54-bd9f-aab57948608e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 0.151690 Apr 05 11:51:33.438602 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 44/85] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:33 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:51:33.447963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-424b40cd-9873-4b41-b041-f64f99ba1914 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:33.448625 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-424b40cd-9873-4b41-b041-f64f99ba1914 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:33.454520 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-424b40cd-9873-4b41-b041-f64f99ba1914 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:33.454965 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-424b40cd-9873-4b41-b041-f64f99ba1914 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:33.455749 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-424b40cd-9873-4b41-b041-f64f99ba1914 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:33.456193 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-424b40cd-9873-4b41-b041-f64f99ba1914 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:33.473262 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-02d74889-3a2c-4d6c-a115-00f0f39c2f31 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:33.480363 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-02d74889-3a2c-4d6c-a115-00f0f39c2f31 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1295 microversion: 2.1 time: 0.078663 Apr 05 11:51:33.480938 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 42/86] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:33 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1295 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:33.515325 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-424b40cd-9873-4b41-b041-f64f99ba1914 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:33.522748 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-424b40cd-9873-4b41-b041-f64f99ba1914 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1301 microversion: 2.1 time: 0.078395 Apr 05 11:51:33.523321 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 45/87] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:33 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1301 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:51:34.203060 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-005ba17a-a1c0-44ba-a068-1822a23d37fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:34.203752 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-005ba17a-a1c0-44ba-a068-1822a23d37fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:34.214043 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-005ba17a-a1c0-44ba-a068-1822a23d37fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:34.214494 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-005ba17a-a1c0-44ba-a068-1822a23d37fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:34.215315 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-005ba17a-a1c0-44ba-a068-1822a23d37fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:34.215752 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-005ba17a-a1c0-44ba-a068-1822a23d37fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:34.419090 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8ab140a7-e61b-4ec4-8314-be928cb71d98 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:34.420349 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8ab140a7-e61b-4ec4-8314-be928cb71d98 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:34.428021 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8ab140a7-e61b-4ec4-8314-be928cb71d98 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:34.428608 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8ab140a7-e61b-4ec4-8314-be928cb71d98 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:34.429733 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8ab140a7-e61b-4ec4-8314-be928cb71d98 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:34.430516 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8ab140a7-e61b-4ec4-8314-be928cb71d98 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:34.595800 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8ab140a7-e61b-4ec4-8314-be928cb71d98 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:34.605091 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8ab140a7-e61b-4ec4-8314-be928cb71d98 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1322 microversion: 2.1 time: 0.189896 Apr 05 11:51:34.616042 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 46/88] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:34 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:34.616042 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6f11c4d5-c23f-48da-a369-9926de406b00 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:34.616042 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6f11c4d5-c23f-48da-a369-9926de406b00 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:34.619453 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f11c4d5-c23f-48da-a369-9926de406b00 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:34.619674 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f11c4d5-c23f-48da-a369-9926de406b00 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:34.620466 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f11c4d5-c23f-48da-a369-9926de406b00 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:34.620901 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f11c4d5-c23f-48da-a369-9926de406b00 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:34.682820 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-005ba17a-a1c0-44ba-a068-1822a23d37fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:34.693329 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-005ba17a-a1c0-44ba-a068-1822a23d37fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:34.695751 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-005ba17a-a1c0-44ba-a068-1822a23d37fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:34.697366 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-005ba17a-a1c0-44ba-a068-1822a23d37fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.500843 Apr 05 11:51:34.698092 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 43/89] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:34 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:34.703690 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8a807a14-17b6-4d82-be22-07c894eeed07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:34.704620 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8a807a14-17b6-4d82-be22-07c894eeed07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:34.711693 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8a807a14-17b6-4d82-be22-07c894eeed07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:34.712447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8a807a14-17b6-4d82-be22-07c894eeed07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:34.713420 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8a807a14-17b6-4d82-be22-07c894eeed07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:34.714200 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8a807a14-17b6-4d82-be22-07c894eeed07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:34.782301 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6f11c4d5-c23f-48da-a369-9926de406b00 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:34.789810 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6f11c4d5-c23f-48da-a369-9926de406b00 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 0.182271 Apr 05 11:51:34.790391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 47/90] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:34 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:34.794970 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8a807a14-17b6-4d82-be22-07c894eeed07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:34.796065 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fbfe3136-48e9-4da1-89ca-7c36a5300731 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:34.797234 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fbfe3136-48e9-4da1-89ca-7c36a5300731 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:34.804926 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8a807a14-17b6-4d82-be22-07c894eeed07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1295 microversion: 2.1 time: 0.104804 Apr 05 11:51:34.805094 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fbfe3136-48e9-4da1-89ca-7c36a5300731 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:34.805673 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fbfe3136-48e9-4da1-89ca-7c36a5300731 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:34.805804 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 44/91] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:34 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1295 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:34.806901 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fbfe3136-48e9-4da1-89ca-7c36a5300731 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:34.807483 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fbfe3136-48e9-4da1-89ca-7c36a5300731 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:34.879508 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fbfe3136-48e9-4da1-89ca-7c36a5300731 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:34.888439 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fbfe3136-48e9-4da1-89ca-7c36a5300731 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1299 microversion: 2.1 time: 0.095989 Apr 05 11:51:34.889143 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 48/92] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:34 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:35.071803 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-ce6886f0-4191-4638-a348-a847eb6182f1 req-2fc5f25f-b9cd-413f-86d1-ab9600df5306 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a3437c-94c0-4133-a629-9386b4639a2d", "tag": "4b172ae7-f382-4bd9-8d9f-48fd8694b406"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:51:35.082331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-ce6886f0-4191-4638-a348-a847eb6182f1 req-2fc5f25f-b9cd-413f-86d1-ab9600df5306 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:35.082772 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-ce6886f0-4191-4638-a348-a847eb6182f1 req-2fc5f25f-b9cd-413f-86d1-ab9600df5306 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:35.097691 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-ce6886f0-4191-4638-a348-a847eb6182f1 req-2fc5f25f-b9cd-413f-86d1-ab9600df5306 service nova] Creating event network-changed:4b172ae7-f382-4bd9-8d9f-48fd8694b406 for instance 98a3437c-94c0-4133-a629-9386b4639a2d on hv-cinder-82956 Apr 05 11:51:35.104421 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-ce6886f0-4191-4638-a348-a847eb6182f1 req-2fc5f25f-b9cd-413f-86d1-ab9600df5306 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036071 Apr 05 11:51:35.106250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 45/93] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:51:35.623698 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7e6eb417-9e1b-4184-9337-111f7942ada2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:35.624394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7e6eb417-9e1b-4184-9337-111f7942ada2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:35.631509 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7e6eb417-9e1b-4184-9337-111f7942ada2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:35.631509 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7e6eb417-9e1b-4184-9337-111f7942ada2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:35.632361 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7e6eb417-9e1b-4184-9337-111f7942ada2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:35.632802 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7e6eb417-9e1b-4184-9337-111f7942ada2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:35.716364 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6cdf202b-f75d-4a69-962a-d8d44c78a708 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:35.717611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6cdf202b-f75d-4a69-962a-d8d44c78a708 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:35.724018 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6cdf202b-f75d-4a69-962a-d8d44c78a708 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:35.724565 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6cdf202b-f75d-4a69-962a-d8d44c78a708 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:35.725342 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6cdf202b-f75d-4a69-962a-d8d44c78a708 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:35.725776 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6cdf202b-f75d-4a69-962a-d8d44c78a708 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:35.771968 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7e6eb417-9e1b-4184-9337-111f7942ada2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:35.782041 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7e6eb417-9e1b-4184-9337-111f7942ada2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1322 microversion: 2.1 time: 0.163127 Apr 05 11:51:35.782841 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 49/94] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:35 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:35.807030 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-258c5ab5-588e-4edc-a437-a09570ad658e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:35.807747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-258c5ab5-588e-4edc-a437-a09570ad658e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:35.814017 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-258c5ab5-588e-4edc-a437-a09570ad658e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:35.814474 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-258c5ab5-588e-4edc-a437-a09570ad658e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:35.815241 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-258c5ab5-588e-4edc-a437-a09570ad658e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:35.817036 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-258c5ab5-588e-4edc-a437-a09570ad658e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:35.885535 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6cdf202b-f75d-4a69-962a-d8d44c78a708 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:35.893599 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6cdf202b-f75d-4a69-962a-d8d44c78a708 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:35.895226 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6cdf202b-f75d-4a69-962a-d8d44c78a708 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:35.896367 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6cdf202b-f75d-4a69-962a-d8d44c78a708 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.184711 Apr 05 11:51:35.896940 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 46/95] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:35 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:51:35.903013 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a7ff6e03-d9cf-4c56-b253-2aa3e2dacf97 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:35.903617 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a7ff6e03-d9cf-4c56-b253-2aa3e2dacf97 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:35.909529 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a7ff6e03-d9cf-4c56-b253-2aa3e2dacf97 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:35.910241 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a7ff6e03-d9cf-4c56-b253-2aa3e2dacf97 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:35.911011 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a7ff6e03-d9cf-4c56-b253-2aa3e2dacf97 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:35.911454 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a7ff6e03-d9cf-4c56-b253-2aa3e2dacf97 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:35.970747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-258c5ab5-588e-4edc-a437-a09570ad658e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:35.977001 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a7ff6e03-d9cf-4c56-b253-2aa3e2dacf97 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:35.981546 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-258c5ab5-588e-4edc-a437-a09570ad658e tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 0.178264 Apr 05 11:51:35.982139 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 50/96] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:35 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:51:35.984836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a7ff6e03-d9cf-4c56-b253-2aa3e2dacf97 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1295 microversion: 2.1 time: 0.086852 Apr 05 11:51:35.985549 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 47/97] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:35 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1295 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:35.987415 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-486c4c42-34e1-4e30-83d7-6a4f4d611cb9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:35.988103 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-486c4c42-34e1-4e30-83d7-6a4f4d611cb9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:35.994987 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-486c4c42-34e1-4e30-83d7-6a4f4d611cb9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:35.995487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-486c4c42-34e1-4e30-83d7-6a4f4d611cb9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:35.996296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-486c4c42-34e1-4e30-83d7-6a4f4d611cb9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:35.996734 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-486c4c42-34e1-4e30-83d7-6a4f4d611cb9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:36.056506 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-486c4c42-34e1-4e30-83d7-6a4f4d611cb9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:36.063711 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-486c4c42-34e1-4e30-83d7-6a4f4d611cb9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1299 microversion: 2.1 time: 0.080356 Apr 05 11:51:36.064329 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 51/98] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:35 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1299 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:36.336858 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-f957aead-e44f-4b28-b0f4-f2fed00c0839 req-12f28265-3751-4f19-af4c-0c10d1e5779e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159c0fda-d790-488a-bbdc-a3b9ee6174d1", "name": "network-vif-plugged", "status": "completed", "tag": "baa72685-1fff-4499-bff9-2ee7cbb1dcf5"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:51:36.345454 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-f957aead-e44f-4b28-b0f4-f2fed00c0839 req-12f28265-3751-4f19-af4c-0c10d1e5779e service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:36.346092 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-f957aead-e44f-4b28-b0f4-f2fed00c0839 req-12f28265-3751-4f19-af4c-0c10d1e5779e service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:36.359737 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-f957aead-e44f-4b28-b0f4-f2fed00c0839 req-12f28265-3751-4f19-af4c-0c10d1e5779e service nova] Creating event network-vif-plugged:baa72685-1fff-4499-bff9-2ee7cbb1dcf5 for instance 159c0fda-d790-488a-bbdc-a3b9ee6174d1 on hv-cinder-82956 Apr 05 11:51:36.365404 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-f957aead-e44f-4b28-b0f4-f2fed00c0839 req-12f28265-3751-4f19-af4c-0c10d1e5779e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032460 Apr 05 11:51:36.366206 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 48/99] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:51:36.799023 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a2051fb5-df9b-447c-b664-ce871d5bfaf2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:36.799817 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a2051fb5-df9b-447c-b664-ce871d5bfaf2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:36.806168 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a2051fb5-df9b-447c-b664-ce871d5bfaf2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:36.806653 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a2051fb5-df9b-447c-b664-ce871d5bfaf2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:36.807432 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a2051fb5-df9b-447c-b664-ce871d5bfaf2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:36.807849 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a2051fb5-df9b-447c-b664-ce871d5bfaf2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:36.914940 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8194cebe-2b93-48ad-9063-b10801bb871e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:36.916575 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8194cebe-2b93-48ad-9063-b10801bb871e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:36.925253 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8194cebe-2b93-48ad-9063-b10801bb871e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:36.926132 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8194cebe-2b93-48ad-9063-b10801bb871e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:36.927956 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8194cebe-2b93-48ad-9063-b10801bb871e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:36.928610 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8194cebe-2b93-48ad-9063-b10801bb871e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:36.969557 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a2051fb5-df9b-447c-b664-ce871d5bfaf2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:36.979761 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a2051fb5-df9b-447c-b664-ce871d5bfaf2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1322 microversion: 2.1 time: 0.184138 Apr 05 11:51:36.980751 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 52/100] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:36 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:37.000878 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-34ec0472-64e9-4158-91bc-2cc1432004d8 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:37.001559 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-34ec0472-64e9-4158-91bc-2cc1432004d8 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:37.015419 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34ec0472-64e9-4158-91bc-2cc1432004d8 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:37.016152 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34ec0472-64e9-4158-91bc-2cc1432004d8 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:37.017243 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34ec0472-64e9-4158-91bc-2cc1432004d8 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:37.018006 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34ec0472-64e9-4158-91bc-2cc1432004d8 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:37.140420 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8194cebe-2b93-48ad-9063-b10801bb871e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:37.149439 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8194cebe-2b93-48ad-9063-b10801bb871e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:37.151202 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8194cebe-2b93-48ad-9063-b10801bb871e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:37.152560 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8194cebe-2b93-48ad-9063-b10801bb871e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.242705 Apr 05 11:51:37.163416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 49/101] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:36 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:51:37.168226 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d0d382eb-dedb-4c19-b2c4-5ac3698bd59c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:37.168848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d0d382eb-dedb-4c19-b2c4-5ac3698bd59c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:37.174930 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d0d382eb-dedb-4c19-b2c4-5ac3698bd59c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:37.175435 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d0d382eb-dedb-4c19-b2c4-5ac3698bd59c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:37.176300 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d0d382eb-dedb-4c19-b2c4-5ac3698bd59c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:37.176739 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d0d382eb-dedb-4c19-b2c4-5ac3698bd59c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:37.181652 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-34ec0472-64e9-4158-91bc-2cc1432004d8 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:37.190469 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-34ec0472-64e9-4158-91bc-2cc1432004d8 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 0.195542 Apr 05 11:51:37.191549 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 53/102] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:36 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:51:37.196299 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b55479c7-d39b-4ef6-ba67-66d69968f987 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:37.197134 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b55479c7-d39b-4ef6-ba67-66d69968f987 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:37.203838 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b55479c7-d39b-4ef6-ba67-66d69968f987 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:37.204640 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b55479c7-d39b-4ef6-ba67-66d69968f987 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:37.205610 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b55479c7-d39b-4ef6-ba67-66d69968f987 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:37.206393 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b55479c7-d39b-4ef6-ba67-66d69968f987 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:37.246053 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d0d382eb-dedb-4c19-b2c4-5ac3698bd59c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:37.253963 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d0d382eb-dedb-4c19-b2c4-5ac3698bd59c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1295 microversion: 2.1 time: 0.089386 Apr 05 11:51:37.255286 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 50/103] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:37 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1295 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:37.276115 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b55479c7-d39b-4ef6-ba67-66d69968f987 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:37.283317 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b55479c7-d39b-4ef6-ba67-66d69968f987 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1299 microversion: 2.1 time: 0.090564 Apr 05 11:51:37.288408 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 54/104] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:37 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:37.997249 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-278cf6ab-b6e9-4901-b6f6-8021e0934201 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:37.997846 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-278cf6ab-b6e9-4901-b6f6-8021e0934201 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:38.004223 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-278cf6ab-b6e9-4901-b6f6-8021e0934201 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:38.004675 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-278cf6ab-b6e9-4901-b6f6-8021e0934201 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:38.005436 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-278cf6ab-b6e9-4901-b6f6-8021e0934201 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:38.005873 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-278cf6ab-b6e9-4901-b6f6-8021e0934201 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:38.144897 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-278cf6ab-b6e9-4901-b6f6-8021e0934201 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:38.153715 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-278cf6ab-b6e9-4901-b6f6-8021e0934201 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1322 microversion: 2.1 time: 0.160336 Apr 05 11:51:38.154279 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 51/105] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:37 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:38.171489 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c53e72f2-fff1-4d77-bff8-c54a8cf951ef tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:38.172110 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c53e72f2-fff1-4d77-bff8-c54a8cf951ef tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:38.178656 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c53e72f2-fff1-4d77-bff8-c54a8cf951ef tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:38.179097 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c53e72f2-fff1-4d77-bff8-c54a8cf951ef tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:38.179883 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c53e72f2-fff1-4d77-bff8-c54a8cf951ef tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:38.180327 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c53e72f2-fff1-4d77-bff8-c54a8cf951ef tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:38.207182 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ab4ec8df-1123-4134-85ce-6b6b3f94f7b1 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:38.207772 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ab4ec8df-1123-4134-85ce-6b6b3f94f7b1 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:38.213766 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab4ec8df-1123-4134-85ce-6b6b3f94f7b1 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:38.214214 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab4ec8df-1123-4134-85ce-6b6b3f94f7b1 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:38.214979 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab4ec8df-1123-4134-85ce-6b6b3f94f7b1 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:38.215408 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab4ec8df-1123-4134-85ce-6b6b3f94f7b1 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:38.466872 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c53e72f2-fff1-4d77-bff8-c54a8cf951ef tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:38.474843 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c53e72f2-fff1-4d77-bff8-c54a8cf951ef tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:38.476572 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c53e72f2-fff1-4d77-bff8-c54a8cf951ef tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:38.479550 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c53e72f2-fff1-4d77-bff8-c54a8cf951ef tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.311101 Apr 05 11:51:38.480419 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 55/106] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:38 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:38.485520 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8fe2c609-6e74-4568-b4a5-d9502c2a58e2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:38.486197 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8fe2c609-6e74-4568-b4a5-d9502c2a58e2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:38.495213 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8fe2c609-6e74-4568-b4a5-d9502c2a58e2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:38.495882 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8fe2c609-6e74-4568-b4a5-d9502c2a58e2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:38.496934 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8fe2c609-6e74-4568-b4a5-d9502c2a58e2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:38.497893 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8fe2c609-6e74-4568-b4a5-d9502c2a58e2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:38.566359 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8fe2c609-6e74-4568-b4a5-d9502c2a58e2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:38.577072 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8fe2c609-6e74-4568-b4a5-d9502c2a58e2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1295 microversion: 2.1 time: 0.095375 Apr 05 11:51:38.578314 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 56/107] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:38 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1295 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:38.595823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5bc2e0ec-59be-438f-becc-1733635740b8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:38.596825 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5bc2e0ec-59be-438f-becc-1733635740b8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:38.605904 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ab4ec8df-1123-4134-85ce-6b6b3f94f7b1 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:38.616865 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ab4ec8df-1123-4134-85ce-6b6b3f94f7b1 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 0.413964 Apr 05 11:51:38.622180 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 52/108] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:38 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:51:38.635347 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5bc2e0ec-59be-438f-becc-1733635740b8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:38.636893 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5bc2e0ec-59be-438f-becc-1733635740b8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:38.639479 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5bc2e0ec-59be-438f-becc-1733635740b8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:38.639922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5bc2e0ec-59be-438f-becc-1733635740b8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:38.935994 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5bc2e0ec-59be-438f-becc-1733635740b8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:38.945184 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5bc2e0ec-59be-438f-becc-1733635740b8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1299 microversion: 2.1 time: 0.354728 Apr 05 11:51:38.955237 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 57/109] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:38 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1299 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:39.171583 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d188a46b-32dd-4324-9364-1689ae375218 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:39.173147 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d188a46b-32dd-4324-9364-1689ae375218 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:39.183377 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d188a46b-32dd-4324-9364-1689ae375218 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:39.184036 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d188a46b-32dd-4324-9364-1689ae375218 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:39.185329 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d188a46b-32dd-4324-9364-1689ae375218 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:39.185933 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d188a46b-32dd-4324-9364-1689ae375218 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:39.498371 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d673f6b1-70fa-4610-897d-fedb7650dce5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:39.499448 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d673f6b1-70fa-4610-897d-fedb7650dce5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:39.516265 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d673f6b1-70fa-4610-897d-fedb7650dce5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:39.517661 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d673f6b1-70fa-4610-897d-fedb7650dce5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:39.520169 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d673f6b1-70fa-4610-897d-fedb7650dce5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:39.520947 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d673f6b1-70fa-4610-897d-fedb7650dce5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:39.897720 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d188a46b-32dd-4324-9364-1689ae375218 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:39.906315 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d188a46b-32dd-4324-9364-1689ae375218 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1322 microversion: 2.1 time: 0.740476 Apr 05 11:51:39.907058 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 53/110] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:39 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1322 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:39.916289 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d673f6b1-70fa-4610-897d-fedb7650dce5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:39.920096 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d6053a34-e9f4-4e96-ac34-30a7bc4fec51 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:39.920719 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d6053a34-e9f4-4e96-ac34-30a7bc4fec51 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:39.926216 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d673f6b1-70fa-4610-897d-fedb7650dce5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:39.926764 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d6053a34-e9f4-4e96-ac34-30a7bc4fec51 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:39.927264 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d6053a34-e9f4-4e96-ac34-30a7bc4fec51 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:39.927721 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d673f6b1-70fa-4610-897d-fedb7650dce5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:39.928555 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d6053a34-e9f4-4e96-ac34-30a7bc4fec51 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:39.928860 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d673f6b1-70fa-4610-897d-fedb7650dce5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.434451 Apr 05 11:51:39.929009 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d6053a34-e9f4-4e96-ac34-30a7bc4fec51 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:39.929697 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 58/111] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:39 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:51:39.934371 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-54382aaa-846d-4776-a905-a9d2e07aa387 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:39.935143 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-54382aaa-846d-4776-a905-a9d2e07aa387 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:39.941226 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-54382aaa-846d-4776-a905-a9d2e07aa387 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:39.941879 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-54382aaa-846d-4776-a905-a9d2e07aa387 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:39.942809 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-54382aaa-846d-4776-a905-a9d2e07aa387 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:39.943387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-54382aaa-846d-4776-a905-a9d2e07aa387 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:40.172458 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-54382aaa-846d-4776-a905-a9d2e07aa387 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:40.179938 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d6053a34-e9f4-4e96-ac34-30a7bc4fec51 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:40.182241 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-54382aaa-846d-4776-a905-a9d2e07aa387 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 0.251312 Apr 05 11:51:40.183029 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 59/112] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:39 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:40.189439 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d6053a34-e9f4-4e96-ac34-30a7bc4fec51 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.281216 Apr 05 11:51:40.190249 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 54/113] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:39 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:40.198052 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1f917390-6469-4dd5-bf7d-43413a97e155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:40.199185 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1f917390-6469-4dd5-bf7d-43413a97e155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:40.204111 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ead0fc9a-3750-498e-b74d-1df375943917 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-34692815", "imageRef": "2b657785-cb0b-43ba-956c-1564c27fd10a", "flavorRef": "452", "networks": [{"uuid": "fe38ead3-de1a-4598-9c4f-98d57d249c1e"}]}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:51:40.205660 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1f917390-6469-4dd5-bf7d-43413a97e155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:40.206323 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1f917390-6469-4dd5-bf7d-43413a97e155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:40.207400 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1f917390-6469-4dd5-bf7d-43413a97e155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:40.208033 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1f917390-6469-4dd5-bf7d-43413a97e155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:40.305647 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.network.neutron [None req-ead0fc9a-3750-498e-b74d-1df375943917 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] validate_networks() for [('fe38ead3-de1a-4598-9c4f-98d57d249c1e', None, None, None, None, None)] {{(pid=123358) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:51:40.413858 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1f917390-6469-4dd5-bf7d-43413a97e155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:40.422253 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1f917390-6469-4dd5-bf7d-43413a97e155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.229852 Apr 05 11:51:40.423776 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 55/114] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:40 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:40.630988 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-c695453b-3a79-44ec-87f2-3401747f4a45 req-d67c607f-804c-4d9e-9413-1dd77c25551e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8d507e3-5f14-419a-a3cd-31f36496b2d8", "tag": "54ad08dc-d08d-49a7-a3d3-ff818ba84298"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:51:40.670836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-c695453b-3a79-44ec-87f2-3401747f4a45 req-d67c607f-804c-4d9e-9413-1dd77c25551e service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:40.672726 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-c695453b-3a79-44ec-87f2-3401747f4a45 req-d67c607f-804c-4d9e-9413-1dd77c25551e service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:40.697348 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-c695453b-3a79-44ec-87f2-3401747f4a45 req-d67c607f-804c-4d9e-9413-1dd77c25551e service nova] Creating event network-changed:54ad08dc-d08d-49a7-a3d3-ff818ba84298 for instance f8d507e3-5f14-419a-a3cd-31f36496b2d8 on hv-cinder-82956 Apr 05 11:51:40.707267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-c695453b-3a79-44ec-87f2-3401747f4a45 req-d67c607f-804c-4d9e-9413-1dd77c25551e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092860 Apr 05 11:51:40.707956 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 56/115] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:51:40.883663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-ead0fc9a-3750-498e-b74d-1df375943917 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Flavor limits 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:51:40.884216 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-ead0fc9a-3750-498e-b74d-1df375943917 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Image limits 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:51:40.884713 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-ead0fc9a-3750-498e-b74d-1df375943917 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Flavor pref 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:51:40.885259 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-ead0fc9a-3750-498e-b74d-1df375943917 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Image pref 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:51:40.885660 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-ead0fc9a-3750-498e-b74d-1df375943917 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:51:40.895478 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ead0fc9a-3750-498e-b74d-1df375943917 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:40.895929 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ead0fc9a-3750-498e-b74d-1df375943917 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:40.896747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ead0fc9a-3750-498e-b74d-1df375943917 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:40.897183 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ead0fc9a-3750-498e-b74d-1df375943917 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:40.914817 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-ead0fc9a-3750-498e-b74d-1df375943917 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Getting quotas for project 0d972b47694842bea4274943bdfd9ede. Resources: {'ram', 'instances', 'cores'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:51:40.918852 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-ead0fc9a-3750-498e-b74d-1df375943917 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Getting quotas for user 06e3ebdc00fd49ce9350df9efa29e199 and project 0d972b47694842bea4274943bdfd9ede. Resources: {'ram', 'instances', 'cores'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:51:40.924603 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-295596f2-87a9-43e5-b3ee-92e9f2d6dba0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:40.925448 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-295596f2-87a9-43e5-b3ee-92e9f2d6dba0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:40.930347 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ead0fc9a-3750-498e-b74d-1df375943917 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Going to run 1 instances... {{(pid=123358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:51:40.931832 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-295596f2-87a9-43e5-b3ee-92e9f2d6dba0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:40.932296 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-295596f2-87a9-43e5-b3ee-92e9f2d6dba0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:40.932516 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ead0fc9a-3750-498e-b74d-1df375943917 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b657785-cb0b-43ba-956c-1564c27fd10a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:51:40.933062 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-295596f2-87a9-43e5-b3ee-92e9f2d6dba0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:40.933503 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-295596f2-87a9-43e5-b3ee-92e9f2d6dba0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:40.982252 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ead0fc9a-3750-498e-b74d-1df375943917 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.794966 Apr 05 11:51:40.982994 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 60/116] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Apr 5 11:51:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:51:40.992448 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7edd0f25-06ec-4a94-bac5-4d8f69a05b36 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:40.993050 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7edd0f25-06ec-4a94-bac5-4d8f69a05b36 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:40.999678 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7edd0f25-06ec-4a94-bac5-4d8f69a05b36 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:41.000237 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7edd0f25-06ec-4a94-bac5-4d8f69a05b36 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:41.001029 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7edd0f25-06ec-4a94-bac5-4d8f69a05b36 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:41.001453 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7edd0f25-06ec-4a94-bac5-4d8f69a05b36 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:41.090080 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-295596f2-87a9-43e5-b3ee-92e9f2d6dba0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:41.098386 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-295596f2-87a9-43e5-b3ee-92e9f2d6dba0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1322 microversion: 2.1 time: 0.177925 Apr 05 11:51:41.098834 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 57/117] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:40 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:41.103714 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f89e19d6-7083-460f-ad5c-9970847e24ef tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:41.104681 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f89e19d6-7083-460f-ad5c-9970847e24ef tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:41.153378 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7edd0f25-06ec-4a94-bac5-4d8f69a05b36 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:41.160593 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f89e19d6-7083-460f-ad5c-9970847e24ef tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:41.162122 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7edd0f25-06ec-4a94-bac5-4d8f69a05b36 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:41.163605 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7edd0f25-06ec-4a94-bac5-4d8f69a05b36 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:41.164901 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7edd0f25-06ec-4a94-bac5-4d8f69a05b36 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.180846 Apr 05 11:51:41.165595 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 61/118] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:40 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:41.167714 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f89e19d6-7083-460f-ad5c-9970847e24ef tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1212 microversion: 2.1 time: 0.067777 Apr 05 11:51:41.168318 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 58/119] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:41 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1212 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:41.199101 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9ff26c3c-7fba-4fcd-807e-4de482fb5197 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:41.199811 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9ff26c3c-7fba-4fcd-807e-4de482fb5197 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:41.206076 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9ff26c3c-7fba-4fcd-807e-4de482fb5197 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:41.206698 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9ff26c3c-7fba-4fcd-807e-4de482fb5197 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:41.207529 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9ff26c3c-7fba-4fcd-807e-4de482fb5197 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:41.208105 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9ff26c3c-7fba-4fcd-807e-4de482fb5197 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:41.208227 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3dc1fe3c-ff22-453f-baf3-993251668de3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:41.209119 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3dc1fe3c-ff22-453f-baf3-993251668de3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:41.216039 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3dc1fe3c-ff22-453f-baf3-993251668de3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:41.216629 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3dc1fe3c-ff22-453f-baf3-993251668de3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:41.217678 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3dc1fe3c-ff22-453f-baf3-993251668de3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:41.218131 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3dc1fe3c-ff22-453f-baf3-993251668de3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:41.351522 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9ff26c3c-7fba-4fcd-807e-4de482fb5197 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:41.360401 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9ff26c3c-7fba-4fcd-807e-4de482fb5197 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 0.164923 Apr 05 11:51:41.362832 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 62/120] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:41 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:41.364577 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3dc1fe3c-ff22-453f-baf3-993251668de3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:41.373305 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3dc1fe3c-ff22-453f-baf3-993251668de3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.170279 Apr 05 11:51:41.374050 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 59/121] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:41 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:51:41.440215 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2c4d06a3-8b6b-40b1-b022-86b8cc441d40 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:41.441035 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2c4d06a3-8b6b-40b1-b022-86b8cc441d40 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:41.447559 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2c4d06a3-8b6b-40b1-b022-86b8cc441d40 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:41.448026 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2c4d06a3-8b6b-40b1-b022-86b8cc441d40 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:41.448826 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2c4d06a3-8b6b-40b1-b022-86b8cc441d40 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:41.449261 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2c4d06a3-8b6b-40b1-b022-86b8cc441d40 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:41.586179 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2c4d06a3-8b6b-40b1-b022-86b8cc441d40 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:41.597845 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2c4d06a3-8b6b-40b1-b022-86b8cc441d40 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.161191 Apr 05 11:51:41.598409 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 63/122] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:41 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:42.119578 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e6fcf409-1686-4b48-984a-159f0116069f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:42.120661 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e6fcf409-1686-4b48-984a-159f0116069f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:42.130159 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6fcf409-1686-4b48-984a-159f0116069f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:42.130607 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6fcf409-1686-4b48-984a-159f0116069f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:42.131366 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6fcf409-1686-4b48-984a-159f0116069f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:42.131798 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6fcf409-1686-4b48-984a-159f0116069f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:42.182866 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b9835c8f-cf99-4b1d-88fa-0f453ed80781 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:42.183546 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b9835c8f-cf99-4b1d-88fa-0f453ed80781 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:42.189862 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9835c8f-cf99-4b1d-88fa-0f453ed80781 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:42.190380 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9835c8f-cf99-4b1d-88fa-0f453ed80781 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:42.191133 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9835c8f-cf99-4b1d-88fa-0f453ed80781 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:42.191678 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9835c8f-cf99-4b1d-88fa-0f453ed80781 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:42.265215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e6fcf409-1686-4b48-984a-159f0116069f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:42.272997 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e6fcf409-1686-4b48-984a-159f0116069f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1322 microversion: 2.1 time: 0.159802 Apr 05 11:51:42.273574 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 60/123] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:42 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:42.277922 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-65802d56-9988-4c39-bdd7-4c011afeb863 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:42.278916 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-65802d56-9988-4c39-bdd7-4c011afeb863 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:42.285139 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-65802d56-9988-4c39-bdd7-4c011afeb863 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:42.285684 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-65802d56-9988-4c39-bdd7-4c011afeb863 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:42.286504 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-65802d56-9988-4c39-bdd7-4c011afeb863 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:42.286996 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-65802d56-9988-4c39-bdd7-4c011afeb863 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:42.326908 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b9835c8f-cf99-4b1d-88fa-0f453ed80781 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:42.334891 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b9835c8f-cf99-4b1d-88fa-0f453ed80781 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:42.336424 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b9835c8f-cf99-4b1d-88fa-0f453ed80781 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:42.337527 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b9835c8f-cf99-4b1d-88fa-0f453ed80781 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.158648 Apr 05 11:51:42.338094 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 64/124] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:42 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:42.344994 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-65802d56-9988-4c39-bdd7-4c011afeb863 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:42.352411 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-65802d56-9988-4c39-bdd7-4c011afeb863 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1216 microversion: 2.1 time: 0.077841 Apr 05 11:51:42.353368 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 61/125] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:42 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1216 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:42.377859 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-57b1555a-39b5-4ab3-8096-fdf304dd0539 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:42.378386 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-57b1555a-39b5-4ab3-8096-fdf304dd0539 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:42.385122 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-57b1555a-39b5-4ab3-8096-fdf304dd0539 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:42.385561 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-57b1555a-39b5-4ab3-8096-fdf304dd0539 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:42.386341 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-57b1555a-39b5-4ab3-8096-fdf304dd0539 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:42.386764 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-57b1555a-39b5-4ab3-8096-fdf304dd0539 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:42.391618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-adc3058c-b6aa-4c73-9031-5e212fdf99ad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:42.391618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-adc3058c-b6aa-4c73-9031-5e212fdf99ad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:42.397013 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-adc3058c-b6aa-4c73-9031-5e212fdf99ad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:42.397456 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-adc3058c-b6aa-4c73-9031-5e212fdf99ad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:42.398218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-adc3058c-b6aa-4c73-9031-5e212fdf99ad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:42.398652 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-adc3058c-b6aa-4c73-9031-5e212fdf99ad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:42.519691 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-57b1555a-39b5-4ab3-8096-fdf304dd0539 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:42.527290 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-57b1555a-39b5-4ab3-8096-fdf304dd0539 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 0.153368 Apr 05 11:51:42.528047 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 65/126] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:42 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:51:42.534432 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-adc3058c-b6aa-4c73-9031-5e212fdf99ad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:42.541732 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-adc3058c-b6aa-4c73-9031-5e212fdf99ad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.155276 Apr 05 11:51:42.542303 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 62/127] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:42 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:51:42.615402 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-45d4c47d-bb8f-4741-aa49-391041f57ad0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:42.616004 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-45d4c47d-bb8f-4741-aa49-391041f57ad0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:42.622296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-45d4c47d-bb8f-4741-aa49-391041f57ad0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:42.622744 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-45d4c47d-bb8f-4741-aa49-391041f57ad0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:42.623507 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-45d4c47d-bb8f-4741-aa49-391041f57ad0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:42.623929 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-45d4c47d-bb8f-4741-aa49-391041f57ad0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:42.678158 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-6e209278-86c2-4710-84d8-0614c6b8bfd2 req-7d3cb2a4-f042-401b-a1ef-3ac241939625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "590c9148-99a5-4120-8b46-235860f6eca2", "name": "network-vif-plugged", "status": "completed", "tag": "55b22dff-98f7-484a-a01e-41c558cf7a2f"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:51:42.686632 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-6e209278-86c2-4710-84d8-0614c6b8bfd2 req-7d3cb2a4-f042-401b-a1ef-3ac241939625 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:42.687311 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-6e209278-86c2-4710-84d8-0614c6b8bfd2 req-7d3cb2a4-f042-401b-a1ef-3ac241939625 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:42.715217 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-6e209278-86c2-4710-84d8-0614c6b8bfd2 req-7d3cb2a4-f042-401b-a1ef-3ac241939625 service nova] Creating event network-vif-plugged:55b22dff-98f7-484a-a01e-41c558cf7a2f for instance 590c9148-99a5-4120-8b46-235860f6eca2 on hv-cinder-82956 Apr 05 11:51:42.720608 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-6e209278-86c2-4710-84d8-0614c6b8bfd2 req-7d3cb2a4-f042-401b-a1ef-3ac241939625 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046205 Apr 05 11:51:42.721256 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 63/128] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:51:42.810453 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-45d4c47d-bb8f-4741-aa49-391041f57ad0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:42.817871 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-45d4c47d-bb8f-4741-aa49-391041f57ad0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.206505 Apr 05 11:51:42.818476 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 66/129] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:42 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:43.290329 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3cdf3188-b2a0-40b5-8a37-737ff473f74d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:43.291823 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3cdf3188-b2a0-40b5-8a37-737ff473f74d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:43.298505 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3cdf3188-b2a0-40b5-8a37-737ff473f74d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:43.299310 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3cdf3188-b2a0-40b5-8a37-737ff473f74d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:43.300312 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3cdf3188-b2a0-40b5-8a37-737ff473f74d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:43.300809 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3cdf3188-b2a0-40b5-8a37-737ff473f74d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:43.354793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b053003d-0220-4c26-8a7d-5c2631bc97ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:43.355393 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b053003d-0220-4c26-8a7d-5c2631bc97ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:43.361573 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b053003d-0220-4c26-8a7d-5c2631bc97ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:43.362010 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b053003d-0220-4c26-8a7d-5c2631bc97ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:43.362771 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b053003d-0220-4c26-8a7d-5c2631bc97ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:43.363285 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b053003d-0220-4c26-8a7d-5c2631bc97ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:43.511600 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b053003d-0220-4c26-8a7d-5c2631bc97ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:43.520402 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b053003d-0220-4c26-8a7d-5c2631bc97ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:43.522139 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b053003d-0220-4c26-8a7d-5c2631bc97ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:43.525342 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3cdf3188-b2a0-40b5-8a37-737ff473f74d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:43.527658 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b053003d-0220-4c26-8a7d-5c2631bc97ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.176664 Apr 05 11:51:43.528685 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 67/130] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:43 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:51:43.533526 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-24f282bd-d2fd-46bf-aace-5a90f647b5e2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:43.534350 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-24f282bd-d2fd-46bf-aace-5a90f647b5e2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:43.538557 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3cdf3188-b2a0-40b5-8a37-737ff473f74d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1322 microversion: 2.1 time: 0.252684 Apr 05 11:51:43.540063 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 64/131] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:43 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:43.540842 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24f282bd-d2fd-46bf-aace-5a90f647b5e2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:43.541403 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24f282bd-d2fd-46bf-aace-5a90f647b5e2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:43.542381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24f282bd-d2fd-46bf-aace-5a90f647b5e2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:43.542922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24f282bd-d2fd-46bf-aace-5a90f647b5e2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:43.545653 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-afb8d1cf-6cc6-4ea1-9a55-2965f72133cf req-ccc1655d-cc41-46ac-a17d-e04f1e83119b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c48b77eb-b654-43e4-9551-735bac89d0de", "tag": "e6dd88bf-e528-41ea-ac09-941f2df0ad3c"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:51:43.554102 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-afb8d1cf-6cc6-4ea1-9a55-2965f72133cf req-ccc1655d-cc41-46ac-a17d-e04f1e83119b service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:43.554638 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-afb8d1cf-6cc6-4ea1-9a55-2965f72133cf req-ccc1655d-cc41-46ac-a17d-e04f1e83119b service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:43.566755 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-afb8d1cf-6cc6-4ea1-9a55-2965f72133cf req-ccc1655d-cc41-46ac-a17d-e04f1e83119b service nova] Creating event network-changed:e6dd88bf-e528-41ea-ac09-941f2df0ad3c for instance c48b77eb-b654-43e4-9551-735bac89d0de on hv-cinder-82956 Apr 05 11:51:43.571852 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-afb8d1cf-6cc6-4ea1-9a55-2965f72133cf req-ccc1655d-cc41-46ac-a17d-e04f1e83119b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030076 Apr 05 11:51:43.573038 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 65/132] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:51:43.578526 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9472155b-cdc5-4c90-91d5-933d7e7936ea tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:43.579221 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9472155b-cdc5-4c90-91d5-933d7e7936ea tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:43.585971 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9472155b-cdc5-4c90-91d5-933d7e7936ea tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:43.586419 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9472155b-cdc5-4c90-91d5-933d7e7936ea tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:43.587192 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9472155b-cdc5-4c90-91d5-933d7e7936ea tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:43.587623 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9472155b-cdc5-4c90-91d5-933d7e7936ea tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:43.611466 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-24f282bd-d2fd-46bf-aace-5a90f647b5e2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:43.618748 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-24f282bd-d2fd-46bf-aace-5a90f647b5e2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1216 microversion: 2.1 time: 0.089022 Apr 05 11:51:43.619337 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 68/133] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:43 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1216 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:43.624680 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a53f1faa-c9fe-4294-9663-3c41ea22a3e7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:43.625633 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a53f1faa-c9fe-4294-9663-3c41ea22a3e7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:43.634503 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a53f1faa-c9fe-4294-9663-3c41ea22a3e7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:43.634832 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a53f1faa-c9fe-4294-9663-3c41ea22a3e7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:43.635594 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a53f1faa-c9fe-4294-9663-3c41ea22a3e7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:43.636017 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a53f1faa-c9fe-4294-9663-3c41ea22a3e7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:43.758595 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9472155b-cdc5-4c90-91d5-933d7e7936ea tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:43.765881 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9472155b-cdc5-4c90-91d5-933d7e7936ea tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 0.191664 Apr 05 11:51:43.766509 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 66/134] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:43 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:43.799115 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a53f1faa-c9fe-4294-9663-3c41ea22a3e7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:43.809446 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a53f1faa-c9fe-4294-9663-3c41ea22a3e7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.189128 Apr 05 11:51:43.810036 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 69/135] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:43 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:43.834742 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-95b2db7d-0506-4d58-be58-947017dc6231 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:43.835345 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-95b2db7d-0506-4d58-be58-947017dc6231 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:43.841154 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-95b2db7d-0506-4d58-be58-947017dc6231 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:43.841592 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-95b2db7d-0506-4d58-be58-947017dc6231 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:43.842339 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-95b2db7d-0506-4d58-be58-947017dc6231 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:43.842764 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-95b2db7d-0506-4d58-be58-947017dc6231 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:43.983350 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-95b2db7d-0506-4d58-be58-947017dc6231 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:43.991285 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-95b2db7d-0506-4d58-be58-947017dc6231 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.160346 Apr 05 11:51:43.991857 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 67/136] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:43 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:44.550878 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e1a613e7-0edb-4014-887f-97fe7186a9db tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:44.551975 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e1a613e7-0edb-4014-887f-97fe7186a9db tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:44.559963 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e41cccf6-e030-4845-a838-9cb6117eb6ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:44.561007 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e41cccf6-e030-4845-a838-9cb6117eb6ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:44.562178 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e1a613e7-0edb-4014-887f-97fe7186a9db tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:44.562994 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e1a613e7-0edb-4014-887f-97fe7186a9db tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:44.564341 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e1a613e7-0edb-4014-887f-97fe7186a9db tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:44.565055 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e1a613e7-0edb-4014-887f-97fe7186a9db tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:44.569262 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e41cccf6-e030-4845-a838-9cb6117eb6ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:44.569709 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e41cccf6-e030-4845-a838-9cb6117eb6ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:44.570465 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e41cccf6-e030-4845-a838-9cb6117eb6ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:44.570890 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e41cccf6-e030-4845-a838-9cb6117eb6ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:44.695516 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e1a613e7-0edb-4014-887f-97fe7186a9db tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:44.703384 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e1a613e7-0edb-4014-887f-97fe7186a9db tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:44.704922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e1a613e7-0edb-4014-887f-97fe7186a9db tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:44.706043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e1a613e7-0edb-4014-887f-97fe7186a9db tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.161904 Apr 05 11:51:44.706684 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 70/137] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:44 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:44.707616 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e41cccf6-e030-4845-a838-9cb6117eb6ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:44.711247 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4bd0836e-a38c-4716-baa8-559d594dcb6f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:44.711731 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4bd0836e-a38c-4716-baa8-559d594dcb6f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:44.715634 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e41cccf6-e030-4845-a838-9cb6117eb6ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1322 microversion: 2.1 time: 0.161844 Apr 05 11:51:44.716482 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 68/138] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:44 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:44.718291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4bd0836e-a38c-4716-baa8-559d594dcb6f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:44.718729 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4bd0836e-a38c-4716-baa8-559d594dcb6f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:44.719485 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4bd0836e-a38c-4716-baa8-559d594dcb6f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:44.719935 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4bd0836e-a38c-4716-baa8-559d594dcb6f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:44.779859 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4bd0836e-a38c-4716-baa8-559d594dcb6f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:44.782710 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-171e2ed6-f011-48f7-9868-9e936f722511 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:44.783350 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-171e2ed6-f011-48f7-9868-9e936f722511 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:44.787214 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4bd0836e-a38c-4716-baa8-559d594dcb6f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1216 microversion: 2.1 time: 0.079581 Apr 05 11:51:44.787835 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 71/139] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:44 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1216 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:44.789566 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-171e2ed6-f011-48f7-9868-9e936f722511 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:44.790025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-171e2ed6-f011-48f7-9868-9e936f722511 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:44.790920 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-171e2ed6-f011-48f7-9868-9e936f722511 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:44.791359 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-171e2ed6-f011-48f7-9868-9e936f722511 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:44.826075 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-995893f2-a62f-4832-b0b6-45adfb675e65 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:44.826677 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-995893f2-a62f-4832-b0b6-45adfb675e65 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:44.832892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-995893f2-a62f-4832-b0b6-45adfb675e65 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:44.833363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-995893f2-a62f-4832-b0b6-45adfb675e65 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:44.834117 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-995893f2-a62f-4832-b0b6-45adfb675e65 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:44.834537 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-995893f2-a62f-4832-b0b6-45adfb675e65 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:44.925067 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-171e2ed6-f011-48f7-9868-9e936f722511 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:44.932877 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-171e2ed6-f011-48f7-9868-9e936f722511 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 0.154033 Apr 05 11:51:44.933495 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 69/140] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:44 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:44.968315 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-995893f2-a62f-4832-b0b6-45adfb675e65 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:44.976126 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-995893f2-a62f-4832-b0b6-45adfb675e65 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.153487 Apr 05 11:51:44.976697 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 72/141] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:44 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:51:45.008470 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9cd5bfda-3403-40b7-ae46-35ab89e52a5f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:45.009083 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9cd5bfda-3403-40b7-ae46-35ab89e52a5f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:45.015154 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9cd5bfda-3403-40b7-ae46-35ab89e52a5f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:45.015621 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9cd5bfda-3403-40b7-ae46-35ab89e52a5f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:45.016396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9cd5bfda-3403-40b7-ae46-35ab89e52a5f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:45.016828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9cd5bfda-3403-40b7-ae46-35ab89e52a5f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:45.160845 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9cd5bfda-3403-40b7-ae46-35ab89e52a5f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:45.168817 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9cd5bfda-3403-40b7-ae46-35ab89e52a5f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.164318 Apr 05 11:51:45.169391 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 70/142] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:45 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:45.727543 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b84a9066-212d-4379-8be3-2ee7b3644b0c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:45.728799 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b84a9066-212d-4379-8be3-2ee7b3644b0c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:45.736868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9773f617-ca95-4621-9023-3e293c65c0ac tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:45.737996 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9773f617-ca95-4621-9023-3e293c65c0ac tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:45.739002 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b84a9066-212d-4379-8be3-2ee7b3644b0c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:45.739453 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b84a9066-212d-4379-8be3-2ee7b3644b0c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:45.740249 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b84a9066-212d-4379-8be3-2ee7b3644b0c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:45.740674 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b84a9066-212d-4379-8be3-2ee7b3644b0c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:45.744323 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9773f617-ca95-4621-9023-3e293c65c0ac tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:45.744766 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9773f617-ca95-4621-9023-3e293c65c0ac tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:45.745515 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9773f617-ca95-4621-9023-3e293c65c0ac tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:45.745939 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9773f617-ca95-4621-9023-3e293c65c0ac tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:45.894655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b84a9066-212d-4379-8be3-2ee7b3644b0c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:45.902468 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b84a9066-212d-4379-8be3-2ee7b3644b0c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:45.904000 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b84a9066-212d-4379-8be3-2ee7b3644b0c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:45.905130 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b84a9066-212d-4379-8be3-2ee7b3644b0c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.184152 Apr 05 11:51:45.905697 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 73/143] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:45 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:45.909112 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9773f617-ca95-4621-9023-3e293c65c0ac tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:45.910536 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-aed6fdb1-0551-4307-8d02-38eab286e27d tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:45.911134 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-aed6fdb1-0551-4307-8d02-38eab286e27d tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:45.916935 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aed6fdb1-0551-4307-8d02-38eab286e27d tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:45.917172 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9773f617-ca95-4621-9023-3e293c65c0ac tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1322 microversion: 2.1 time: 0.186843 Apr 05 11:51:45.917370 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aed6fdb1-0551-4307-8d02-38eab286e27d tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:45.917844 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 71/144] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:45 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:45.918314 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aed6fdb1-0551-4307-8d02-38eab286e27d tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:45.918743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aed6fdb1-0551-4307-8d02-38eab286e27d tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:45.949686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fde092a2-6184-4232-aec9-92927c1b6bbc tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:45.950288 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fde092a2-6184-4232-aec9-92927c1b6bbc tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:45.956206 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fde092a2-6184-4232-aec9-92927c1b6bbc tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:45.956683 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fde092a2-6184-4232-aec9-92927c1b6bbc tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:45.957436 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fde092a2-6184-4232-aec9-92927c1b6bbc tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:45.957856 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fde092a2-6184-4232-aec9-92927c1b6bbc tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:45.979614 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-aed6fdb1-0551-4307-8d02-38eab286e27d tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:45.987484 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-aed6fdb1-0551-4307-8d02-38eab286e27d tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1208 microversion: 2.1 time: 0.080665 Apr 05 11:51:45.996156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 74/145] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:45 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1208 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:46.002350 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-257d0ce9-cfc2-443c-a66a-c767f35d3ad2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:46.002953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-257d0ce9-cfc2-443c-a66a-c767f35d3ad2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:46.009243 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-257d0ce9-cfc2-443c-a66a-c767f35d3ad2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:46.009607 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-257d0ce9-cfc2-443c-a66a-c767f35d3ad2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:46.010359 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-257d0ce9-cfc2-443c-a66a-c767f35d3ad2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:46.010785 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-257d0ce9-cfc2-443c-a66a-c767f35d3ad2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:46.102884 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fde092a2-6184-4232-aec9-92927c1b6bbc tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:46.111016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fde092a2-6184-4232-aec9-92927c1b6bbc tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 0.165079 Apr 05 11:51:46.111675 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 72/146] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:45 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:51:46.147185 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-257d0ce9-cfc2-443c-a66a-c767f35d3ad2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:46.154989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-257d0ce9-cfc2-443c-a66a-c767f35d3ad2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.157775 Apr 05 11:51:46.155605 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 75/147] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:45 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:46.185267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-974174a4-00ff-4cbc-a548-f20abcee195a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:46.185914 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-974174a4-00ff-4cbc-a548-f20abcee195a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:46.192100 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-974174a4-00ff-4cbc-a548-f20abcee195a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:46.192555 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-974174a4-00ff-4cbc-a548-f20abcee195a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:46.193302 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-974174a4-00ff-4cbc-a548-f20abcee195a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:46.193725 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-974174a4-00ff-4cbc-a548-f20abcee195a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:46.448263 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-974174a4-00ff-4cbc-a548-f20abcee195a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:46.456499 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-974174a4-00ff-4cbc-a548-f20abcee195a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.274941 Apr 05 11:51:46.457163 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 73/148] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:46 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:46.922728 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-84fbee61-8c37-4639-a3eb-f9800be2ba1b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:46.923631 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-84fbee61-8c37-4639-a3eb-f9800be2ba1b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:46.929692 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84fbee61-8c37-4639-a3eb-f9800be2ba1b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:46.930363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84fbee61-8c37-4639-a3eb-f9800be2ba1b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:46.931119 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84fbee61-8c37-4639-a3eb-f9800be2ba1b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:46.931552 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84fbee61-8c37-4639-a3eb-f9800be2ba1b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:46.933926 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-66598bd7-4f3f-48de-883f-1957cbbff79b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:46.935048 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-66598bd7-4f3f-48de-883f-1957cbbff79b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:46.940921 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66598bd7-4f3f-48de-883f-1957cbbff79b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:46.941367 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66598bd7-4f3f-48de-883f-1957cbbff79b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:46.942302 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66598bd7-4f3f-48de-883f-1957cbbff79b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:46.942729 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66598bd7-4f3f-48de-883f-1957cbbff79b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:47.090062 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-84fbee61-8c37-4639-a3eb-f9800be2ba1b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:47.099693 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-84fbee61-8c37-4639-a3eb-f9800be2ba1b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:47.101170 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-84fbee61-8c37-4639-a3eb-f9800be2ba1b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:47.102305 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-84fbee61-8c37-4639-a3eb-f9800be2ba1b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.183375 Apr 05 11:51:47.115571 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-66598bd7-4f3f-48de-883f-1957cbbff79b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:47.116171 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 76/149] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:46 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:47.126111 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-66598bd7-4f3f-48de-883f-1957cbbff79b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1322 microversion: 2.1 time: 0.195778 Apr 05 11:51:47.126649 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-97980110-a178-4bb3-a2d9-0f7a6f1dd763 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:47.127310 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-97980110-a178-4bb3-a2d9-0f7a6f1dd763 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:47.134484 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-97980110-a178-4bb3-a2d9-0f7a6f1dd763 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:47.134949 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-97980110-a178-4bb3-a2d9-0f7a6f1dd763 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:47.135713 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-97980110-a178-4bb3-a2d9-0f7a6f1dd763 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:47.136171 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-97980110-a178-4bb3-a2d9-0f7a6f1dd763 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:47.137678 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 74/150] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:46 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:47.145793 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2b05fc03-7217-494f-93ac-88fdbefb26d3 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:47.146334 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2b05fc03-7217-494f-93ac-88fdbefb26d3 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:47.152438 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2b05fc03-7217-494f-93ac-88fdbefb26d3 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:47.152879 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2b05fc03-7217-494f-93ac-88fdbefb26d3 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:47.153721 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2b05fc03-7217-494f-93ac-88fdbefb26d3 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:47.154149 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2b05fc03-7217-494f-93ac-88fdbefb26d3 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:47.213664 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-97980110-a178-4bb3-a2d9-0f7a6f1dd763 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:47.222717 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-97980110-a178-4bb3-a2d9-0f7a6f1dd763 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1264 microversion: 2.1 time: 0.105152 Apr 05 11:51:47.224227 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 77/151] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:47 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1264 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:47.229404 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1a5c9c6c-ae20-43de-a110-23fec9fe5d85 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:47.230156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1a5c9c6c-ae20-43de-a110-23fec9fe5d85 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:47.237439 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a5c9c6c-ae20-43de-a110-23fec9fe5d85 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:47.238392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a5c9c6c-ae20-43de-a110-23fec9fe5d85 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:47.239622 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a5c9c6c-ae20-43de-a110-23fec9fe5d85 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:47.240268 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a5c9c6c-ae20-43de-a110-23fec9fe5d85 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:47.602257 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1a5c9c6c-ae20-43de-a110-23fec9fe5d85 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:47.610229 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1a5c9c6c-ae20-43de-a110-23fec9fe5d85 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.384592 Apr 05 11:51:47.611196 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 78/152] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:47 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:47.615655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-73789019-f032-41e0-b77e-560e7082af65 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:47.616305 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-73789019-f032-41e0-b77e-560e7082af65 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:47.622736 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-73789019-f032-41e0-b77e-560e7082af65 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:47.622736 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-73789019-f032-41e0-b77e-560e7082af65 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:47.623461 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-73789019-f032-41e0-b77e-560e7082af65 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:47.623902 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-73789019-f032-41e0-b77e-560e7082af65 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:47.674675 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2b05fc03-7217-494f-93ac-88fdbefb26d3 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:47.683878 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2b05fc03-7217-494f-93ac-88fdbefb26d3 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1315 microversion: 2.1 time: 0.543391 Apr 05 11:51:47.684521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 75/153] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:47 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:47.761201 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-73789019-f032-41e0-b77e-560e7082af65 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:47.769125 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-73789019-f032-41e0-b77e-560e7082af65 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.156989 Apr 05 11:51:47.769832 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 79/154] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:47 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:48.126656 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-be50e8ec-3def-49f2-b136-7b1e9adb7d54 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:48.127223 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-be50e8ec-3def-49f2-b136-7b1e9adb7d54 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:48.133327 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-be50e8ec-3def-49f2-b136-7b1e9adb7d54 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:48.133773 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-be50e8ec-3def-49f2-b136-7b1e9adb7d54 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:48.134555 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-be50e8ec-3def-49f2-b136-7b1e9adb7d54 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:48.134976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-be50e8ec-3def-49f2-b136-7b1e9adb7d54 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:48.142874 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-359c7e7f-7502-4bdc-ac86-207e4307a574 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:48.143482 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-359c7e7f-7502-4bdc-ac86-207e4307a574 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:48.149460 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-359c7e7f-7502-4bdc-ac86-207e4307a574 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:48.149901 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-359c7e7f-7502-4bdc-ac86-207e4307a574 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:48.150667 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-359c7e7f-7502-4bdc-ac86-207e4307a574 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:48.151092 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-359c7e7f-7502-4bdc-ac86-207e4307a574 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:48.281685 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-be50e8ec-3def-49f2-b136-7b1e9adb7d54 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:48.289978 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-be50e8ec-3def-49f2-b136-7b1e9adb7d54 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:48.293418 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-be50e8ec-3def-49f2-b136-7b1e9adb7d54 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:48.294739 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-be50e8ec-3def-49f2-b136-7b1e9adb7d54 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.172091 Apr 05 11:51:48.295492 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 76/155] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:48 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:48.300764 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a759e1f8-438f-48b3-b9b8-8748519336c2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:48.301463 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a759e1f8-438f-48b3-b9b8-8748519336c2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:48.307667 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a759e1f8-438f-48b3-b9b8-8748519336c2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:48.308141 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a759e1f8-438f-48b3-b9b8-8748519336c2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:48.311540 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-359c7e7f-7502-4bdc-ac86-207e4307a574 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:48.313163 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a759e1f8-438f-48b3-b9b8-8748519336c2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:48.313605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a759e1f8-438f-48b3-b9b8-8748519336c2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:48.328622 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-359c7e7f-7502-4bdc-ac86-207e4307a574 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1516 microversion: 2.1 time: 0.189404 Apr 05 11:51:48.329211 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 80/156] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:48 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1516 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:48.356273 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d0a94e5d-9ad8-41e0-951e-415fdf13f404 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:51:48.357332 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d0a94e5d-9ad8-41e0-951e-415fdf13f404 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:48.363751 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d0a94e5d-9ad8-41e0-951e-415fdf13f404 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:48.364238 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d0a94e5d-9ad8-41e0-951e-415fdf13f404 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:48.365017 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d0a94e5d-9ad8-41e0-951e-415fdf13f404 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:48.365431 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d0a94e5d-9ad8-41e0-951e-415fdf13f404 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:48.381508 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a759e1f8-438f-48b3-b9b8-8748519336c2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:48.388721 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a759e1f8-438f-48b3-b9b8-8748519336c2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1272 microversion: 2.1 time: 0.091525 Apr 05 11:51:48.389763 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 77/157] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:48 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1272 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:48.434757 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.objects.instance [None req-d0a94e5d-9ad8-41e0-951e-415fdf13f404 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lazy-loading 'flavor' on Instance uuid 159c0fda-d790-488a-bbdc-a3b9ee6174d1 {{(pid=123358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:51:48.561193 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d0a94e5d-9ad8-41e0-951e-415fdf13f404 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "POST /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1/action" status: 200 len: 32 microversion: 2.1 time: 0.208795 Apr 05 11:51:48.566137 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 81/158] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Apr 5 11:51:48 2022] POST /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1/action => generated 32 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 11:51:48.571125 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ce6e9cf2-4e31-445a-a282-38443e426e68 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:48.571832 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ce6e9cf2-4e31-445a-a282-38443e426e68 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:48.581139 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ce6e9cf2-4e31-445a-a282-38443e426e68 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:48.581776 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ce6e9cf2-4e31-445a-a282-38443e426e68 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:48.582654 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ce6e9cf2-4e31-445a-a282-38443e426e68 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:48.583154 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ce6e9cf2-4e31-445a-a282-38443e426e68 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:48.627044 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2077385c-ec0d-4563-a90e-bf63957c33ad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:48.627724 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2077385c-ec0d-4563-a90e-bf63957c33ad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:48.633870 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2077385c-ec0d-4563-a90e-bf63957c33ad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:48.634309 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2077385c-ec0d-4563-a90e-bf63957c33ad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:48.635081 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2077385c-ec0d-4563-a90e-bf63957c33ad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:48.635512 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2077385c-ec0d-4563-a90e-bf63957c33ad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:48.728692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ce6e9cf2-4e31-445a-a282-38443e426e68 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:48.737028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ce6e9cf2-4e31-445a-a282-38443e426e68 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.169657 Apr 05 11:51:48.737684 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 78/159] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:48 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:48.742578 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fd932007-504a-420f-bb46-f7fdacf0011b tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:48.743233 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fd932007-504a-420f-bb46-f7fdacf0011b tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:48.749130 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd932007-504a-420f-bb46-f7fdacf0011b tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:48.749645 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd932007-504a-420f-bb46-f7fdacf0011b tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:48.750468 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd932007-504a-420f-bb46-f7fdacf0011b tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:48.750980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd932007-504a-420f-bb46-f7fdacf0011b tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:48.803407 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2077385c-ec0d-4563-a90e-bf63957c33ad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:48.811447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2077385c-ec0d-4563-a90e-bf63957c33ad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.188554 Apr 05 11:51:48.812128 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 82/160] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:48 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:48.823396 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c465b191-2779-486c-a732-f365ab5e8b35 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:48.824062 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c465b191-2779-486c-a732-f365ab5e8b35 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:48.830003 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c465b191-2779-486c-a732-f365ab5e8b35 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:48.830554 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c465b191-2779-486c-a732-f365ab5e8b35 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:48.831404 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c465b191-2779-486c-a732-f365ab5e8b35 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:48.831929 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c465b191-2779-486c-a732-f365ab5e8b35 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:48.900502 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fd932007-504a-420f-bb46-f7fdacf0011b tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:48.909733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fd932007-504a-420f-bb46-f7fdacf0011b tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1501 microversion: 2.1 time: 0.170891 Apr 05 11:51:48.922068 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 79/161] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:48 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1501 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:48.977970 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c465b191-2779-486c-a732-f365ab5e8b35 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:48.986129 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c465b191-2779-486c-a732-f365ab5e8b35 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.167081 Apr 05 11:51:48.986756 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 83/162] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:48 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:49.313082 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-22d271c2-a869-4d84-a07e-a0c5666aca65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:49.313697 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-22d271c2-a869-4d84-a07e-a0c5666aca65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:49.319878 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-22d271c2-a869-4d84-a07e-a0c5666aca65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:49.320376 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-22d271c2-a869-4d84-a07e-a0c5666aca65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:49.321143 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-22d271c2-a869-4d84-a07e-a0c5666aca65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:49.321580 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-22d271c2-a869-4d84-a07e-a0c5666aca65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:49.406760 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-030384ec-64d3-4742-a790-56a651b8432c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:49.407480 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-030384ec-64d3-4742-a790-56a651b8432c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:49.413541 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-030384ec-64d3-4742-a790-56a651b8432c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:49.414211 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-030384ec-64d3-4742-a790-56a651b8432c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:49.414980 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-030384ec-64d3-4742-a790-56a651b8432c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:49.415394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-030384ec-64d3-4742-a790-56a651b8432c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:49.491364 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-030384ec-64d3-4742-a790-56a651b8432c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:49.501417 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-030384ec-64d3-4742-a790-56a651b8432c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1272 microversion: 2.1 time: 0.098106 Apr 05 11:51:49.502541 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 84/163] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:49 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1272 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:49.514477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-22d271c2-a869-4d84-a07e-a0c5666aca65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:49.522185 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-22d271c2-a869-4d84-a07e-a0c5666aca65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:49.523672 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-22d271c2-a869-4d84-a07e-a0c5666aca65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:49.524811 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-22d271c2-a869-4d84-a07e-a0c5666aca65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.216503 Apr 05 11:51:49.525372 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 80/164] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:49 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:49.755153 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-652a0bff-fe15-4c8b-96e0-cd60746825ac tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:49.755839 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-652a0bff-fe15-4c8b-96e0-cd60746825ac tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:49.762122 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-652a0bff-fe15-4c8b-96e0-cd60746825ac tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:49.762559 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-652a0bff-fe15-4c8b-96e0-cd60746825ac tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:49.763338 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-652a0bff-fe15-4c8b-96e0-cd60746825ac tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:49.763763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-652a0bff-fe15-4c8b-96e0-cd60746825ac tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:49.828411 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-414f6371-a981-4057-9985-bcd2ea5e0f5e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:49.829101 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-414f6371-a981-4057-9985-bcd2ea5e0f5e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:49.835359 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-414f6371-a981-4057-9985-bcd2ea5e0f5e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:49.835824 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-414f6371-a981-4057-9985-bcd2ea5e0f5e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:49.836682 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-414f6371-a981-4057-9985-bcd2ea5e0f5e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:49.837134 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-414f6371-a981-4057-9985-bcd2ea5e0f5e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:49.983611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-414f6371-a981-4057-9985-bcd2ea5e0f5e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:49.991142 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-414f6371-a981-4057-9985-bcd2ea5e0f5e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.166733 Apr 05 11:51:49.991764 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 81/165] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:49 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:49.997889 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-652a0bff-fe15-4c8b-96e0-cd60746825ac tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:50.003955 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1ccb9429-5f2c-49b0-9f32-56512526f5fa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:50.004610 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1ccb9429-5f2c-49b0-9f32-56512526f5fa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:50.006495 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-652a0bff-fe15-4c8b-96e0-cd60746825ac tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.255089 Apr 05 11:51:50.007232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 85/166] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:49 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:50.019651 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ccb9429-5f2c-49b0-9f32-56512526f5fa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:50.020110 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ccb9429-5f2c-49b0-9f32-56512526f5fa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:50.020875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ccb9429-5f2c-49b0-9f32-56512526f5fa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:50.021304 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ccb9429-5f2c-49b0-9f32-56512526f5fa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:50.156006 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1ccb9429-5f2c-49b0-9f32-56512526f5fa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:50.163309 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1ccb9429-5f2c-49b0-9f32-56512526f5fa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.164430 Apr 05 11:51:50.163878 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 82/167] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:49 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:50.518716 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fb98d02b-3f6d-4418-bf6c-01bc808b5aaf tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:50.519316 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fb98d02b-3f6d-4418-bf6c-01bc808b5aaf tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:50.525585 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fb98d02b-3f6d-4418-bf6c-01bc808b5aaf tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:50.526031 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fb98d02b-3f6d-4418-bf6c-01bc808b5aaf tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:50.526875 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fb98d02b-3f6d-4418-bf6c-01bc808b5aaf tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:50.527302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fb98d02b-3f6d-4418-bf6c-01bc808b5aaf tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:50.542920 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1690128c-59b2-4821-b092-47980a7d77cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:50.543588 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1690128c-59b2-4821-b092-47980a7d77cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:50.549503 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1690128c-59b2-4821-b092-47980a7d77cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:50.550004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1690128c-59b2-4821-b092-47980a7d77cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:50.550775 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1690128c-59b2-4821-b092-47980a7d77cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:50.551200 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1690128c-59b2-4821-b092-47980a7d77cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:50.597603 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fb98d02b-3f6d-4418-bf6c-01bc808b5aaf tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:50.606325 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fb98d02b-3f6d-4418-bf6c-01bc808b5aaf tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1272 microversion: 2.1 time: 0.091498 Apr 05 11:51:50.609247 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 86/168] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:50 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1272 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:50.695090 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1690128c-59b2-4821-b092-47980a7d77cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:50.703814 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1690128c-59b2-4821-b092-47980a7d77cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:50.705604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1690128c-59b2-4821-b092-47980a7d77cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:50.706709 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1690128c-59b2-4821-b092-47980a7d77cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.167733 Apr 05 11:51:50.707248 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 83/169] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:50 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:51:51.010773 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b1456d75-7a8b-4b29-974c-1dff212e8491 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:51.011456 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b1456d75-7a8b-4b29-974c-1dff212e8491 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:51.022864 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-79e2273c-291e-4515-9c18-fce613fef68d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:51.023464 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-79e2273c-291e-4515-9c18-fce613fef68d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:51.026785 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b1456d75-7a8b-4b29-974c-1dff212e8491 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:51.027223 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b1456d75-7a8b-4b29-974c-1dff212e8491 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:51.027986 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b1456d75-7a8b-4b29-974c-1dff212e8491 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:51.028486 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b1456d75-7a8b-4b29-974c-1dff212e8491 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:51.029660 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79e2273c-291e-4515-9c18-fce613fef68d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:51.030104 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79e2273c-291e-4515-9c18-fce613fef68d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:51.030946 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79e2273c-291e-4515-9c18-fce613fef68d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:51.031530 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79e2273c-291e-4515-9c18-fce613fef68d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:51.171099 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-79e2273c-291e-4515-9c18-fce613fef68d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:51.172701 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b1456d75-7a8b-4b29-974c-1dff212e8491 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:51.178592 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-79e2273c-291e-4515-9c18-fce613fef68d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.159653 Apr 05 11:51:51.179163 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 84/170] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:51 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:51.180444 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b1456d75-7a8b-4b29-974c-1dff212e8491 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.173732 Apr 05 11:51:51.181002 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 87/171] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:51 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:51.187849 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-31c0cd12-d3e4-47a7-9002-485b0749eff9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:51.188703 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-31c0cd12-d3e4-47a7-9002-485b0749eff9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:51.194853 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-31c0cd12-d3e4-47a7-9002-485b0749eff9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:51.195304 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-31c0cd12-d3e4-47a7-9002-485b0749eff9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:51.196109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-31c0cd12-d3e4-47a7-9002-485b0749eff9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:51.196555 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-31c0cd12-d3e4-47a7-9002-485b0749eff9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:51.341060 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-31c0cd12-d3e4-47a7-9002-485b0749eff9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:51.348300 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-31c0cd12-d3e4-47a7-9002-485b0749eff9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.167926 Apr 05 11:51:51.348841 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 85/172] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:51 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:51.625636 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1a10047f-ac51-4b51-96d3-7489d59f1c0f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:51.626308 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1a10047f-ac51-4b51-96d3-7489d59f1c0f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:51.632429 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a10047f-ac51-4b51-96d3-7489d59f1c0f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:51.632943 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a10047f-ac51-4b51-96d3-7489d59f1c0f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:51.633906 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a10047f-ac51-4b51-96d3-7489d59f1c0f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:51.634230 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a10047f-ac51-4b51-96d3-7489d59f1c0f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:51.693304 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1a10047f-ac51-4b51-96d3-7489d59f1c0f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:51.700802 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1a10047f-ac51-4b51-96d3-7489d59f1c0f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1272 microversion: 2.1 time: 0.078983 Apr 05 11:51:51.701358 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 88/173] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:51 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1272 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:51.725644 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cbb05030-a99c-410e-bd9e-c5701e4d3808 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:51.726248 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cbb05030-a99c-410e-bd9e-c5701e4d3808 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:51.733599 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cbb05030-a99c-410e-bd9e-c5701e4d3808 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:51.734296 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cbb05030-a99c-410e-bd9e-c5701e4d3808 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:51.737077 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cbb05030-a99c-410e-bd9e-c5701e4d3808 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:51.737704 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cbb05030-a99c-410e-bd9e-c5701e4d3808 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:51.869176 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-cbb05030-a99c-410e-bd9e-c5701e4d3808 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:51.877349 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-cbb05030-a99c-410e-bd9e-c5701e4d3808 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:51.878861 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-cbb05030-a99c-410e-bd9e-c5701e4d3808 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:51.879951 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cbb05030-a99c-410e-bd9e-c5701e4d3808 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.158323 Apr 05 11:51:51.880591 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 86/174] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:51 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:52.197404 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a8546881-2301-43c1-b146-7e26abf7a2b2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:52.198012 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a8546881-2301-43c1-b146-7e26abf7a2b2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:52.198455 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7f6ad624-e34f-471f-ba0c-3caa8362308a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:52.199065 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7f6ad624-e34f-471f-ba0c-3caa8362308a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:52.204373 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a8546881-2301-43c1-b146-7e26abf7a2b2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:52.204817 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a8546881-2301-43c1-b146-7e26abf7a2b2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:52.205477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f6ad624-e34f-471f-ba0c-3caa8362308a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:52.205626 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a8546881-2301-43c1-b146-7e26abf7a2b2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:52.205898 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f6ad624-e34f-471f-ba0c-3caa8362308a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:52.206008 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a8546881-2301-43c1-b146-7e26abf7a2b2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:52.206691 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f6ad624-e34f-471f-ba0c-3caa8362308a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:52.207118 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f6ad624-e34f-471f-ba0c-3caa8362308a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:52.341818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a8546881-2301-43c1-b146-7e26abf7a2b2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:52.348220 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7f6ad624-e34f-471f-ba0c-3caa8362308a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:52.349411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a8546881-2301-43c1-b146-7e26abf7a2b2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.156216 Apr 05 11:51:52.359147 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 89/175] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:52 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:52.359297 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7f6ad624-e34f-471f-ba0c-3caa8362308a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.161467 Apr 05 11:51:52.359297 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 87/176] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:52 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:52.365349 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6abdb8f0-77df-41af-9591-3ad437593f26 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:52.366055 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6abdb8f0-77df-41af-9591-3ad437593f26 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:52.372007 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6abdb8f0-77df-41af-9591-3ad437593f26 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:52.372484 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6abdb8f0-77df-41af-9591-3ad437593f26 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:52.373239 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6abdb8f0-77df-41af-9591-3ad437593f26 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:52.373667 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6abdb8f0-77df-41af-9591-3ad437593f26 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:52.508389 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6abdb8f0-77df-41af-9591-3ad437593f26 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:52.516358 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6abdb8f0-77df-41af-9591-3ad437593f26 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.154720 Apr 05 11:51:52.516947 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 90/177] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:52 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:52.718492 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-29feca34-36f3-4bb5-b3f9-42083d1520ea tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:52.719413 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-29feca34-36f3-4bb5-b3f9-42083d1520ea tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:52.727214 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-29feca34-36f3-4bb5-b3f9-42083d1520ea tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:52.729331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-29feca34-36f3-4bb5-b3f9-42083d1520ea tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:52.730696 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-29feca34-36f3-4bb5-b3f9-42083d1520ea tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:52.731406 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-29feca34-36f3-4bb5-b3f9-42083d1520ea tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:52.822511 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-29feca34-36f3-4bb5-b3f9-42083d1520ea tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:52.830353 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-29feca34-36f3-4bb5-b3f9-42083d1520ea tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1272 microversion: 2.1 time: 0.115872 Apr 05 11:51:52.831075 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 88/178] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:52 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1272 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:52.899658 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-61a9854b-8b08-4f64-b9df-deb066484146 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:52.900502 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-61a9854b-8b08-4f64-b9df-deb066484146 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:52.907368 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-61a9854b-8b08-4f64-b9df-deb066484146 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:52.907897 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-61a9854b-8b08-4f64-b9df-deb066484146 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:52.908703 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-61a9854b-8b08-4f64-b9df-deb066484146 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:52.909139 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-61a9854b-8b08-4f64-b9df-deb066484146 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:53.046041 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-61a9854b-8b08-4f64-b9df-deb066484146 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:53.054815 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-61a9854b-8b08-4f64-b9df-deb066484146 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:53.056549 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-61a9854b-8b08-4f64-b9df-deb066484146 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:53.057658 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-61a9854b-8b08-4f64-b9df-deb066484146 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.162346 Apr 05 11:51:53.058234 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 91/179] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:52 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:53.366975 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f7a5550d-d4d2-4a3b-be82-9a9209de4a4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:53.367807 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f7a5550d-d4d2-4a3b-be82-9a9209de4a4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:53.373904 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f7a5550d-d4d2-4a3b-be82-9a9209de4a4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:53.374753 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f7a5550d-d4d2-4a3b-be82-9a9209de4a4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:53.374881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b4c54adf-4389-463b-aa78-3c4a154720c7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:53.375840 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b4c54adf-4389-463b-aa78-3c4a154720c7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:53.376085 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f7a5550d-d4d2-4a3b-be82-9a9209de4a4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:53.376826 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f7a5550d-d4d2-4a3b-be82-9a9209de4a4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:53.384559 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b4c54adf-4389-463b-aa78-3c4a154720c7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:53.385143 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b4c54adf-4389-463b-aa78-3c4a154720c7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:53.386011 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b4c54adf-4389-463b-aa78-3c4a154720c7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:53.387261 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b4c54adf-4389-463b-aa78-3c4a154720c7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:53.670154 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f7a5550d-d4d2-4a3b-be82-9a9209de4a4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:53.687829 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f7a5550d-d4d2-4a3b-be82-9a9209de4a4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.324589 Apr 05 11:51:53.688922 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 89/180] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:53 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:53.703379 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8e567f26-c5d8-4f3f-b710-9274efd46805 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e8b9745-6d8d-4b25-b461-26e349d8620f"}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:51:53.705337 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8e567f26-c5d8-4f3f-b710-9274efd46805 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:53.711936 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8e567f26-c5d8-4f3f-b710-9274efd46805 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:53.712441 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8e567f26-c5d8-4f3f-b710-9274efd46805 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:53.713267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8e567f26-c5d8-4f3f-b710-9274efd46805 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:53.713721 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8e567f26-c5d8-4f3f-b710-9274efd46805 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:53.735454 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b4c54adf-4389-463b-aa78-3c4a154720c7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:53.745191 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b4c54adf-4389-463b-aa78-3c4a154720c7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.375631 Apr 05 11:51:53.754362 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 92/181] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:53 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:53.754362 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-27933d90-d681-418b-ae2b-8b000f36fef4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:53.754362 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-27933d90-d681-418b-ae2b-8b000f36fef4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:53.757810 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-27933d90-d681-418b-ae2b-8b000f36fef4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:53.758316 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-27933d90-d681-418b-ae2b-8b000f36fef4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:53.759129 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-27933d90-d681-418b-ae2b-8b000f36fef4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:53.759640 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-27933d90-d681-418b-ae2b-8b000f36fef4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:53.992617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-27933d90-d681-418b-ae2b-8b000f36fef4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:54.000375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-27933d90-d681-418b-ae2b-8b000f36fef4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.252756 Apr 05 11:51:54.000945 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 93/182] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:53 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:54.013459 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-54aebf1f-9275-4e00-b40b-321917248029 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:54.013893 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-54aebf1f-9275-4e00-b40b-321917248029 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:54.019710 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-54aebf1f-9275-4e00-b40b-321917248029 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:54.020187 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-54aebf1f-9275-4e00-b40b-321917248029 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:54.020942 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-54aebf1f-9275-4e00-b40b-321917248029 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:54.021468 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-54aebf1f-9275-4e00-b40b-321917248029 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:54.226594 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-54aebf1f-9275-4e00-b40b-321917248029 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:54.234158 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-54aebf1f-9275-4e00-b40b-321917248029 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.232272 Apr 05 11:51:54.234734 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 94/183] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:54 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:54.239097 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d8b50b9f-c1f5-45e4-a2c9-9b77be6d31a5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:54.239690 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d8b50b9f-c1f5-45e4-a2c9-9b77be6d31a5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:54.245401 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d8b50b9f-c1f5-45e4-a2c9-9b77be6d31a5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:54.245862 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d8b50b9f-c1f5-45e4-a2c9-9b77be6d31a5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:54.246650 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d8b50b9f-c1f5-45e4-a2c9-9b77be6d31a5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:54.247075 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d8b50b9f-c1f5-45e4-a2c9-9b77be6d31a5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:54.385253 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d8b50b9f-c1f5-45e4-a2c9-9b77be6d31a5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:54.394442 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d8b50b9f-c1f5-45e4-a2c9-9b77be6d31a5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:54.395983 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d8b50b9f-c1f5-45e4-a2c9-9b77be6d31a5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:54.397181 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d8b50b9f-c1f5-45e4-a2c9-9b77be6d31a5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.161545 Apr 05 11:51:54.397751 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 95/184] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:54 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:54.709551 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-565e4fc9-3472-4145-9a58-f14c674fa67c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:54.710150 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-565e4fc9-3472-4145-9a58-f14c674fa67c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:54.716738 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-565e4fc9-3472-4145-9a58-f14c674fa67c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:54.717185 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-565e4fc9-3472-4145-9a58-f14c674fa67c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:54.717943 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-565e4fc9-3472-4145-9a58-f14c674fa67c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:54.718365 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-565e4fc9-3472-4145-9a58-f14c674fa67c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:54.851366 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-565e4fc9-3472-4145-9a58-f14c674fa67c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:54.862319 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-565e4fc9-3472-4145-9a58-f14c674fa67c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.159274 Apr 05 11:51:54.864168 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 96/185] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:54 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:54.868886 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-30411ae1-f2cf-4a7c-acfb-20c6c1bb6471 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:54.869514 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-30411ae1-f2cf-4a7c-acfb-20c6c1bb6471 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:54.875683 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-30411ae1-f2cf-4a7c-acfb-20c6c1bb6471 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:54.876267 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-30411ae1-f2cf-4a7c-acfb-20c6c1bb6471 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:54.877057 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-30411ae1-f2cf-4a7c-acfb-20c6c1bb6471 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:54.877491 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-30411ae1-f2cf-4a7c-acfb-20c6c1bb6471 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:55.015019 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-30411ae1-f2cf-4a7c-acfb-20c6c1bb6471 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:55.022489 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-30411ae1-f2cf-4a7c-acfb-20c6c1bb6471 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.158006 Apr 05 11:51:55.023116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 97/186] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:54 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:55.027555 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6fa14486-9975-4adb-bd6a-a49f5b6b28dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:55.028194 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6fa14486-9975-4adb-bd6a-a49f5b6b28dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:55.033436 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6fa14486-9975-4adb-bd6a-a49f5b6b28dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:55.033890 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6fa14486-9975-4adb-bd6a-a49f5b6b28dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:55.034636 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6fa14486-9975-4adb-bd6a-a49f5b6b28dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:55.035058 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6fa14486-9975-4adb-bd6a-a49f5b6b28dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:55.178391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6fa14486-9975-4adb-bd6a-a49f5b6b28dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:55.189699 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6fa14486-9975-4adb-bd6a-a49f5b6b28dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.165304 Apr 05 11:51:55.190456 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 98/187] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:55 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:55.252188 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6416e03b-6f16-4b4c-80da-667387eb4f14 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:55.252737 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6416e03b-6f16-4b4c-80da-667387eb4f14 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:55.258995 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6416e03b-6f16-4b4c-80da-667387eb4f14 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:55.259454 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6416e03b-6f16-4b4c-80da-667387eb4f14 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:55.260254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6416e03b-6f16-4b4c-80da-667387eb4f14 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:55.260682 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6416e03b-6f16-4b4c-80da-667387eb4f14 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:55.407234 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6416e03b-6f16-4b4c-80da-667387eb4f14 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:55.415100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6416e03b-6f16-4b4c-80da-667387eb4f14 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.166592 Apr 05 11:51:55.415676 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 99/188] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:55 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:55.420033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f2f78b46-f58c-45cf-b9f5-f247c68ad34c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:55.420670 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f2f78b46-f58c-45cf-b9f5-f247c68ad34c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:55.426509 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f2f78b46-f58c-45cf-b9f5-f247c68ad34c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:55.426940 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f2f78b46-f58c-45cf-b9f5-f247c68ad34c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:55.427695 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f2f78b46-f58c-45cf-b9f5-f247c68ad34c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:55.428124 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f2f78b46-f58c-45cf-b9f5-f247c68ad34c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:55.559864 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f2f78b46-f58c-45cf-b9f5-f247c68ad34c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:55.568488 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f2f78b46-f58c-45cf-b9f5-f247c68ad34c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:55.569966 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f2f78b46-f58c-45cf-b9f5-f247c68ad34c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:55.571045 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f2f78b46-f58c-45cf-b9f5-f247c68ad34c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.154477 Apr 05 11:51:55.571611 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 100/189] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:55 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:55.885070 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-521b256d-ad3e-432f-9fb2-87fed7f90667 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:55.886139 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-521b256d-ad3e-432f-9fb2-87fed7f90667 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:55.896543 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-521b256d-ad3e-432f-9fb2-87fed7f90667 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:55.897280 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-521b256d-ad3e-432f-9fb2-87fed7f90667 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:55.898616 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-521b256d-ad3e-432f-9fb2-87fed7f90667 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:55.899324 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-521b256d-ad3e-432f-9fb2-87fed7f90667 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:56.039903 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-521b256d-ad3e-432f-9fb2-87fed7f90667 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:56.047581 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-521b256d-ad3e-432f-9fb2-87fed7f90667 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.169236 Apr 05 11:51:56.048385 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 101/190] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:55 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:56.052447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4cd1ff4e-0e6b-4b05-a36b-26da2d7a9605 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:56.053036 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4cd1ff4e-0e6b-4b05-a36b-26da2d7a9605 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:56.058549 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cd1ff4e-0e6b-4b05-a36b-26da2d7a9605 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:56.058993 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cd1ff4e-0e6b-4b05-a36b-26da2d7a9605 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:56.059740 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cd1ff4e-0e6b-4b05-a36b-26da2d7a9605 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:56.060205 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cd1ff4e-0e6b-4b05-a36b-26da2d7a9605 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:56.203724 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4cd1ff4e-0e6b-4b05-a36b-26da2d7a9605 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:56.212930 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4cd1ff4e-0e6b-4b05-a36b-26da2d7a9605 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.163844 Apr 05 11:51:56.213683 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 102/191] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:56 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:56.218188 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-012b9c81-2340-40f8-8f8c-a885fb5f1d72 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:56.218809 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-012b9c81-2340-40f8-8f8c-a885fb5f1d72 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:56.224838 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-012b9c81-2340-40f8-8f8c-a885fb5f1d72 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:56.225284 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-012b9c81-2340-40f8-8f8c-a885fb5f1d72 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:56.226038 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-012b9c81-2340-40f8-8f8c-a885fb5f1d72 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:56.226466 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-012b9c81-2340-40f8-8f8c-a885fb5f1d72 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:56.363409 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-012b9c81-2340-40f8-8f8c-a885fb5f1d72 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:56.371073 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-012b9c81-2340-40f8-8f8c-a885fb5f1d72 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.156407 Apr 05 11:51:56.371642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 103/192] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:56 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:56.434544 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d0ef8dc1-2263-4294-becb-359eb179f5d6 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:56.435385 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d0ef8dc1-2263-4294-becb-359eb179f5d6 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:56.444748 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d0ef8dc1-2263-4294-becb-359eb179f5d6 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:56.445419 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d0ef8dc1-2263-4294-becb-359eb179f5d6 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:56.446560 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d0ef8dc1-2263-4294-becb-359eb179f5d6 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:56.447206 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d0ef8dc1-2263-4294-becb-359eb179f5d6 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:56.591833 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d0ef8dc1-2263-4294-becb-359eb179f5d6 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:56.599295 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d0ef8dc1-2263-4294-becb-359eb179f5d6 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.170544 Apr 05 11:51:56.599902 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 104/193] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:56 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:56.604296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4b52db22-4902-4f57-8e76-306270b8acfe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:56.604892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4b52db22-4902-4f57-8e76-306270b8acfe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:56.611271 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4b52db22-4902-4f57-8e76-306270b8acfe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:56.611724 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4b52db22-4902-4f57-8e76-306270b8acfe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:56.612523 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4b52db22-4902-4f57-8e76-306270b8acfe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:56.612953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4b52db22-4902-4f57-8e76-306270b8acfe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:56.751107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4b52db22-4902-4f57-8e76-306270b8acfe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:56.759323 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4b52db22-4902-4f57-8e76-306270b8acfe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:56.760850 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4b52db22-4902-4f57-8e76-306270b8acfe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:56.761952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4b52db22-4902-4f57-8e76-306270b8acfe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.161085 Apr 05 11:51:56.762528 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 105/194] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:56 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:57.068440 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0a0c64ed-2cf1-4a95-8dde-4661e244d0c7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:57.069426 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0a0c64ed-2cf1-4a95-8dde-4661e244d0c7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:57.079471 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0a0c64ed-2cf1-4a95-8dde-4661e244d0c7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:57.080258 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0a0c64ed-2cf1-4a95-8dde-4661e244d0c7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:57.081504 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0a0c64ed-2cf1-4a95-8dde-4661e244d0c7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:57.082214 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0a0c64ed-2cf1-4a95-8dde-4661e244d0c7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:57.222490 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0a0c64ed-2cf1-4a95-8dde-4661e244d0c7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:57.230319 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0a0c64ed-2cf1-4a95-8dde-4661e244d0c7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.168292 Apr 05 11:51:57.230894 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 106/195] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:57 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:57.235542 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f6789074-25f5-4ccb-a800-c56b3ba5d03f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:57.236122 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f6789074-25f5-4ccb-a800-c56b3ba5d03f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:57.242139 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f6789074-25f5-4ccb-a800-c56b3ba5d03f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:57.242507 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f6789074-25f5-4ccb-a800-c56b3ba5d03f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:57.243251 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f6789074-25f5-4ccb-a800-c56b3ba5d03f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:57.243672 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f6789074-25f5-4ccb-a800-c56b3ba5d03f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:57.391178 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f6789074-25f5-4ccb-a800-c56b3ba5d03f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:57.398432 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f6789074-25f5-4ccb-a800-c56b3ba5d03f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.166620 Apr 05 11:51:57.398990 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 107/196] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:57 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:57.403291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-682b13a2-ae9c-45f1-8b77-b11523fcb4e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:57.403869 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-682b13a2-ae9c-45f1-8b77-b11523fcb4e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:57.409732 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-682b13a2-ae9c-45f1-8b77-b11523fcb4e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:57.410172 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-682b13a2-ae9c-45f1-8b77-b11523fcb4e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:57.410916 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-682b13a2-ae9c-45f1-8b77-b11523fcb4e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:57.411342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-682b13a2-ae9c-45f1-8b77-b11523fcb4e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:57.540645 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-682b13a2-ae9c-45f1-8b77-b11523fcb4e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:57.547922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-682b13a2-ae9c-45f1-8b77-b11523fcb4e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.148015 Apr 05 11:51:57.548514 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 108/197] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:57 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:57.621380 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c279967a-20df-46cf-88e6-292bc2bd9d88 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:57.622381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c279967a-20df-46cf-88e6-292bc2bd9d88 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:57.631750 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c279967a-20df-46cf-88e6-292bc2bd9d88 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:57.632224 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c279967a-20df-46cf-88e6-292bc2bd9d88 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:57.632973 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c279967a-20df-46cf-88e6-292bc2bd9d88 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:57.633390 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c279967a-20df-46cf-88e6-292bc2bd9d88 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:57.777718 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c279967a-20df-46cf-88e6-292bc2bd9d88 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:57.785435 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c279967a-20df-46cf-88e6-292bc2bd9d88 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.170049 Apr 05 11:51:57.786003 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 109/198] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:57 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:57.790380 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d03ebb2e-8f2b-4f5e-8460-2ad3c5e07301 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:57.790963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d03ebb2e-8f2b-4f5e-8460-2ad3c5e07301 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:57.796914 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d03ebb2e-8f2b-4f5e-8460-2ad3c5e07301 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:57.797353 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d03ebb2e-8f2b-4f5e-8460-2ad3c5e07301 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:57.798094 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d03ebb2e-8f2b-4f5e-8460-2ad3c5e07301 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:57.798516 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d03ebb2e-8f2b-4f5e-8460-2ad3c5e07301 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:57.929038 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d03ebb2e-8f2b-4f5e-8460-2ad3c5e07301 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:57.940585 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d03ebb2e-8f2b-4f5e-8460-2ad3c5e07301 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:57.942976 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d03ebb2e-8f2b-4f5e-8460-2ad3c5e07301 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:57.944680 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d03ebb2e-8f2b-4f5e-8460-2ad3c5e07301 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.157548 Apr 05 11:51:57.945532 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 110/199] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:57 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:58.251766 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9eb5f4e2-11c1-4c87-bf70-e80adbd2eecb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:58.252820 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9eb5f4e2-11c1-4c87-bf70-e80adbd2eecb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:58.260500 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9eb5f4e2-11c1-4c87-bf70-e80adbd2eecb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:58.260944 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9eb5f4e2-11c1-4c87-bf70-e80adbd2eecb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:58.261713 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9eb5f4e2-11c1-4c87-bf70-e80adbd2eecb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:58.262165 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9eb5f4e2-11c1-4c87-bf70-e80adbd2eecb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:58.602387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9eb5f4e2-11c1-4c87-bf70-e80adbd2eecb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:58.612740 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9eb5f4e2-11c1-4c87-bf70-e80adbd2eecb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.367288 Apr 05 11:51:58.613310 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 111/200] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:58 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:58.617817 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d3c02f88-04f8-441e-abd2-883ec97e5cd2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:58.618595 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d3c02f88-04f8-441e-abd2-883ec97e5cd2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:58.624154 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d3c02f88-04f8-441e-abd2-883ec97e5cd2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:58.624618 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d3c02f88-04f8-441e-abd2-883ec97e5cd2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:58.625370 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d3c02f88-04f8-441e-abd2-883ec97e5cd2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:58.625795 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d3c02f88-04f8-441e-abd2-883ec97e5cd2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:58.791037 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d3c02f88-04f8-441e-abd2-883ec97e5cd2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:58.798323 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d3c02f88-04f8-441e-abd2-883ec97e5cd2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.184055 Apr 05 11:51:58.798899 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 112/201] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:58 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:58.803451 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-34452815-a339-49b5-ae6d-4b29a4a9f4e0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:58.804042 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-34452815-a339-49b5-ae6d-4b29a4a9f4e0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:58.810212 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34452815-a339-49b5-ae6d-4b29a4a9f4e0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:58.810632 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34452815-a339-49b5-ae6d-4b29a4a9f4e0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:58.811381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34452815-a339-49b5-ae6d-4b29a4a9f4e0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:58.811939 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34452815-a339-49b5-ae6d-4b29a4a9f4e0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:58.947830 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-34452815-a339-49b5-ae6d-4b29a4a9f4e0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:58.958968 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-34452815-a339-49b5-ae6d-4b29a4a9f4e0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.158804 Apr 05 11:51:58.959712 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 113/202] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:58 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:58.965458 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4a97abed-ce2a-4cbd-a787-eb2fb159dd6c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:58.966329 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4a97abed-ce2a-4cbd-a787-eb2fb159dd6c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:58.972761 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a97abed-ce2a-4cbd-a787-eb2fb159dd6c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:58.973209 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a97abed-ce2a-4cbd-a787-eb2fb159dd6c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:58.973968 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a97abed-ce2a-4cbd-a787-eb2fb159dd6c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:58.974396 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a97abed-ce2a-4cbd-a787-eb2fb159dd6c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:59.121950 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4a97abed-ce2a-4cbd-a787-eb2fb159dd6c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:59.129494 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4a97abed-ce2a-4cbd-a787-eb2fb159dd6c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.168624 Apr 05 11:51:59.130069 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 114/203] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:58 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:59.134482 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a7755ddf-a673-4c45-95e5-9bf0d7db12af tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:59.135077 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a7755ddf-a673-4c45-95e5-9bf0d7db12af tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:59.140881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7755ddf-a673-4c45-95e5-9bf0d7db12af tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:59.141320 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7755ddf-a673-4c45-95e5-9bf0d7db12af tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:59.142071 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7755ddf-a673-4c45-95e5-9bf0d7db12af tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:59.142528 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7755ddf-a673-4c45-95e5-9bf0d7db12af tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:59.276296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a7755ddf-a673-4c45-95e5-9bf0d7db12af tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:59.288260 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a7755ddf-a673-4c45-95e5-9bf0d7db12af tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:59.290320 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a7755ddf-a673-4c45-95e5-9bf0d7db12af tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:59.291903 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a7755ddf-a673-4c45-95e5-9bf0d7db12af tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.160926 Apr 05 11:51:59.292646 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 115/204] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:51:59 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:51:59.629502 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-348c3c10-9bac-47ce-ac01-56307bd90f51 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:59.630112 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-348c3c10-9bac-47ce-ac01-56307bd90f51 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:59.636394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-348c3c10-9bac-47ce-ac01-56307bd90f51 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:59.636843 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-348c3c10-9bac-47ce-ac01-56307bd90f51 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:59.637617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-348c3c10-9bac-47ce-ac01-56307bd90f51 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:59.638046 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-348c3c10-9bac-47ce-ac01-56307bd90f51 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:59.778544 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-348c3c10-9bac-47ce-ac01-56307bd90f51 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:59.786161 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-348c3c10-9bac-47ce-ac01-56307bd90f51 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.160378 Apr 05 11:51:59.786966 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 116/205] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:59 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:59.814952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4e994d19-6aa8-4338-90f6-1cf1ea4df2ed tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:59.815571 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4e994d19-6aa8-4338-90f6-1cf1ea4df2ed tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:59.822404 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e994d19-6aa8-4338-90f6-1cf1ea4df2ed tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:59.822851 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e994d19-6aa8-4338-90f6-1cf1ea4df2ed tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:59.823604 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e994d19-6aa8-4338-90f6-1cf1ea4df2ed tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:59.824033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e994d19-6aa8-4338-90f6-1cf1ea4df2ed tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:59.956490 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4e994d19-6aa8-4338-90f6-1cf1ea4df2ed tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:51:59.964093 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4e994d19-6aa8-4338-90f6-1cf1ea4df2ed tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.152860 Apr 05 11:51:59.964696 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 117/206] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:59 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:51:59.980295 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4e8193f2-4e2c-4701-b747-4cff494221b3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:51:59.980900 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4e8193f2-4e2c-4701-b747-4cff494221b3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:51:59.987058 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e8193f2-4e2c-4701-b747-4cff494221b3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:59.987501 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e8193f2-4e2c-4701-b747-4cff494221b3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:51:59.988291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e8193f2-4e2c-4701-b747-4cff494221b3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:51:59.988765 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e8193f2-4e2c-4701-b747-4cff494221b3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:00.125881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4e8193f2-4e2c-4701-b747-4cff494221b3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:00.133686 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4e8193f2-4e2c-4701-b747-4cff494221b3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.157010 Apr 05 11:52:00.134251 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 118/207] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:51:59 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:00.146493 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-539ab15d-c6bc-4884-8e01-ff92b4ed6994 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:00.147144 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-539ab15d-c6bc-4884-8e01-ff92b4ed6994 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:00.152673 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-539ab15d-c6bc-4884-8e01-ff92b4ed6994 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:00.153243 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-539ab15d-c6bc-4884-8e01-ff92b4ed6994 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:00.153997 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-539ab15d-c6bc-4884-8e01-ff92b4ed6994 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:00.154427 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-539ab15d-c6bc-4884-8e01-ff92b4ed6994 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:00.288036 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-539ab15d-c6bc-4884-8e01-ff92b4ed6994 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:00.295733 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-539ab15d-c6bc-4884-8e01-ff92b4ed6994 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.153043 Apr 05 11:52:00.296335 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 119/208] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:00 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:52:00.313294 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-93c11eb6-e58a-4043-a97c-6a071e777178 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:00.313888 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-93c11eb6-e58a-4043-a97c-6a071e777178 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:00.320113 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-93c11eb6-e58a-4043-a97c-6a071e777178 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:00.320565 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-93c11eb6-e58a-4043-a97c-6a071e777178 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:00.321327 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-93c11eb6-e58a-4043-a97c-6a071e777178 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:00.321750 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-93c11eb6-e58a-4043-a97c-6a071e777178 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:00.462369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-93c11eb6-e58a-4043-a97c-6a071e777178 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:00.470325 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-93c11eb6-e58a-4043-a97c-6a071e777178 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:00.471796 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-93c11eb6-e58a-4043-a97c-6a071e777178 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:00.472909 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-93c11eb6-e58a-4043-a97c-6a071e777178 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.163235 Apr 05 11:52:00.473473 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 120/209] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:52:00 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:52:00.806948 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-216ce19a-4486-4726-951f-81b5f6b679cc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:00.807941 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-216ce19a-4486-4726-951f-81b5f6b679cc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:00.818029 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-216ce19a-4486-4726-951f-81b5f6b679cc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:00.818772 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-216ce19a-4486-4726-951f-81b5f6b679cc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:00.820017 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-216ce19a-4486-4726-951f-81b5f6b679cc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:00.820777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-216ce19a-4486-4726-951f-81b5f6b679cc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:01.092140 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-216ce19a-4486-4726-951f-81b5f6b679cc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:01.100056 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-216ce19a-4486-4726-951f-81b5f6b679cc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.299703 Apr 05 11:52:01.100663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 121/210] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:00 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:01.105154 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c4719dac-a44c-4e5a-84d7-07adcdd8e0a3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:01.105733 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c4719dac-a44c-4e5a-84d7-07adcdd8e0a3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:01.113787 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c4719dac-a44c-4e5a-84d7-07adcdd8e0a3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:01.114240 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c4719dac-a44c-4e5a-84d7-07adcdd8e0a3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:01.115028 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c4719dac-a44c-4e5a-84d7-07adcdd8e0a3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:01.115520 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c4719dac-a44c-4e5a-84d7-07adcdd8e0a3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:01.368532 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c4719dac-a44c-4e5a-84d7-07adcdd8e0a3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:01.376110 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c4719dac-a44c-4e5a-84d7-07adcdd8e0a3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.274479 Apr 05 11:52:01.376705 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 122/211] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:01 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:01.381683 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-34a09bb7-b2fd-4d91-9627-7e4e076f6300 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:01.382249 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-34a09bb7-b2fd-4d91-9627-7e4e076f6300 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:01.388378 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34a09bb7-b2fd-4d91-9627-7e4e076f6300 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:01.388824 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34a09bb7-b2fd-4d91-9627-7e4e076f6300 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:01.389588 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34a09bb7-b2fd-4d91-9627-7e4e076f6300 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:01.390014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34a09bb7-b2fd-4d91-9627-7e4e076f6300 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:01.610891 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-34a09bb7-b2fd-4d91-9627-7e4e076f6300 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:01.618744 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-34a09bb7-b2fd-4d91-9627-7e4e076f6300 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.241000 Apr 05 11:52:01.619216 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 123/212] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:01 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:01.623612 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3b1bcb30-2d21-45af-90e5-8fd9bdfa911e tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:01.624251 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3b1bcb30-2d21-45af-90e5-8fd9bdfa911e tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:01.629795 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b1bcb30-2d21-45af-90e5-8fd9bdfa911e tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:01.630243 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b1bcb30-2d21-45af-90e5-8fd9bdfa911e tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:01.631022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b1bcb30-2d21-45af-90e5-8fd9bdfa911e tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:01.631439 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b1bcb30-2d21-45af-90e5-8fd9bdfa911e tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:01.834678 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3b1bcb30-2d21-45af-90e5-8fd9bdfa911e tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:01.845743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3b1bcb30-2d21-45af-90e5-8fd9bdfa911e tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.225259 Apr 05 11:52:01.846486 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 124/213] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:01 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:01.850907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-617dc8c7-ffa0-45d5-8397-5ab05211e4eb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:01.851493 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-617dc8c7-ffa0-45d5-8397-5ab05211e4eb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:01.856890 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-617dc8c7-ffa0-45d5-8397-5ab05211e4eb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:01.857336 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-617dc8c7-ffa0-45d5-8397-5ab05211e4eb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:01.858455 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-617dc8c7-ffa0-45d5-8397-5ab05211e4eb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:01.858878 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-617dc8c7-ffa0-45d5-8397-5ab05211e4eb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:02.006538 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-617dc8c7-ffa0-45d5-8397-5ab05211e4eb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:02.014907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-617dc8c7-ffa0-45d5-8397-5ab05211e4eb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:02.016456 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-617dc8c7-ffa0-45d5-8397-5ab05211e4eb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:02.017553 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-617dc8c7-ffa0-45d5-8397-5ab05211e4eb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.170156 Apr 05 11:52:02.018126 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 125/214] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:52:01 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:52:02.022411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-4198132e-a49f-44d8-a3d3-7b2c1bbc3617 req-b3752f91-d913-4ddf-bb32-23c1315f6aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a367d561-192f-425f-b13a-b6b4c1c7df6c", "tag": "5be9ce97-7c72-4967-b97d-c11b277d5394"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:52:02.030366 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-4198132e-a49f-44d8-a3d3-7b2c1bbc3617 req-b3752f91-d913-4ddf-bb32-23c1315f6aa5 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:02.030838 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-4198132e-a49f-44d8-a3d3-7b2c1bbc3617 req-b3752f91-d913-4ddf-bb32-23c1315f6aa5 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:02.041776 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-4198132e-a49f-44d8-a3d3-7b2c1bbc3617 req-b3752f91-d913-4ddf-bb32-23c1315f6aa5 service nova] Creating event network-changed:5be9ce97-7c72-4967-b97d-c11b277d5394 for instance a367d561-192f-425f-b13a-b6b4c1c7df6c on hv-cinder-82956 Apr 05 11:52:02.046745 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-4198132e-a49f-44d8-a3d3-7b2c1bbc3617 req-b3752f91-d913-4ddf-bb32-23c1315f6aa5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027492 Apr 05 11:52:02.047301 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 126/215] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:52:02.117665 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8b1e0f8b-ea2f-43cb-ad63-f30737c6ea11 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:02.118406 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8b1e0f8b-ea2f-43cb-ad63-f30737c6ea11 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:02.125610 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8b1e0f8b-ea2f-43cb-ad63-f30737c6ea11 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:02.126059 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8b1e0f8b-ea2f-43cb-ad63-f30737c6ea11 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:02.126837 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8b1e0f8b-ea2f-43cb-ad63-f30737c6ea11 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:02.127285 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8b1e0f8b-ea2f-43cb-ad63-f30737c6ea11 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:02.265985 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8b1e0f8b-ea2f-43cb-ad63-f30737c6ea11 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:02.273182 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8b1e0f8b-ea2f-43cb-ad63-f30737c6ea11 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.159683 Apr 05 11:52:02.273764 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 127/216] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:02 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:52:02.393269 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f3f88f45-a704-4bac-9937-05fb3afd0de8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:02.393925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f3f88f45-a704-4bac-9937-05fb3afd0de8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:02.400585 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f3f88f45-a704-4bac-9937-05fb3afd0de8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:02.401059 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f3f88f45-a704-4bac-9937-05fb3afd0de8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:02.401811 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f3f88f45-a704-4bac-9937-05fb3afd0de8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:02.402239 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f3f88f45-a704-4bac-9937-05fb3afd0de8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:02.544683 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f3f88f45-a704-4bac-9937-05fb3afd0de8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:02.554068 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f3f88f45-a704-4bac-9937-05fb3afd0de8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.164696 Apr 05 11:52:02.554643 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 128/217] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:02 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:02.636815 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4f1d4fd8-23c9-404e-ab9a-a2e69f5f8235 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:02.637936 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4f1d4fd8-23c9-404e-ab9a-a2e69f5f8235 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:02.645350 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f1d4fd8-23c9-404e-ab9a-a2e69f5f8235 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:02.645793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f1d4fd8-23c9-404e-ab9a-a2e69f5f8235 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:02.646554 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f1d4fd8-23c9-404e-ab9a-a2e69f5f8235 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:02.646938 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f1d4fd8-23c9-404e-ab9a-a2e69f5f8235 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:02.787262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4f1d4fd8-23c9-404e-ab9a-a2e69f5f8235 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:02.794649 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4f1d4fd8-23c9-404e-ab9a-a2e69f5f8235 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.163055 Apr 05 11:52:02.795215 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 129/218] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:02 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:02.866868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-04928856-9fe2-4d10-983d-862e3917277c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:02.867844 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-04928856-9fe2-4d10-983d-862e3917277c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:02.877747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-04928856-9fe2-4d10-983d-862e3917277c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:02.878480 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-04928856-9fe2-4d10-983d-862e3917277c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:02.879725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-04928856-9fe2-4d10-983d-862e3917277c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:02.880636 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-04928856-9fe2-4d10-983d-862e3917277c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:03.016332 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-04928856-9fe2-4d10-983d-862e3917277c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:03.023970 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-04928856-9fe2-4d10-983d-862e3917277c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.163284 Apr 05 11:52:03.024575 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 130/219] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:02 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:03.034526 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-029f3ca4-2574-4df9-87f0-304ddeeb6051 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:03.035199 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-029f3ca4-2574-4df9-87f0-304ddeeb6051 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:03.040791 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-029f3ca4-2574-4df9-87f0-304ddeeb6051 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:03.041238 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-029f3ca4-2574-4df9-87f0-304ddeeb6051 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:03.041989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-029f3ca4-2574-4df9-87f0-304ddeeb6051 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:03.042415 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-029f3ca4-2574-4df9-87f0-304ddeeb6051 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:03.371618 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-029f3ca4-2574-4df9-87f0-304ddeeb6051 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:03.391034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-029f3ca4-2574-4df9-87f0-304ddeeb6051 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:03.395411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-029f3ca4-2574-4df9-87f0-304ddeeb6051 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:03.400424 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-029f3ca4-2574-4df9-87f0-304ddeeb6051 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.368039 Apr 05 11:52:03.403912 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 131/220] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:52:03 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:52:03.427358 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-47eb5629-f82c-477c-8b64-1a50dbf95ebb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:03.428107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-47eb5629-f82c-477c-8b64-1a50dbf95ebb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:03.443330 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-47eb5629-f82c-477c-8b64-1a50dbf95ebb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:03.443981 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-47eb5629-f82c-477c-8b64-1a50dbf95ebb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:03.444794 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-47eb5629-f82c-477c-8b64-1a50dbf95ebb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:03.445221 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-47eb5629-f82c-477c-8b64-1a50dbf95ebb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:03.513016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8e567f26-c5d8-4f3f-b710-9274efd46805 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "POST /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.822596 Apr 05 11:52:03.513674 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 90/221] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Apr 5 11:51:53 2022] POST /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac/os-volume_attachments => generated 194 bytes in 9824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:52:03.573066 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1508b40d-a9c5-4e63-abc3-5cffc5a702cf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:03.574439 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1508b40d-a9c5-4e63-abc3-5cffc5a702cf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:03.586953 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1508b40d-a9c5-4e63-abc3-5cffc5a702cf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:03.588371 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1508b40d-a9c5-4e63-abc3-5cffc5a702cf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:03.592030 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1508b40d-a9c5-4e63-abc3-5cffc5a702cf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:03.594701 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1508b40d-a9c5-4e63-abc3-5cffc5a702cf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:03.688866 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-47eb5629-f82c-477c-8b64-1a50dbf95ebb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:03.699251 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-47eb5629-f82c-477c-8b64-1a50dbf95ebb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.286314 Apr 05 11:52:03.700127 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 132/222] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:03 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:03.705186 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-447aa980-5347-4cfb-96f8-1da57cd1b739 req-bf437ba7-ada7-4fa4-ae65-336949ef5e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a3437c-94c0-4133-a629-9386b4639a2d", "name": "network-vif-plugged", "status": "completed", "tag": "4b172ae7-f382-4bd9-8d9f-48fd8694b406"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:52:03.714283 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-447aa980-5347-4cfb-96f8-1da57cd1b739 req-bf437ba7-ada7-4fa4-ae65-336949ef5e94 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:03.714283 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-447aa980-5347-4cfb-96f8-1da57cd1b739 req-bf437ba7-ada7-4fa4-ae65-336949ef5e94 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:03.729894 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-447aa980-5347-4cfb-96f8-1da57cd1b739 req-bf437ba7-ada7-4fa4-ae65-336949ef5e94 service nova] Creating event network-vif-plugged:4b172ae7-f382-4bd9-8d9f-48fd8694b406 for instance 98a3437c-94c0-4133-a629-9386b4639a2d on hv-cinder-82956 Apr 05 11:52:03.735438 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-447aa980-5347-4cfb-96f8-1da57cd1b739 req-bf437ba7-ada7-4fa4-ae65-336949ef5e94 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033599 Apr 05 11:52:03.736037 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 133/223] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:52:03.772451 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1508b40d-a9c5-4e63-abc3-5cffc5a702cf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:03.779703 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1508b40d-a9c5-4e63-abc3-5cffc5a702cf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.212622 Apr 05 11:52:03.780405 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 91/224] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:03 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:03.812575 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-328802c3-425c-4eb8-b1a2-c7c83c2a6411 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:03.813170 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-328802c3-425c-4eb8-b1a2-c7c83c2a6411 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:03.819815 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-328802c3-425c-4eb8-b1a2-c7c83c2a6411 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:03.820391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-328802c3-425c-4eb8-b1a2-c7c83c2a6411 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:03.821221 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-328802c3-425c-4eb8-b1a2-c7c83c2a6411 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:03.821652 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-328802c3-425c-4eb8-b1a2-c7c83c2a6411 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:03.954128 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-328802c3-425c-4eb8-b1a2-c7c83c2a6411 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:03.961557 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-328802c3-425c-4eb8-b1a2-c7c83c2a6411 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.153395 Apr 05 11:52:03.962103 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 134/225] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:03 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:04.043620 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7f84ab36-c296-4e41-858e-c2030f8c1621 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:04.044501 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7f84ab36-c296-4e41-858e-c2030f8c1621 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:04.053575 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f84ab36-c296-4e41-858e-c2030f8c1621 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:04.054027 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f84ab36-c296-4e41-858e-c2030f8c1621 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:04.054791 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f84ab36-c296-4e41-858e-c2030f8c1621 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:04.055221 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f84ab36-c296-4e41-858e-c2030f8c1621 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:04.189501 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7f84ab36-c296-4e41-858e-c2030f8c1621 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:04.196849 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7f84ab36-c296-4e41-858e-c2030f8c1621 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.159372 Apr 05 11:52:04.197421 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 92/226] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:04 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:04.426034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f9003d68-055b-4f5a-9e21-85812da089e8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:04.426873 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f9003d68-055b-4f5a-9e21-85812da089e8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:04.437032 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9003d68-055b-4f5a-9e21-85812da089e8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:04.437774 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9003d68-055b-4f5a-9e21-85812da089e8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:04.439036 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9003d68-055b-4f5a-9e21-85812da089e8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:04.439755 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9003d68-055b-4f5a-9e21-85812da089e8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:04.581240 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f9003d68-055b-4f5a-9e21-85812da089e8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:04.592787 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f9003d68-055b-4f5a-9e21-85812da089e8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:04.594300 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f9003d68-055b-4f5a-9e21-85812da089e8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:04.595442 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f9003d68-055b-4f5a-9e21-85812da089e8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.176561 Apr 05 11:52:04.595980 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 135/227] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:52:04 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:52:04.718618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4c52580d-582f-4f95-9790-749b95fa512e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:04.720132 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4c52580d-582f-4f95-9790-749b95fa512e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:04.728203 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c52580d-582f-4f95-9790-749b95fa512e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:04.728944 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c52580d-582f-4f95-9790-749b95fa512e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:04.729910 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c52580d-582f-4f95-9790-749b95fa512e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:04.730555 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c52580d-582f-4f95-9790-749b95fa512e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:04.797108 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4f938092-1af7-4fe3-90d3-07ee31619739 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:04.797717 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4f938092-1af7-4fe3-90d3-07ee31619739 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:04.804625 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f938092-1af7-4fe3-90d3-07ee31619739 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:04.805091 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f938092-1af7-4fe3-90d3-07ee31619739 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:04.805975 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f938092-1af7-4fe3-90d3-07ee31619739 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:04.806382 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f938092-1af7-4fe3-90d3-07ee31619739 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:04.887578 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4c52580d-582f-4f95-9790-749b95fa512e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:04.905498 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4c52580d-582f-4f95-9790-749b95fa512e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.192348 Apr 05 11:52:04.906453 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 93/228] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:04 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:04.970610 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4f938092-1af7-4fe3-90d3-07ee31619739 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:04.978630 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-de33f4ca-a8d0-4529-8649-af62b03b0293 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:04.979256 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-de33f4ca-a8d0-4529-8649-af62b03b0293 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:04.990037 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4f938092-1af7-4fe3-90d3-07ee31619739 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.196963 Apr 05 11:52:04.991576 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-de33f4ca-a8d0-4529-8649-af62b03b0293 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:04.992061 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-de33f4ca-a8d0-4529-8649-af62b03b0293 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:04.992773 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 136/229] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:04 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:52:05.004243 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-de33f4ca-a8d0-4529-8649-af62b03b0293 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:05.004968 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-de33f4ca-a8d0-4529-8649-af62b03b0293 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:05.216410 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-53312469-8225-42d0-91e9-ca725d8bd009 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:05.217020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-53312469-8225-42d0-91e9-ca725d8bd009 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:05.224168 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-53312469-8225-42d0-91e9-ca725d8bd009 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:05.224544 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-53312469-8225-42d0-91e9-ca725d8bd009 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:05.229690 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-53312469-8225-42d0-91e9-ca725d8bd009 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:05.235089 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-53312469-8225-42d0-91e9-ca725d8bd009 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:05.265994 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-de33f4ca-a8d0-4529-8649-af62b03b0293 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:05.273413 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-de33f4ca-a8d0-4529-8649-af62b03b0293 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.298563 Apr 05 11:52:05.274019 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 94/230] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:04 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:05.449500 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-53312469-8225-42d0-91e9-ca725d8bd009 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:05.457663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-53312469-8225-42d0-91e9-ca725d8bd009 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.246845 Apr 05 11:52:05.458242 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 137/231] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:05 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:05.613387 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b516167d-04b5-4f73-8c45-8c28711c0034 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:05.613988 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b516167d-04b5-4f73-8c45-8c28711c0034 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:05.619761 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b516167d-04b5-4f73-8c45-8c28711c0034 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:05.620256 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b516167d-04b5-4f73-8c45-8c28711c0034 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:05.621025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b516167d-04b5-4f73-8c45-8c28711c0034 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:05.621628 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b516167d-04b5-4f73-8c45-8c28711c0034 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:05.761133 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b516167d-04b5-4f73-8c45-8c28711c0034 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:05.769340 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b516167d-04b5-4f73-8c45-8c28711c0034 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:05.770985 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b516167d-04b5-4f73-8c45-8c28711c0034 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:05.772373 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b516167d-04b5-4f73-8c45-8c28711c0034 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.162669 Apr 05 11:52:05.773066 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 95/232] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:52:05 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:52:05.922666 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-503b21d4-128c-4437-b405-ebf275fb5a77 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:05.923272 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-503b21d4-128c-4437-b405-ebf275fb5a77 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:05.929292 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-503b21d4-128c-4437-b405-ebf275fb5a77 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:05.929742 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-503b21d4-128c-4437-b405-ebf275fb5a77 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:05.930503 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-503b21d4-128c-4437-b405-ebf275fb5a77 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:05.930928 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-503b21d4-128c-4437-b405-ebf275fb5a77 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:06.011345 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e0b12841-1575-4143-b514-6735232ce83d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:06.012307 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e0b12841-1575-4143-b514-6735232ce83d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:06.018562 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0b12841-1575-4143-b514-6735232ce83d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:06.019007 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0b12841-1575-4143-b514-6735232ce83d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:06.019765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0b12841-1575-4143-b514-6735232ce83d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:06.020228 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0b12841-1575-4143-b514-6735232ce83d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:06.116440 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-503b21d4-128c-4437-b405-ebf275fb5a77 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:06.125506 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-503b21d4-128c-4437-b405-ebf275fb5a77 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.206684 Apr 05 11:52:06.126048 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 138/233] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:05 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:06.176848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e0b12841-1575-4143-b514-6735232ce83d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:06.184405 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e0b12841-1575-4143-b514-6735232ce83d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.176874 Apr 05 11:52:06.184984 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 96/234] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:06 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:06.290009 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f82a308f-a243-4016-a827-459bf6769a6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:06.290626 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f82a308f-a243-4016-a827-459bf6769a6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:06.296329 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f82a308f-a243-4016-a827-459bf6769a6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:06.296769 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f82a308f-a243-4016-a827-459bf6769a6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:06.297516 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f82a308f-a243-4016-a827-459bf6769a6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:06.297990 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f82a308f-a243-4016-a827-459bf6769a6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:06.440232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f82a308f-a243-4016-a827-459bf6769a6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:06.447699 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f82a308f-a243-4016-a827-459bf6769a6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.161543 Apr 05 11:52:06.448305 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 139/235] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:06 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:06.477572 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-eb2f4589-b59c-4506-905f-d24c8cac9342 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:06.478172 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-eb2f4589-b59c-4506-905f-d24c8cac9342 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:06.484361 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eb2f4589-b59c-4506-905f-d24c8cac9342 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:06.484788 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eb2f4589-b59c-4506-905f-d24c8cac9342 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:06.485535 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eb2f4589-b59c-4506-905f-d24c8cac9342 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:06.486895 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eb2f4589-b59c-4506-905f-d24c8cac9342 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:06.623146 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-eb2f4589-b59c-4506-905f-d24c8cac9342 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:06.631183 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-eb2f4589-b59c-4506-905f-d24c8cac9342 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.160417 Apr 05 11:52:06.631756 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 97/236] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:06 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:06.790941 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ea45a464-893f-4154-951d-fb0be5fe57d4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:06.791538 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ea45a464-893f-4154-951d-fb0be5fe57d4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:06.798354 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea45a464-893f-4154-951d-fb0be5fe57d4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:06.798897 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea45a464-893f-4154-951d-fb0be5fe57d4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:06.799540 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea45a464-893f-4154-951d-fb0be5fe57d4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:06.800104 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea45a464-893f-4154-951d-fb0be5fe57d4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:06.997300 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ea45a464-893f-4154-951d-fb0be5fe57d4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:07.020799 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ea45a464-893f-4154-951d-fb0be5fe57d4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:07.023876 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ea45a464-893f-4154-951d-fb0be5fe57d4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:07.026503 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ea45a464-893f-4154-951d-fb0be5fe57d4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.240015 Apr 05 11:52:07.027086 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 140/237] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:52:06 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:52:07.142878 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b1ce71a0-22fc-4664-a24b-8e8ce0fb4014 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:07.144386 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b1ce71a0-22fc-4664-a24b-8e8ce0fb4014 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:07.151698 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b1ce71a0-22fc-4664-a24b-8e8ce0fb4014 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:07.152185 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b1ce71a0-22fc-4664-a24b-8e8ce0fb4014 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:07.152984 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b1ce71a0-22fc-4664-a24b-8e8ce0fb4014 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:07.153416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b1ce71a0-22fc-4664-a24b-8e8ce0fb4014 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:07.206341 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a583c0d4-02d1-4ff0-95e6-f2ee95f8264b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:07.207361 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a583c0d4-02d1-4ff0-95e6-f2ee95f8264b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:07.214620 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a583c0d4-02d1-4ff0-95e6-f2ee95f8264b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:07.215135 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a583c0d4-02d1-4ff0-95e6-f2ee95f8264b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:07.215946 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a583c0d4-02d1-4ff0-95e6-f2ee95f8264b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:07.216417 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a583c0d4-02d1-4ff0-95e6-f2ee95f8264b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:07.319990 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b1ce71a0-22fc-4664-a24b-8e8ce0fb4014 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:07.328232 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b1ce71a0-22fc-4664-a24b-8e8ce0fb4014 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.188620 Apr 05 11:52:07.337639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 98/238] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:07 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:07.377618 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a583c0d4-02d1-4ff0-95e6-f2ee95f8264b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:07.398793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a583c0d4-02d1-4ff0-95e6-f2ee95f8264b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.198775 Apr 05 11:52:07.399778 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 141/239] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:07 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:07.466583 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1aa83280-7bed-4021-962d-ef868ce559d3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:07.467390 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1aa83280-7bed-4021-962d-ef868ce559d3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:07.475919 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1aa83280-7bed-4021-962d-ef868ce559d3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:07.477993 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1aa83280-7bed-4021-962d-ef868ce559d3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:07.480716 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1aa83280-7bed-4021-962d-ef868ce559d3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:07.482704 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1aa83280-7bed-4021-962d-ef868ce559d3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:07.649787 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4c1a081f-63e1-4b46-9e66-a20f7daf646e tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:07.650424 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4c1a081f-63e1-4b46-9e66-a20f7daf646e tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:07.662325 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4c1a081f-63e1-4b46-9e66-a20f7daf646e tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:07.662571 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4c1a081f-63e1-4b46-9e66-a20f7daf646e tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:07.663350 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4c1a081f-63e1-4b46-9e66-a20f7daf646e tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:07.663783 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4c1a081f-63e1-4b46-9e66-a20f7daf646e tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:07.672562 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1aa83280-7bed-4021-962d-ef868ce559d3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:07.682856 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1aa83280-7bed-4021-962d-ef868ce559d3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.219030 Apr 05 11:52:07.683573 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 99/240] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:07 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:07.820448 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4c1a081f-63e1-4b46-9e66-a20f7daf646e tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:07.830637 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4c1a081f-63e1-4b46-9e66-a20f7daf646e tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.184735 Apr 05 11:52:07.844280 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 142/241] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:07 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:08.045235 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e2be90ce-f578-49a4-a053-324eb93ad340 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:08.045725 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e2be90ce-f578-49a4-a053-324eb93ad340 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:08.051784 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e2be90ce-f578-49a4-a053-324eb93ad340 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:08.052308 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e2be90ce-f578-49a4-a053-324eb93ad340 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:08.053106 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e2be90ce-f578-49a4-a053-324eb93ad340 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:08.053702 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e2be90ce-f578-49a4-a053-324eb93ad340 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:08.260828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e2be90ce-f578-49a4-a053-324eb93ad340 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:08.270272 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e2be90ce-f578-49a4-a053-324eb93ad340 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:08.271837 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e2be90ce-f578-49a4-a053-324eb93ad340 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:08.272974 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e2be90ce-f578-49a4-a053-324eb93ad340 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.232072 Apr 05 11:52:08.273620 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 100/242] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:52:08 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:52:08.344871 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9439d764-409d-4226-a91e-ca7758393958 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:08.345485 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9439d764-409d-4226-a91e-ca7758393958 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:08.351357 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9439d764-409d-4226-a91e-ca7758393958 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:08.351789 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9439d764-409d-4226-a91e-ca7758393958 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:08.352581 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9439d764-409d-4226-a91e-ca7758393958 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:08.353018 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9439d764-409d-4226-a91e-ca7758393958 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:08.417200 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0825f278-e82b-4426-a788-ad986e04fe44 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:08.417836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0825f278-e82b-4426-a788-ad986e04fe44 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:08.424243 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0825f278-e82b-4426-a788-ad986e04fe44 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:08.424710 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0825f278-e82b-4426-a788-ad986e04fe44 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:08.425585 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0825f278-e82b-4426-a788-ad986e04fe44 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:08.426037 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0825f278-e82b-4426-a788-ad986e04fe44 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:08.490976 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9439d764-409d-4226-a91e-ca7758393958 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:08.502279 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9439d764-409d-4226-a91e-ca7758393958 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.161223 Apr 05 11:52:08.502854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 143/243] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:08 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:08.636993 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0825f278-e82b-4426-a788-ad986e04fe44 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:08.644750 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0825f278-e82b-4426-a788-ad986e04fe44 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.231377 Apr 05 11:52:08.645429 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 101/244] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:08 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:08.704500 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-646a913a-5128-4348-bd50-16c1f1a45a78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:08.704732 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-646a913a-5128-4348-bd50-16c1f1a45a78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:08.710885 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-646a913a-5128-4348-bd50-16c1f1a45a78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:08.711320 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-646a913a-5128-4348-bd50-16c1f1a45a78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:08.712368 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-646a913a-5128-4348-bd50-16c1f1a45a78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:08.712948 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-646a913a-5128-4348-bd50-16c1f1a45a78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:08.857585 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9b6be512-0c4c-4853-910c-1a4db83841a7 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:08.858363 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9b6be512-0c4c-4853-910c-1a4db83841a7 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:08.865976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9b6be512-0c4c-4853-910c-1a4db83841a7 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:08.867073 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9b6be512-0c4c-4853-910c-1a4db83841a7 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:08.868692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9b6be512-0c4c-4853-910c-1a4db83841a7 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:08.869231 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9b6be512-0c4c-4853-910c-1a4db83841a7 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:08.909380 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-646a913a-5128-4348-bd50-16c1f1a45a78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:08.922283 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-646a913a-5128-4348-bd50-16c1f1a45a78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.226110 Apr 05 11:52:08.924231 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 144/245] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:08 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:09.014257 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9b6be512-0c4c-4853-910c-1a4db83841a7 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:09.021645 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9b6be512-0c4c-4853-910c-1a4db83841a7 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.169284 Apr 05 11:52:09.022220 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 102/246] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:08 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:09.290853 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-80e7cfa1-7338-4472-9beb-9a9c020989e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:09.291918 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-80e7cfa1-7338-4472-9beb-9a9c020989e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:09.298531 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-80e7cfa1-7338-4472-9beb-9a9c020989e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:09.298977 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-80e7cfa1-7338-4472-9beb-9a9c020989e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:09.299794 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-80e7cfa1-7338-4472-9beb-9a9c020989e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:09.300328 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-80e7cfa1-7338-4472-9beb-9a9c020989e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:09.502770 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-80e7cfa1-7338-4472-9beb-9a9c020989e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:09.510701 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-80e7cfa1-7338-4472-9beb-9a9c020989e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:09.520458 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1d855b6b-9e0e-439a-a7a3-c9ed5e80b5e7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:09.521189 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1d855b6b-9e0e-439a-a7a3-c9ed5e80b5e7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:09.528968 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-80e7cfa1-7338-4472-9beb-9a9c020989e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:09.530086 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1d855b6b-9e0e-439a-a7a3-c9ed5e80b5e7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:09.530532 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1d855b6b-9e0e-439a-a7a3-c9ed5e80b5e7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:09.530687 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-80e7cfa1-7338-4472-9beb-9a9c020989e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.243646 Apr 05 11:52:09.531359 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 145/247] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:52:09 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:52:09.532640 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1d855b6b-9e0e-439a-a7a3-c9ed5e80b5e7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:09.534214 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1d855b6b-9e0e-439a-a7a3-c9ed5e80b5e7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:09.664152 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-115d3188-b567-471d-b859-73ab6ec5b690 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:09.665694 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-115d3188-b567-471d-b859-73ab6ec5b690 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:09.673015 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-115d3188-b567-471d-b859-73ab6ec5b690 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:09.673586 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-115d3188-b567-471d-b859-73ab6ec5b690 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:09.674536 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-115d3188-b567-471d-b859-73ab6ec5b690 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:09.675110 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-115d3188-b567-471d-b859-73ab6ec5b690 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:09.687652 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1d855b6b-9e0e-439a-a7a3-c9ed5e80b5e7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:09.699270 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1d855b6b-9e0e-439a-a7a3-c9ed5e80b5e7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.182718 Apr 05 11:52:09.700554 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 103/248] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:09 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:52:09.787686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-e8cb41a9-c51b-432b-83e8-faef1c7141a5 req-f8346871-9697-4c51-8868-2d03dcbb2ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d507e3-5f14-419a-a3cd-31f36496b2d8", "name": "network-vif-plugged", "status": "completed", "tag": "54ad08dc-d08d-49a7-a3d3-ff818ba84298"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:52:09.798679 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-e8cb41a9-c51b-432b-83e8-faef1c7141a5 req-f8346871-9697-4c51-8868-2d03dcbb2ecb service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:09.799416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-e8cb41a9-c51b-432b-83e8-faef1c7141a5 req-f8346871-9697-4c51-8868-2d03dcbb2ecb service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:09.815323 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-e8cb41a9-c51b-432b-83e8-faef1c7141a5 req-f8346871-9697-4c51-8868-2d03dcbb2ecb service nova] Creating event network-vif-plugged:54ad08dc-d08d-49a7-a3d3-ff818ba84298 for instance f8d507e3-5f14-419a-a3cd-31f36496b2d8 on hv-cinder-82956 Apr 05 11:52:09.821885 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-e8cb41a9-c51b-432b-83e8-faef1c7141a5 req-f8346871-9697-4c51-8868-2d03dcbb2ecb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038860 Apr 05 11:52:09.823496 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 104/249] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:52:09.824906 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-115d3188-b567-471d-b859-73ab6ec5b690 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:09.833068 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-115d3188-b567-471d-b859-73ab6ec5b690 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.174318 Apr 05 11:52:09.833947 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 146/250] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:09 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:09.940890 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5900c4fb-da90-48bd-b400-34eba2327487 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:09.941782 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5900c4fb-da90-48bd-b400-34eba2327487 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:09.948195 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5900c4fb-da90-48bd-b400-34eba2327487 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:09.948637 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5900c4fb-da90-48bd-b400-34eba2327487 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:09.949392 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5900c4fb-da90-48bd-b400-34eba2327487 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:09.949816 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5900c4fb-da90-48bd-b400-34eba2327487 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:10.039691 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3bf3fe58-266c-4514-af08-be51897db46f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:10.041190 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3bf3fe58-266c-4514-af08-be51897db46f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:10.047881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3bf3fe58-266c-4514-af08-be51897db46f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:10.048756 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3bf3fe58-266c-4514-af08-be51897db46f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:10.049764 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3bf3fe58-266c-4514-af08-be51897db46f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:10.050113 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3bf3fe58-266c-4514-af08-be51897db46f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:10.088889 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5900c4fb-da90-48bd-b400-34eba2327487 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:10.096408 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5900c4fb-da90-48bd-b400-34eba2327487 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.159619 Apr 05 11:52:10.097003 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 105/251] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:09 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:10.189496 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3bf3fe58-266c-4514-af08-be51897db46f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:10.197251 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3bf3fe58-266c-4514-af08-be51897db46f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.162152 Apr 05 11:52:10.197837 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 147/252] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:10 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:10.548989 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-13a41710-4f7e-4adf-a2d1-ee5079528768 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:10.549594 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-13a41710-4f7e-4adf-a2d1-ee5079528768 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:10.556245 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13a41710-4f7e-4adf-a2d1-ee5079528768 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:10.556913 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13a41710-4f7e-4adf-a2d1-ee5079528768 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:10.557678 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13a41710-4f7e-4adf-a2d1-ee5079528768 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:10.558124 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13a41710-4f7e-4adf-a2d1-ee5079528768 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:10.704248 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-13a41710-4f7e-4adf-a2d1-ee5079528768 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:10.710889 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-13a41710-4f7e-4adf-a2d1-ee5079528768 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:10.712641 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-13a41710-4f7e-4adf-a2d1-ee5079528768 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:10.714183 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-13a41710-4f7e-4adf-a2d1-ee5079528768 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1406 microversion: 2.20 time: 0.169247 Apr 05 11:52:10.724882 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-123975c6-7b68-4419-9bb4-832db271ad5b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:10.724882 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-123975c6-7b68-4419-9bb4-832db271ad5b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:10.725669 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 106/253] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:52:10 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:52:10.726079 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-123975c6-7b68-4419-9bb4-832db271ad5b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:10.726471 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-123975c6-7b68-4419-9bb4-832db271ad5b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:10.727296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-123975c6-7b68-4419-9bb4-832db271ad5b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:10.727931 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-123975c6-7b68-4419-9bb4-832db271ad5b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:10.854028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-828228a1-3b99-4d61-8068-7aa87ab2cb42 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:10.854855 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-828228a1-3b99-4d61-8068-7aa87ab2cb42 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:10.862498 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-828228a1-3b99-4d61-8068-7aa87ab2cb42 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:10.863416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-828228a1-3b99-4d61-8068-7aa87ab2cb42 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:10.864556 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-828228a1-3b99-4d61-8068-7aa87ab2cb42 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:10.865136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-828228a1-3b99-4d61-8068-7aa87ab2cb42 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:10.918965 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-123975c6-7b68-4419-9bb4-832db271ad5b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:10.926698 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-123975c6-7b68-4419-9bb4-832db271ad5b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.213955 Apr 05 11:52:10.927724 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 148/254] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:10 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:11.034439 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-828228a1-3b99-4d61-8068-7aa87ab2cb42 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:11.041838 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-828228a1-3b99-4d61-8068-7aa87ab2cb42 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.195366 Apr 05 11:52:11.042409 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 107/255] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:10 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:52:11.113504 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4e6fc8f2-e7d7-4dfd-af54-114d8f2a1152 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:11.114113 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4e6fc8f2-e7d7-4dfd-af54-114d8f2a1152 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:11.119923 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e6fc8f2-e7d7-4dfd-af54-114d8f2a1152 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:11.120614 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e6fc8f2-e7d7-4dfd-af54-114d8f2a1152 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:11.121377 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e6fc8f2-e7d7-4dfd-af54-114d8f2a1152 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:11.121808 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e6fc8f2-e7d7-4dfd-af54-114d8f2a1152 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:11.214784 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-70bb1c68-0142-41cf-ae2c-ac263fbfc54f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:11.215577 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-70bb1c68-0142-41cf-ae2c-ac263fbfc54f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:11.221518 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-70bb1c68-0142-41cf-ae2c-ac263fbfc54f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:11.222189 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-70bb1c68-0142-41cf-ae2c-ac263fbfc54f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:11.222958 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-70bb1c68-0142-41cf-ae2c-ac263fbfc54f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:11.223587 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-70bb1c68-0142-41cf-ae2c-ac263fbfc54f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:11.268338 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4e6fc8f2-e7d7-4dfd-af54-114d8f2a1152 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:11.276033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4e6fc8f2-e7d7-4dfd-af54-114d8f2a1152 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.166558 Apr 05 11:52:11.283642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 149/256] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:11 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:11.377341 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-70bb1c68-0142-41cf-ae2c-ac263fbfc54f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:11.384723 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-70bb1c68-0142-41cf-ae2c-ac263fbfc54f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.174074 Apr 05 11:52:11.385534 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 108/257] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:11 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:11.734116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8b926bd2-c26f-4742-8356-30f0680c24df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:11.734783 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8b926bd2-c26f-4742-8356-30f0680c24df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:11.744338 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8b926bd2-c26f-4742-8356-30f0680c24df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:11.748392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8b926bd2-c26f-4742-8356-30f0680c24df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:11.749324 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8b926bd2-c26f-4742-8356-30f0680c24df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:11.749773 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8b926bd2-c26f-4742-8356-30f0680c24df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:11.843853 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-f24450e8-0d9d-4575-8b21-e8bc2863bff9 req-21d72ac5-c2fa-4c9d-bf34-2d7de6478acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48b77eb-b654-43e4-9551-735bac89d0de", "name": "network-vif-plugged", "status": "completed", "tag": "e6dd88bf-e528-41ea-ac09-941f2df0ad3c"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:52:11.855826 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-f24450e8-0d9d-4575-8b21-e8bc2863bff9 req-21d72ac5-c2fa-4c9d-bf34-2d7de6478acf service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:11.856638 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-f24450e8-0d9d-4575-8b21-e8bc2863bff9 req-21d72ac5-c2fa-4c9d-bf34-2d7de6478acf service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:11.871342 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-f24450e8-0d9d-4575-8b21-e8bc2863bff9 req-21d72ac5-c2fa-4c9d-bf34-2d7de6478acf service nova] Creating event network-vif-plugged:e6dd88bf-e528-41ea-ac09-941f2df0ad3c for instance c48b77eb-b654-43e4-9551-735bac89d0de on hv-cinder-82956 Apr 05 11:52:11.876687 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-f24450e8-0d9d-4575-8b21-e8bc2863bff9 req-21d72ac5-c2fa-4c9d-bf34-2d7de6478acf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040284 Apr 05 11:52:11.879614 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 109/258] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:52:11.950334 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8b1edcd9-a440-4313-84ac-16213d9a5719 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:11.951412 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8b1edcd9-a440-4313-84ac-16213d9a5719 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:11.960967 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8b1edcd9-a440-4313-84ac-16213d9a5719 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:11.961418 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8b1edcd9-a440-4313-84ac-16213d9a5719 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:11.962207 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8b1edcd9-a440-4313-84ac-16213d9a5719 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:11.962834 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8b1edcd9-a440-4313-84ac-16213d9a5719 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:12.089601 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8b926bd2-c26f-4742-8356-30f0680c24df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:12.097048 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8b926bd2-c26f-4742-8356-30f0680c24df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:12.098557 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8b926bd2-c26f-4742-8356-30f0680c24df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:12.099882 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8b926bd2-c26f-4742-8356-30f0680c24df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1598 microversion: 2.20 time: 0.370912 Apr 05 11:52:12.100541 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 150/259] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:52:11 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1598 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:52:12.105254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1b13da97-040f-4730-ae41-420397c852a3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:12.105924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1b13da97-040f-4730-ae41-420397c852a3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:12.112191 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1b13da97-040f-4730-ae41-420397c852a3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:12.112899 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1b13da97-040f-4730-ae41-420397c852a3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:12.125409 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1b13da97-040f-4730-ae41-420397c852a3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:12.125974 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1b13da97-040f-4730-ae41-420397c852a3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:12.174932 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8b1edcd9-a440-4313-84ac-16213d9a5719 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:12.188051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8b1edcd9-a440-4313-84ac-16213d9a5719 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.247004 Apr 05 11:52:12.189125 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 110/260] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:11 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:52:12.197354 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-950ca661-0f82-454e-9aa0-53f0a73e5382 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:12.198163 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-950ca661-0f82-454e-9aa0-53f0a73e5382 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:12.205676 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-950ca661-0f82-454e-9aa0-53f0a73e5382 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:12.206696 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-950ca661-0f82-454e-9aa0-53f0a73e5382 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:12.207678 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-950ca661-0f82-454e-9aa0-53f0a73e5382 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:12.208413 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-950ca661-0f82-454e-9aa0-53f0a73e5382 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:12.310341 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-950ca661-0f82-454e-9aa0-53f0a73e5382 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.119782 Apr 05 11:52:12.311142 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 111/261] 10.222.0.61 () {60 vars in 1315 bytes} [Tue Apr 5 11:52:12 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:52:12.315672 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-031662fb-6411-4b75-a0de-549559a0f411 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:12.316872 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-031662fb-6411-4b75-a0de-549559a0f411 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:12.324567 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-031662fb-6411-4b75-a0de-549559a0f411 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:12.325032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-031662fb-6411-4b75-a0de-549559a0f411 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:12.325798 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-031662fb-6411-4b75-a0de-549559a0f411 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:12.326224 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-031662fb-6411-4b75-a0de-549559a0f411 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:12.336685 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1b13da97-040f-4730-ae41-420397c852a3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:12.346707 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1b13da97-040f-4730-ae41-420397c852a3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.244953 Apr 05 11:52:12.347694 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 151/262] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:12 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:12.403214 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c049e422-b7b9-4a21-a565-811ca997172c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:12.403820 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c049e422-b7b9-4a21-a565-811ca997172c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:12.412866 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c049e422-b7b9-4a21-a565-811ca997172c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:12.413618 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c049e422-b7b9-4a21-a565-811ca997172c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:12.414654 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c049e422-b7b9-4a21-a565-811ca997172c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:12.415635 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c049e422-b7b9-4a21-a565-811ca997172c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:12.647983 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c049e422-b7b9-4a21-a565-811ca997172c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:12.657972 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c049e422-b7b9-4a21-a565-811ca997172c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.259667 Apr 05 11:52:12.659278 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 152/263] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:12 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:52:13.067041 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-031662fb-6411-4b75-a0de-549559a0f411 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:13.075935 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-031662fb-6411-4b75-a0de-549559a0f411 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.763775 Apr 05 11:52:13.100339 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 112/264] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:12 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:13.205834 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-80932f05-6122-48af-933d-d21c0ab20162 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:13.206436 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-80932f05-6122-48af-933d-d21c0ab20162 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:13.213720 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-80932f05-6122-48af-933d-d21c0ab20162 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:13.214135 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-80932f05-6122-48af-933d-d21c0ab20162 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:13.214904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-80932f05-6122-48af-933d-d21c0ab20162 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:13.215362 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-80932f05-6122-48af-933d-d21c0ab20162 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:13.358829 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-80932f05-6122-48af-933d-d21c0ab20162 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:13.364506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4bbdd72a-4606-4983-8abe-80a0ee6ee6ac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:13.365266 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4bbdd72a-4606-4983-8abe-80a0ee6ee6ac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:13.367407 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-80932f05-6122-48af-933d-d21c0ab20162 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.165340 Apr 05 11:52:13.377746 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 153/265] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:13 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:13.377921 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4bbdd72a-4606-4983-8abe-80a0ee6ee6ac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:13.377921 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4bbdd72a-4606-4983-8abe-80a0ee6ee6ac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:13.377921 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4bbdd72a-4606-4983-8abe-80a0ee6ee6ac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:13.377921 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4bbdd72a-4606-4983-8abe-80a0ee6ee6ac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:13.675576 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3e452420-aa23-4bff-8d7e-e314d7d132e5 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:13.676311 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3e452420-aa23-4bff-8d7e-e314d7d132e5 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:13.682426 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3e452420-aa23-4bff-8d7e-e314d7d132e5 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:13.682861 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3e452420-aa23-4bff-8d7e-e314d7d132e5 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:13.683615 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3e452420-aa23-4bff-8d7e-e314d7d132e5 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:13.684515 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3e452420-aa23-4bff-8d7e-e314d7d132e5 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:13.839839 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4bbdd72a-4606-4983-8abe-80a0ee6ee6ac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:13.849325 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4bbdd72a-4606-4983-8abe-80a0ee6ee6ac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.489056 Apr 05 11:52:13.849885 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 113/266] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:13 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:13.865482 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3e452420-aa23-4bff-8d7e-e314d7d132e5 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:13.874563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3e452420-aa23-4bff-8d7e-e314d7d132e5 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.202763 Apr 05 11:52:13.886165 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 154/267] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:13 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:14.109496 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b770ea95-d9e1-4d9f-b855-55e0d4a2e9bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:14.110710 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b770ea95-d9e1-4d9f-b855-55e0d4a2e9bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:14.120558 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b770ea95-d9e1-4d9f-b855-55e0d4a2e9bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:14.121005 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b770ea95-d9e1-4d9f-b855-55e0d4a2e9bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:14.123668 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b770ea95-d9e1-4d9f-b855-55e0d4a2e9bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:14.124145 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b770ea95-d9e1-4d9f-b855-55e0d4a2e9bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:14.308375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-f9b428b4-0e8c-425e-85fe-f06b5e8894c7 req-84435f15-6c57-469d-9e1d-7f18030a8392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a367d561-192f-425f-b13a-b6b4c1c7df6c", "name": "network-vif-plugged", "status": "completed", "tag": "5be9ce97-7c72-4967-b97d-c11b277d5394"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:52:14.331505 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-f9b428b4-0e8c-425e-85fe-f06b5e8894c7 req-84435f15-6c57-469d-9e1d-7f18030a8392 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:14.332364 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-f9b428b4-0e8c-425e-85fe-f06b5e8894c7 req-84435f15-6c57-469d-9e1d-7f18030a8392 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:14.346701 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-f9b428b4-0e8c-425e-85fe-f06b5e8894c7 req-84435f15-6c57-469d-9e1d-7f18030a8392 service nova] Creating event network-vif-plugged:5be9ce97-7c72-4967-b97d-c11b277d5394 for instance a367d561-192f-425f-b13a-b6b4c1c7df6c on hv-cinder-82956 Apr 05 11:52:14.353976 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-f9b428b4-0e8c-425e-85fe-f06b5e8894c7 req-84435f15-6c57-469d-9e1d-7f18030a8392 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049581 Apr 05 11:52:14.355480 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 155/268] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:52:14.386146 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bf73245e-a940-4fa4-907b-d3cf3c256806 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:14.387128 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bf73245e-a940-4fa4-907b-d3cf3c256806 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:14.399659 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bf73245e-a940-4fa4-907b-d3cf3c256806 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:14.400612 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bf73245e-a940-4fa4-907b-d3cf3c256806 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:14.405831 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bf73245e-a940-4fa4-907b-d3cf3c256806 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:14.406560 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bf73245e-a940-4fa4-907b-d3cf3c256806 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:14.618825 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bf73245e-a940-4fa4-907b-d3cf3c256806 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:14.645679 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bf73245e-a940-4fa4-907b-d3cf3c256806 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.263439 Apr 05 11:52:14.647894 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 156/269] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:14 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:52:14.680159 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-eff957ad-90df-42ab-b849-a2c0bb7b4b77 req-27c3d60c-56d4-41fc-904b-7e9826a6b605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a3437c-94c0-4133-a629-9386b4639a2d", "tag": "4b172ae7-f382-4bd9-8d9f-48fd8694b406"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:52:14.689834 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-eff957ad-90df-42ab-b849-a2c0bb7b4b77 req-27c3d60c-56d4-41fc-904b-7e9826a6b605 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:14.690507 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-eff957ad-90df-42ab-b849-a2c0bb7b4b77 req-27c3d60c-56d4-41fc-904b-7e9826a6b605 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:14.703255 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-eff957ad-90df-42ab-b849-a2c0bb7b4b77 req-27c3d60c-56d4-41fc-904b-7e9826a6b605 service nova] Creating event network-changed:4b172ae7-f382-4bd9-8d9f-48fd8694b406 for instance 98a3437c-94c0-4133-a629-9386b4639a2d on hv-cinder-82956 Apr 05 11:52:14.711255 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b770ea95-d9e1-4d9f-b855-55e0d4a2e9bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:14.716274 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-eff957ad-90df-42ab-b849-a2c0bb7b4b77 req-27c3d60c-56d4-41fc-904b-7e9826a6b605 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044021 Apr 05 11:52:14.717381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 157/270] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:52:14.719643 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b770ea95-d9e1-4d9f-b855-55e0d4a2e9bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1366 microversion: 2.1 time: 0.614318 Apr 05 11:52:14.729847 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 114/271] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:14 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1366 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:14.867976 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-24b29516-fd03-4fb1-bac2-16795e24741c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:14.869331 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-24b29516-fd03-4fb1-bac2-16795e24741c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:14.886399 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24b29516-fd03-4fb1-bac2-16795e24741c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:14.886849 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24b29516-fd03-4fb1-bac2-16795e24741c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:14.887654 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24b29516-fd03-4fb1-bac2-16795e24741c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:14.888283 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24b29516-fd03-4fb1-bac2-16795e24741c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:14.894561 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-302633a8-d9c4-489f-bba1-203bceab5cea tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:14.894561 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-302633a8-d9c4-489f-bba1-203bceab5cea tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:14.907278 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-302633a8-d9c4-489f-bba1-203bceab5cea tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:14.907934 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-302633a8-d9c4-489f-bba1-203bceab5cea tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:14.908929 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-302633a8-d9c4-489f-bba1-203bceab5cea tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:14.909535 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-302633a8-d9c4-489f-bba1-203bceab5cea tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:15.059671 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-24b29516-fd03-4fb1-bac2-16795e24741c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:15.071247 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-24b29516-fd03-4fb1-bac2-16795e24741c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.207653 Apr 05 11:52:15.073580 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 158/272] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:14 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:15.109822 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-302633a8-d9c4-489f-bba1-203bceab5cea tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:15.117608 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-302633a8-d9c4-489f-bba1-203bceab5cea tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.228725 Apr 05 11:52:15.127242 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 115/273] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:14 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:15.664723 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5c5a4c1b-25f6-4785-96b8-8c1e45653df1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:15.666092 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5c5a4c1b-25f6-4785-96b8-8c1e45653df1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:15.672119 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5c5a4c1b-25f6-4785-96b8-8c1e45653df1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:15.672653 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5c5a4c1b-25f6-4785-96b8-8c1e45653df1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:15.673518 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5c5a4c1b-25f6-4785-96b8-8c1e45653df1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:15.674018 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5c5a4c1b-25f6-4785-96b8-8c1e45653df1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:15.736018 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cd716e14-433a-4bdd-aff5-54b65ed32b82 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:15.736643 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cd716e14-433a-4bdd-aff5-54b65ed32b82 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:15.746097 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd716e14-433a-4bdd-aff5-54b65ed32b82 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:15.746973 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd716e14-433a-4bdd-aff5-54b65ed32b82 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:15.747896 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd716e14-433a-4bdd-aff5-54b65ed32b82 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:15.749995 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd716e14-433a-4bdd-aff5-54b65ed32b82 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:15.833637 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5c5a4c1b-25f6-4785-96b8-8c1e45653df1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:15.847303 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5c5a4c1b-25f6-4785-96b8-8c1e45653df1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.186870 Apr 05 11:52:15.852560 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 159/274] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:15 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:15.908633 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-cd716e14-433a-4bdd-aff5-54b65ed32b82 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:15.917098 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cd716e14-433a-4bdd-aff5-54b65ed32b82 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1555 microversion: 2.1 time: 0.185196 Apr 05 11:52:15.917911 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 116/275] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:15 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1555 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:15.935941 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a1ffee9f-e97f-4c96-848f-8e45a0ed120b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:15.936632 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a1ffee9f-e97f-4c96-848f-8e45a0ed120b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:15.944822 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a1ffee9f-e97f-4c96-848f-8e45a0ed120b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:15.945205 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a1ffee9f-e97f-4c96-848f-8e45a0ed120b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:15.946072 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a1ffee9f-e97f-4c96-848f-8e45a0ed120b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:15.946507 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a1ffee9f-e97f-4c96-848f-8e45a0ed120b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:16.044244 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a1ffee9f-e97f-4c96-848f-8e45a0ed120b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113099 Apr 05 11:52:16.044852 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 160/276] 10.222.0.61 () {58 vars in 1274 bytes} [Tue Apr 5 11:52:15 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:52:16.091066 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0344cb4c-6616-4414-a8f2-314c9c04f115 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:16.091938 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0344cb4c-6616-4414-a8f2-314c9c04f115 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:16.103212 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0344cb4c-6616-4414-a8f2-314c9c04f115 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:16.104864 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0344cb4c-6616-4414-a8f2-314c9c04f115 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:16.105948 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0344cb4c-6616-4414-a8f2-314c9c04f115 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:16.106535 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0344cb4c-6616-4414-a8f2-314c9c04f115 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:16.140054 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3ecd4df9-5ab2-475b-a21f-4f96da7be421 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:16.140823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3ecd4df9-5ab2-475b-a21f-4f96da7be421 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:16.151107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3ecd4df9-5ab2-475b-a21f-4f96da7be421 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:16.156040 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3ecd4df9-5ab2-475b-a21f-4f96da7be421 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:16.156980 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3ecd4df9-5ab2-475b-a21f-4f96da7be421 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:16.157851 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3ecd4df9-5ab2-475b-a21f-4f96da7be421 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:16.298363 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0344cb4c-6616-4414-a8f2-314c9c04f115 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:16.308913 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0344cb4c-6616-4414-a8f2-314c9c04f115 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.221693 Apr 05 11:52:16.310037 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 117/277] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:16 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:16.474759 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3ecd4df9-5ab2-475b-a21f-4f96da7be421 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:16.483550 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3ecd4df9-5ab2-475b-a21f-4f96da7be421 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.351008 Apr 05 11:52:16.492223 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 161/278] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:16 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:16.864885 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-72ddd50c-0846-431e-bae1-1e6dc1196c09 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:16.865743 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-72ddd50c-0846-431e-bae1-1e6dc1196c09 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:16.875969 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-72ddd50c-0846-431e-bae1-1e6dc1196c09 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:16.876743 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-72ddd50c-0846-431e-bae1-1e6dc1196c09 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:16.877716 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-72ddd50c-0846-431e-bae1-1e6dc1196c09 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:16.878303 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-72ddd50c-0846-431e-bae1-1e6dc1196c09 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:17.033920 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-72ddd50c-0846-431e-bae1-1e6dc1196c09 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:17.041757 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-72ddd50c-0846-431e-bae1-1e6dc1196c09 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.180658 Apr 05 11:52:17.042513 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 118/279] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:16 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:17.326936 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-011c6861-5e28-4079-b647-4a243359519f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:17.327764 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-011c6861-5e28-4079-b647-4a243359519f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:17.333896 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-011c6861-5e28-4079-b647-4a243359519f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:17.334582 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-011c6861-5e28-4079-b647-4a243359519f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:17.335529 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-011c6861-5e28-4079-b647-4a243359519f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:17.336124 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-011c6861-5e28-4079-b647-4a243359519f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:17.504181 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2d2c7251-8a68-4b70-a595-32a1d6f28f63 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:17.504818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2d2c7251-8a68-4b70-a595-32a1d6f28f63 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:17.517070 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2d2c7251-8a68-4b70-a595-32a1d6f28f63 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:17.517745 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2d2c7251-8a68-4b70-a595-32a1d6f28f63 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:17.519289 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2d2c7251-8a68-4b70-a595-32a1d6f28f63 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:17.519922 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2d2c7251-8a68-4b70-a595-32a1d6f28f63 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:17.646194 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-011c6861-5e28-4079-b647-4a243359519f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:17.657562 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-011c6861-5e28-4079-b647-4a243359519f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.334335 Apr 05 11:52:17.670353 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 162/280] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:17 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:17.690159 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2d2c7251-8a68-4b70-a595-32a1d6f28f63 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:17.698419 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2d2c7251-8a68-4b70-a595-32a1d6f28f63 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.202397 Apr 05 11:52:17.709028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 119/281] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:17 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:17.838608 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-fd753378-662c-4130-8ca5-f5af95c796e7 req-298a09fc-cce2-488e-bb48-a7c70608a4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8d507e3-5f14-419a-a3cd-31f36496b2d8", "tag": "54ad08dc-d08d-49a7-a3d3-ff818ba84298"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:52:17.847672 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-fd753378-662c-4130-8ca5-f5af95c796e7 req-298a09fc-cce2-488e-bb48-a7c70608a4c8 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:17.848531 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-fd753378-662c-4130-8ca5-f5af95c796e7 req-298a09fc-cce2-488e-bb48-a7c70608a4c8 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:17.862774 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-fd753378-662c-4130-8ca5-f5af95c796e7 req-298a09fc-cce2-488e-bb48-a7c70608a4c8 service nova] Creating event network-changed:54ad08dc-d08d-49a7-a3d3-ff818ba84298 for instance f8d507e3-5f14-419a-a3cd-31f36496b2d8 on hv-cinder-82956 Apr 05 11:52:17.871204 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-fd753378-662c-4130-8ca5-f5af95c796e7 req-298a09fc-cce2-488e-bb48-a7c70608a4c8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034765 Apr 05 11:52:17.872191 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 163/282] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:52:18.059751 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-23f8b37d-62ce-4074-9db6-fb89b6d7182d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:18.060517 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-23f8b37d-62ce-4074-9db6-fb89b6d7182d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:18.070489 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-23f8b37d-62ce-4074-9db6-fb89b6d7182d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:18.070941 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-23f8b37d-62ce-4074-9db6-fb89b6d7182d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:18.071770 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-23f8b37d-62ce-4074-9db6-fb89b6d7182d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:18.072644 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-23f8b37d-62ce-4074-9db6-fb89b6d7182d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:18.273137 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-23f8b37d-62ce-4074-9db6-fb89b6d7182d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:18.282852 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-23f8b37d-62ce-4074-9db6-fb89b6d7182d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.227303 Apr 05 11:52:18.283949 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 120/283] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:18 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:18.679680 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a99313e9-48ef-4236-94ea-108fb445ba88 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:18.681412 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a99313e9-48ef-4236-94ea-108fb445ba88 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:18.700583 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a99313e9-48ef-4236-94ea-108fb445ba88 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:18.701292 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a99313e9-48ef-4236-94ea-108fb445ba88 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:18.702288 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a99313e9-48ef-4236-94ea-108fb445ba88 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:18.702864 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a99313e9-48ef-4236-94ea-108fb445ba88 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:18.717917 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-326a1d93-fcb2-492c-98d2-85407b625591 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:18.718553 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-326a1d93-fcb2-492c-98d2-85407b625591 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:18.725918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-326a1d93-fcb2-492c-98d2-85407b625591 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:18.726362 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-326a1d93-fcb2-492c-98d2-85407b625591 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:18.727133 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-326a1d93-fcb2-492c-98d2-85407b625591 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:18.727562 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-326a1d93-fcb2-492c-98d2-85407b625591 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:18.908534 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a99313e9-48ef-4236-94ea-108fb445ba88 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:18.917626 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a99313e9-48ef-4236-94ea-108fb445ba88 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1362 microversion: 2.1 time: 0.245131 Apr 05 11:52:18.929213 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 164/284] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:18 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:18.959279 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-326a1d93-fcb2-492c-98d2-85407b625591 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:18.969811 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-326a1d93-fcb2-492c-98d2-85407b625591 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.255026 Apr 05 11:52:18.971661 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 121/285] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:18 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:52:19.300163 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ced0c3a3-2744-44cb-9720-92c54e919814 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:19.301036 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ced0c3a3-2744-44cb-9720-92c54e919814 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:19.307002 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ced0c3a3-2744-44cb-9720-92c54e919814 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:19.307447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ced0c3a3-2744-44cb-9720-92c54e919814 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:19.308234 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ced0c3a3-2744-44cb-9720-92c54e919814 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:19.308864 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ced0c3a3-2744-44cb-9720-92c54e919814 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:19.521856 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ced0c3a3-2744-44cb-9720-92c54e919814 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:19.540982 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ced0c3a3-2744-44cb-9720-92c54e919814 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.244839 Apr 05 11:52:19.542086 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 165/286] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:19 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:19.603459 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f12584f2-6bdc-4b3a-aa62-ba662c884125 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:19.604052 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f12584f2-6bdc-4b3a-aa62-ba662c884125 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:19.611444 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f12584f2-6bdc-4b3a-aa62-ba662c884125 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:19.611962 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f12584f2-6bdc-4b3a-aa62-ba662c884125 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:19.612828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f12584f2-6bdc-4b3a-aa62-ba662c884125 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:19.613337 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f12584f2-6bdc-4b3a-aa62-ba662c884125 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:19.637147 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f12584f2-6bdc-4b3a-aa62-ba662c884125 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Going to try to terminate instance {{(pid=123357) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:52:19.727071 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f12584f2-6bdc-4b3a-aa62-ba662c884125 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "DELETE /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 204 len: 0 microversion: 2.1 time: 0.127780 Apr 05 11:52:19.727726 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 122/287] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 11:52:19 2022] DELETE /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:52:19.736093 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ef94d4ca-87f0-4d94-941c-c83742dee101 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:19.736855 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ef94d4ca-87f0-4d94-941c-c83742dee101 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:19.743094 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ef94d4ca-87f0-4d94-941c-c83742dee101 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:19.743514 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ef94d4ca-87f0-4d94-941c-c83742dee101 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:19.744321 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ef94d4ca-87f0-4d94-941c-c83742dee101 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:19.744748 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ef94d4ca-87f0-4d94-941c-c83742dee101 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:19.882216 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ef94d4ca-87f0-4d94-941c-c83742dee101 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:19.890595 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ef94d4ca-87f0-4d94-941c-c83742dee101 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1553 microversion: 2.1 time: 0.158617 Apr 05 11:52:19.891408 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 166/288] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:19 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:19.937389 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-86714653-5d25-43c8-86ce-f8431e3f27cc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:19.938077 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-86714653-5d25-43c8-86ce-f8431e3f27cc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:19.944373 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86714653-5d25-43c8-86ce-f8431e3f27cc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:19.944817 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86714653-5d25-43c8-86ce-f8431e3f27cc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:19.945602 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86714653-5d25-43c8-86ce-f8431e3f27cc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:19.946037 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86714653-5d25-43c8-86ce-f8431e3f27cc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:19.992012 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b235cd17-7866-4360-a947-537cac0901f9 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:19.992929 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b235cd17-7866-4360-a947-537cac0901f9 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:20.000065 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b235cd17-7866-4360-a947-537cac0901f9 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:20.001330 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b235cd17-7866-4360-a947-537cac0901f9 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:20.002279 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b235cd17-7866-4360-a947-537cac0901f9 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:20.002860 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b235cd17-7866-4360-a947-537cac0901f9 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:20.092025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-86714653-5d25-43c8-86ce-f8431e3f27cc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:20.100238 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-86714653-5d25-43c8-86ce-f8431e3f27cc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1549 microversion: 2.1 time: 0.167287 Apr 05 11:52:20.100848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 123/289] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:19 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:20.117454 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d41a9b05-e993-4b91-aae5-3b6386899d60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:20.117943 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d41a9b05-e993-4b91-aae5-3b6386899d60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:20.123845 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d41a9b05-e993-4b91-aae5-3b6386899d60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:20.124331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d41a9b05-e993-4b91-aae5-3b6386899d60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:20.125277 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d41a9b05-e993-4b91-aae5-3b6386899d60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:20.125947 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d41a9b05-e993-4b91-aae5-3b6386899d60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:20.313466 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d41a9b05-e993-4b91-aae5-3b6386899d60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.199849 Apr 05 11:52:20.314267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 124/290] 10.222.0.61 () {58 vars in 1274 bytes} [Tue Apr 5 11:52:20 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-interface => generated 285 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:52:20.346126 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b235cd17-7866-4360-a947-537cac0901f9 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:20.354372 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b235cd17-7866-4360-a947-537cac0901f9 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.369385 Apr 05 11:52:20.355263 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 167/291] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:19 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:20.557823 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d9061f63-040d-4891-9980-e192855d9d3e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:20.558428 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d9061f63-040d-4891-9980-e192855d9d3e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:20.564362 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d9061f63-040d-4891-9980-e192855d9d3e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:20.564985 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d9061f63-040d-4891-9980-e192855d9d3e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:20.566243 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d9061f63-040d-4891-9980-e192855d9d3e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:20.567199 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d9061f63-040d-4891-9980-e192855d9d3e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:20.908770 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-921574ae-e002-43d4-b362-9bc82d37e7e9 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:20.909363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-921574ae-e002-43d4-b362-9bc82d37e7e9 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:20.915617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-921574ae-e002-43d4-b362-9bc82d37e7e9 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:20.916067 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-921574ae-e002-43d4-b362-9bc82d37e7e9 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:20.916898 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-921574ae-e002-43d4-b362-9bc82d37e7e9 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:20.917329 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-921574ae-e002-43d4-b362-9bc82d37e7e9 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:20.929459 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d9061f63-040d-4891-9980-e192855d9d3e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:20.938254 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d9061f63-040d-4891-9980-e192855d9d3e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.384085 Apr 05 11:52:20.949255 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 125/292] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:20 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:21.063187 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-921574ae-e002-43d4-b362-9bc82d37e7e9 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:21.072050 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-921574ae-e002-43d4-b362-9bc82d37e7e9 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1553 microversion: 2.1 time: 0.167058 Apr 05 11:52:21.072954 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 168/293] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:20 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:52:21.372333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-43d03a7e-8c33-4852-97f5-a79aec1bf970 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:21.373228 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-43d03a7e-8c33-4852-97f5-a79aec1bf970 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:21.379292 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-43d03a7e-8c33-4852-97f5-a79aec1bf970 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:21.379965 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-43d03a7e-8c33-4852-97f5-a79aec1bf970 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:21.381033 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-43d03a7e-8c33-4852-97f5-a79aec1bf970 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:21.381418 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-43d03a7e-8c33-4852-97f5-a79aec1bf970 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:21.482839 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-251a183d-f210-48c8-81b7-ac8e77c85a07 req-0ec2d22d-0dd2-426a-8383-1a33e03525a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c48b77eb-b654-43e4-9551-735bac89d0de", "tag": "e6dd88bf-e528-41ea-ac09-941f2df0ad3c"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:52:21.497503 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-251a183d-f210-48c8-81b7-ac8e77c85a07 req-0ec2d22d-0dd2-426a-8383-1a33e03525a6 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:21.498116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-251a183d-f210-48c8-81b7-ac8e77c85a07 req-0ec2d22d-0dd2-426a-8383-1a33e03525a6 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:21.512096 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-251a183d-f210-48c8-81b7-ac8e77c85a07 req-0ec2d22d-0dd2-426a-8383-1a33e03525a6 service nova] Creating event network-changed:e6dd88bf-e528-41ea-ac09-941f2df0ad3c for instance c48b77eb-b654-43e4-9551-735bac89d0de on hv-cinder-82956 Apr 05 11:52:21.518072 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-251a183d-f210-48c8-81b7-ac8e77c85a07 req-0ec2d22d-0dd2-426a-8383-1a33e03525a6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040702 Apr 05 11:52:21.518865 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 169/294] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:52:21.555212 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-43d03a7e-8c33-4852-97f5-a79aec1bf970 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:21.563263 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-43d03a7e-8c33-4852-97f5-a79aec1bf970 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.194742 Apr 05 11:52:21.564155 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 126/295] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:21 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:21.956572 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f309f0df-7795-4c77-86b9-d9274f4a50a2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:21.957986 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f309f0df-7795-4c77-86b9-d9274f4a50a2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:21.964197 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f309f0df-7795-4c77-86b9-d9274f4a50a2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:21.964805 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f309f0df-7795-4c77-86b9-d9274f4a50a2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:21.965737 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f309f0df-7795-4c77-86b9-d9274f4a50a2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:21.966307 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f309f0df-7795-4c77-86b9-d9274f4a50a2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:22.089846 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cd8b0a75-edc7-424c-91c4-1960179f163d tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:22.090469 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cd8b0a75-edc7-424c-91c4-1960179f163d tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:22.097880 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd8b0a75-edc7-424c-91c4-1960179f163d tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:22.098680 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd8b0a75-edc7-424c-91c4-1960179f163d tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:22.100165 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd8b0a75-edc7-424c-91c4-1960179f163d tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:22.100753 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd8b0a75-edc7-424c-91c4-1960179f163d tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:22.110394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f309f0df-7795-4c77-86b9-d9274f4a50a2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:22.118392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f309f0df-7795-4c77-86b9-d9274f4a50a2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.165995 Apr 05 11:52:22.128809 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 170/296] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:21 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:22.260319 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-cd8b0a75-edc7-424c-91c4-1960179f163d tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:22.268637 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cd8b0a75-edc7-424c-91c4-1960179f163d tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1553 microversion: 2.1 time: 0.183325 Apr 05 11:52:22.269228 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 127/297] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:22 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1553 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:52:22.581438 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e3842299-54a4-4ba7-973c-6a4b1efc454b tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:22.582070 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e3842299-54a4-4ba7-973c-6a4b1efc454b tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:22.590568 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e3842299-54a4-4ba7-973c-6a4b1efc454b tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:22.591003 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e3842299-54a4-4ba7-973c-6a4b1efc454b tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:22.592297 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e3842299-54a4-4ba7-973c-6a4b1efc454b tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:22.592883 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e3842299-54a4-4ba7-973c-6a4b1efc454b tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:22.743339 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e3842299-54a4-4ba7-973c-6a4b1efc454b tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:22.754505 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e3842299-54a4-4ba7-973c-6a4b1efc454b tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.176858 Apr 05 11:52:22.755206 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 171/298] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:22 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:23.138363 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-96584313-8ccb-4103-83e1-d995f8440119 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:23.139273 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-96584313-8ccb-4103-83e1-d995f8440119 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:23.149777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-96584313-8ccb-4103-83e1-d995f8440119 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:23.150539 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-96584313-8ccb-4103-83e1-d995f8440119 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:23.151766 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-96584313-8ccb-4103-83e1-d995f8440119 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:23.152525 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-96584313-8ccb-4103-83e1-d995f8440119 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:23.285459 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4a6ecbe3-ea57-4ffc-937c-eb8a88e0d122 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:23.286220 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4a6ecbe3-ea57-4ffc-937c-eb8a88e0d122 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:23.291250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-96584313-8ccb-4103-83e1-d995f8440119 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:23.292375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a6ecbe3-ea57-4ffc-937c-eb8a88e0d122 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:23.292826 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a6ecbe3-ea57-4ffc-937c-eb8a88e0d122 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:23.293593 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a6ecbe3-ea57-4ffc-937c-eb8a88e0d122 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:23.294024 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a6ecbe3-ea57-4ffc-937c-eb8a88e0d122 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:23.298730 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-96584313-8ccb-4103-83e1-d995f8440119 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.166942 Apr 05 11:52:23.299286 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 128/299] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:23 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:23.425954 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4a6ecbe3-ea57-4ffc-937c-eb8a88e0d122 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:23.433945 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4a6ecbe3-ea57-4ffc-937c-eb8a88e0d122 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1553 microversion: 2.1 time: 0.152372 Apr 05 11:52:23.434523 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 172/300] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:23 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:23.776493 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d1ff56c2-9dd9-430f-bd3e-edb04bb02875 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:23.777095 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d1ff56c2-9dd9-430f-bd3e-edb04bb02875 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:23.783585 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d1ff56c2-9dd9-430f-bd3e-edb04bb02875 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:23.783983 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d1ff56c2-9dd9-430f-bd3e-edb04bb02875 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:23.784824 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d1ff56c2-9dd9-430f-bd3e-edb04bb02875 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:23.785254 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d1ff56c2-9dd9-430f-bd3e-edb04bb02875 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:23.924028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d1ff56c2-9dd9-430f-bd3e-edb04bb02875 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:23.935277 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d1ff56c2-9dd9-430f-bd3e-edb04bb02875 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.162534 Apr 05 11:52:23.936143 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 129/301] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:23 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:24.317671 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-186dc23d-f327-4d48-aeff-eb141d5d850c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:24.318265 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-186dc23d-f327-4d48-aeff-eb141d5d850c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:24.324823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-186dc23d-f327-4d48-aeff-eb141d5d850c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:24.325264 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-186dc23d-f327-4d48-aeff-eb141d5d850c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:24.326022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-186dc23d-f327-4d48-aeff-eb141d5d850c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:24.326445 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-186dc23d-f327-4d48-aeff-eb141d5d850c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:24.450876 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6c2718ee-c18a-4de5-93b2-3852ba54d1c3 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:24.451561 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6c2718ee-c18a-4de5-93b2-3852ba54d1c3 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:24.457593 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6c2718ee-c18a-4de5-93b2-3852ba54d1c3 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:24.458040 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6c2718ee-c18a-4de5-93b2-3852ba54d1c3 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:24.458799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6c2718ee-c18a-4de5-93b2-3852ba54d1c3 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:24.459203 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6c2718ee-c18a-4de5-93b2-3852ba54d1c3 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:24.463963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-186dc23d-f327-4d48-aeff-eb141d5d850c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:24.471903 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-186dc23d-f327-4d48-aeff-eb141d5d850c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.158778 Apr 05 11:52:24.472490 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 173/302] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:24 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:24.593219 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6c2718ee-c18a-4de5-93b2-3852ba54d1c3 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:24.601345 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6c2718ee-c18a-4de5-93b2-3852ba54d1c3 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1553 microversion: 2.1 time: 0.154319 Apr 05 11:52:24.601923 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 130/303] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:24 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:52:24.956861 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-18a0c131-a3b7-4c3b-ba12-32148db4e40c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:24.957956 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-18a0c131-a3b7-4c3b-ba12-32148db4e40c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:24.966139 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-18a0c131-a3b7-4c3b-ba12-32148db4e40c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:24.966733 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-18a0c131-a3b7-4c3b-ba12-32148db4e40c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:24.967732 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-18a0c131-a3b7-4c3b-ba12-32148db4e40c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:24.968449 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-18a0c131-a3b7-4c3b-ba12-32148db4e40c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:25.119647 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-18a0c131-a3b7-4c3b-ba12-32148db4e40c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:25.126917 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-18a0c131-a3b7-4c3b-ba12-32148db4e40c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.176579 Apr 05 11:52:25.127481 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 174/304] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:24 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:25.492466 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-247d7a97-b567-42af-8ad8-471cc558eb11 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:25.493151 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-247d7a97-b567-42af-8ad8-471cc558eb11 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:25.500663 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-247d7a97-b567-42af-8ad8-471cc558eb11 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:25.501164 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-247d7a97-b567-42af-8ad8-471cc558eb11 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:25.502002 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-247d7a97-b567-42af-8ad8-471cc558eb11 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:25.502477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-247d7a97-b567-42af-8ad8-471cc558eb11 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:25.618984 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-05ceaffb-46e2-40b3-b3b6-2cd0b0d06b66 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:25.619553 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-05ceaffb-46e2-40b3-b3b6-2cd0b0d06b66 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:25.625794 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-05ceaffb-46e2-40b3-b3b6-2cd0b0d06b66 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:25.626236 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-05ceaffb-46e2-40b3-b3b6-2cd0b0d06b66 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:25.626977 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-05ceaffb-46e2-40b3-b3b6-2cd0b0d06b66 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:25.627402 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-05ceaffb-46e2-40b3-b3b6-2cd0b0d06b66 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:25.636390 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-247d7a97-b567-42af-8ad8-471cc558eb11 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:25.644066 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-247d7a97-b567-42af-8ad8-471cc558eb11 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.156714 Apr 05 11:52:25.644573 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 131/305] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:25 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:25.774891 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-05ceaffb-46e2-40b3-b3b6-2cd0b0d06b66 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:25.782977 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-05ceaffb-46e2-40b3-b3b6-2cd0b0d06b66 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1553 microversion: 2.1 time: 0.167907 Apr 05 11:52:25.783564 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 175/306] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:25 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:26.148003 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-db716d74-99a8-4720-859d-a1b6390bb960 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:26.148892 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-db716d74-99a8-4720-859d-a1b6390bb960 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:26.156260 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-db716d74-99a8-4720-859d-a1b6390bb960 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:26.157008 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-db716d74-99a8-4720-859d-a1b6390bb960 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:26.157996 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-db716d74-99a8-4720-859d-a1b6390bb960 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:26.158627 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-db716d74-99a8-4720-859d-a1b6390bb960 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:26.310021 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-db716d74-99a8-4720-859d-a1b6390bb960 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:26.317326 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-db716d74-99a8-4720-859d-a1b6390bb960 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.177298 Apr 05 11:52:26.317948 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 132/307] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:26 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:26.664065 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-60fb4f2e-432a-4ec3-ad12-e67abdf3fc7f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:26.664697 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-60fb4f2e-432a-4ec3-ad12-e67abdf3fc7f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:26.670855 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-60fb4f2e-432a-4ec3-ad12-e67abdf3fc7f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:26.671302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-60fb4f2e-432a-4ec3-ad12-e67abdf3fc7f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:26.672060 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-60fb4f2e-432a-4ec3-ad12-e67abdf3fc7f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:26.672519 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-60fb4f2e-432a-4ec3-ad12-e67abdf3fc7f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:26.800190 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-620c4b1d-78bb-4756-9a62-30965e3057dd tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:26.801424 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-620c4b1d-78bb-4756-9a62-30965e3057dd tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:26.803879 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-60fb4f2e-432a-4ec3-ad12-e67abdf3fc7f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:26.807829 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-620c4b1d-78bb-4756-9a62-30965e3057dd tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:26.808298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-620c4b1d-78bb-4756-9a62-30965e3057dd tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:26.809057 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-620c4b1d-78bb-4756-9a62-30965e3057dd tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:26.809496 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-620c4b1d-78bb-4756-9a62-30965e3057dd tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:26.811810 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-60fb4f2e-432a-4ec3-ad12-e67abdf3fc7f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.152410 Apr 05 11:52:26.812447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 176/308] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:26 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:26.945371 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-620c4b1d-78bb-4756-9a62-30965e3057dd tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:26.953314 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-620c4b1d-78bb-4756-9a62-30965e3057dd tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1553 microversion: 2.1 time: 0.157161 Apr 05 11:52:26.953890 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 133/309] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:26 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:52:27.337767 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5af45b53-53d4-4301-99d6-5f1fd1d6a5fb tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:27.338996 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5af45b53-53d4-4301-99d6-5f1fd1d6a5fb tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:27.352327 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5af45b53-53d4-4301-99d6-5f1fd1d6a5fb tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:27.352959 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5af45b53-53d4-4301-99d6-5f1fd1d6a5fb tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:27.354391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5af45b53-53d4-4301-99d6-5f1fd1d6a5fb tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:27.355094 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5af45b53-53d4-4301-99d6-5f1fd1d6a5fb tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:27.828629 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e460b3a7-72e3-4a86-8543-715893040c81 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:27.829241 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e460b3a7-72e3-4a86-8543-715893040c81 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:27.836476 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e460b3a7-72e3-4a86-8543-715893040c81 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:27.836923 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e460b3a7-72e3-4a86-8543-715893040c81 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:27.837699 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e460b3a7-72e3-4a86-8543-715893040c81 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:27.838152 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e460b3a7-72e3-4a86-8543-715893040c81 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:27.867472 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5af45b53-53d4-4301-99d6-5f1fd1d6a5fb tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:27.876807 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5af45b53-53d4-4301-99d6-5f1fd1d6a5fb tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1312 microversion: 2.1 time: 0.546276 Apr 05 11:52:27.877368 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 177/310] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:27 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1312 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:27.975138 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-20db6252-00ac-4ce3-9468-37505d38ee42 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:27.976043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-20db6252-00ac-4ce3-9468-37505d38ee42 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:27.983139 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-20db6252-00ac-4ce3-9468-37505d38ee42 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:27.983762 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-20db6252-00ac-4ce3-9468-37505d38ee42 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:27.985391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-20db6252-00ac-4ce3-9468-37505d38ee42 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:27.986057 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-20db6252-00ac-4ce3-9468-37505d38ee42 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:28.123535 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-20db6252-00ac-4ce3-9468-37505d38ee42 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:28.131596 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-20db6252-00ac-4ce3-9468-37505d38ee42 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1553 microversion: 2.1 time: 0.163031 Apr 05 11:52:28.132159 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 178/311] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:27 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:28.180418 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e460b3a7-72e3-4a86-8543-715893040c81 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:28.187843 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e460b3a7-72e3-4a86-8543-715893040c81 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.363143 Apr 05 11:52:28.188447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 134/312] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:27 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:28.403236 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-e74a02fe-d6f1-4250-8df8-434612218f2c req-47fb145c-4a1e-4004-8eb9-de380f166263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c40921-bbb6-432b-8308-99fd88f854ac", "name": "network-vif-deleted", "tag": "39140efd-8940-42ae-a018-b8973cfd3a44"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:52:28.411513 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-e74a02fe-d6f1-4250-8df8-434612218f2c req-47fb145c-4a1e-4004-8eb9-de380f166263 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:28.411961 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-e74a02fe-d6f1-4250-8df8-434612218f2c req-47fb145c-4a1e-4004-8eb9-de380f166263 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:28.423399 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-e74a02fe-d6f1-4250-8df8-434612218f2c req-47fb145c-4a1e-4004-8eb9-de380f166263 service nova] Creating event network-vif-deleted:39140efd-8940-42ae-a018-b8973cfd3a44 for instance 30c40921-bbb6-432b-8308-99fd88f854ac on hv-cinder-82956 Apr 05 11:52:28.429181 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-e74a02fe-d6f1-4250-8df8-434612218f2c req-47fb145c-4a1e-4004-8eb9-de380f166263 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029616 Apr 05 11:52:28.429805 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 179/313] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:52:28.894066 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-40816f7f-32b2-45f1-ae10-0af564b615a7 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:28.894706 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-40816f7f-32b2-45f1-ae10-0af564b615a7 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:28.904346 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-40816f7f-32b2-45f1-ae10-0af564b615a7 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:28.905954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-40816f7f-32b2-45f1-ae10-0af564b615a7 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:28.906970 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-40816f7f-32b2-45f1-ae10-0af564b615a7 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:28.907509 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-40816f7f-32b2-45f1-ae10-0af564b615a7 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:29.151507 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6d3cca69-c4e4-4d99-a461-2ef1a1107fb4 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:29.152224 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6d3cca69-c4e4-4d99-a461-2ef1a1107fb4 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:29.159139 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6d3cca69-c4e4-4d99-a461-2ef1a1107fb4 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:29.159917 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6d3cca69-c4e4-4d99-a461-2ef1a1107fb4 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:29.160983 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6d3cca69-c4e4-4d99-a461-2ef1a1107fb4 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:29.161781 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6d3cca69-c4e4-4d99-a461-2ef1a1107fb4 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:29.175155 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-40816f7f-32b2-45f1-ae10-0af564b615a7 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:29.184602 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-40816f7f-32b2-45f1-ae10-0af564b615a7 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1496 microversion: 2.1 time: 0.294442 Apr 05 11:52:29.185680 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 135/314] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:28 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1496 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:29.214574 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-64c1d973-e2d1-4c5c-b4fc-27ffa8eb13d1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:29.222108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-64c1d973-e2d1-4c5c-b4fc-27ffa8eb13d1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:29.232927 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64c1d973-e2d1-4c5c-b4fc-27ffa8eb13d1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:29.238694 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64c1d973-e2d1-4c5c-b4fc-27ffa8eb13d1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:29.239648 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64c1d973-e2d1-4c5c-b4fc-27ffa8eb13d1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:29.240219 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64c1d973-e2d1-4c5c-b4fc-27ffa8eb13d1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:29.240653 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6d3cca69-c4e4-4d99-a461-2ef1a1107fb4 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677b8494bd4f4d06b44219b3d1f89ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d637e376f54d94a08bd30f6d5c1a3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:29.251622 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6d3cca69-c4e4-4d99-a461-2ef1a1107fb4 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 200 len: 1346 microversion: 2.1 time: 0.106384 Apr 05 11:52:29.263540 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 180/315] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:29 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 1346 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:52:29.515432 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-64c1d973-e2d1-4c5c-b4fc-27ffa8eb13d1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:29.524358 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-64c1d973-e2d1-4c5c-b4fc-27ffa8eb13d1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.314877 Apr 05 11:52:29.534451 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 136/316] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:29 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:29.847077 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-64037e55-7b3d-4f92-aa21-06fc0e897943 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:29.847569 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-64037e55-7b3d-4f92-aa21-06fc0e897943 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:29.854381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-64037e55-7b3d-4f92-aa21-06fc0e897943 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:29.855105 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-64037e55-7b3d-4f92-aa21-06fc0e897943 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:29.855867 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-64037e55-7b3d-4f92-aa21-06fc0e897943 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:29.856834 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-64037e55-7b3d-4f92-aa21-06fc0e897943 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:29.883314 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-64037e55-7b3d-4f92-aa21-06fc0e897943 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Going to try to terminate instance {{(pid=123358) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:52:29.992262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-64037e55-7b3d-4f92-aa21-06fc0e897943 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 204 len: 0 microversion: 2.1 time: 0.148458 Apr 05 11:52:29.996485 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 181/317] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 11:52:29 2022] DELETE /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:52:30.002188 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7e4f7878-9177-476b-adb3-adbdae4f6318 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:30.002882 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7e4f7878-9177-476b-adb3-adbdae4f6318 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:30.022871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7e4f7878-9177-476b-adb3-adbdae4f6318 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:30.023384 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7e4f7878-9177-476b-adb3-adbdae4f6318 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:30.024291 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7e4f7878-9177-476b-adb3-adbdae4f6318 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:30.024744 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7e4f7878-9177-476b-adb3-adbdae4f6318 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:30.202445 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7e4f7878-9177-476b-adb3-adbdae4f6318 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:30.210152 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7e4f7878-9177-476b-adb3-adbdae4f6318 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1502 microversion: 2.1 time: 0.212512 Apr 05 11:52:30.220196 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 137/318] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:29 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1502 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:30.269238 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b22cdef3-998e-4328-a8ed-b2adfdebc8b9 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:30.270530 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b22cdef3-998e-4328-a8ed-b2adfdebc8b9 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:30.276892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b22cdef3-998e-4328-a8ed-b2adfdebc8b9 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:30.277334 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b22cdef3-998e-4328-a8ed-b2adfdebc8b9 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:30.281534 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b22cdef3-998e-4328-a8ed-b2adfdebc8b9 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:30.281964 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b22cdef3-998e-4328-a8ed-b2adfdebc8b9 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:30.301697 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.wsgi [None req-b22cdef3-998e-4328-a8ed-b2adfdebc8b9 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] HTTP exception thrown: Instance 30c40921-bbb6-432b-8308-99fd88f854ac could not be found. Apr 05 11:52:30.302569 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b22cdef3-998e-4328-a8ed-b2adfdebc8b9 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Returning 404 to user: Instance 30c40921-bbb6-432b-8308-99fd88f854ac could not be found. {{(pid=123358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:52:30.303554 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b22cdef3-998e-4328-a8ed-b2adfdebc8b9 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 404 len: 111 microversion: 2.1 time: 0.038639 Apr 05 11:52:30.304162 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 182/319] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:30 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:52:30.409820 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-309ba136-6b39-4389-80fd-233895df1e2f tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:30.410866 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-309ba136-6b39-4389-80fd-233895df1e2f tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:30.416933 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-309ba136-6b39-4389-80fd-233895df1e2f tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:30.417277 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-309ba136-6b39-4389-80fd-233895df1e2f tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:30.418031 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-309ba136-6b39-4389-80fd-233895df1e2f tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:30.418460 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-309ba136-6b39-4389-80fd-233895df1e2f tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:30.431698 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-309ba136-6b39-4389-80fd-233895df1e2f tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] HTTP exception thrown: Instance 30c40921-bbb6-432b-8308-99fd88f854ac could not be found. Apr 05 11:52:30.432508 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-309ba136-6b39-4389-80fd-233895df1e2f tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Returning 404 to user: Instance 30c40921-bbb6-432b-8308-99fd88f854ac could not be found. {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:52:30.433120 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-309ba136-6b39-4389-80fd-233895df1e2f tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.027287 Apr 05 11:52:30.433895 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 138/320] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:52:30 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac/os-volume_attachments => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:52:30.541747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a23c8eb2-72d4-449d-9385-434ac43b187a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:30.542690 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a23c8eb2-72d4-449d-9385-434ac43b187a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:30.548908 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a23c8eb2-72d4-449d-9385-434ac43b187a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:30.549356 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a23c8eb2-72d4-449d-9385-434ac43b187a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:30.550115 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a23c8eb2-72d4-449d-9385-434ac43b187a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:30.550618 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a23c8eb2-72d4-449d-9385-434ac43b187a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:30.720842 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a23c8eb2-72d4-449d-9385-434ac43b187a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:30.728340 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a23c8eb2-72d4-449d-9385-434ac43b187a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.190354 Apr 05 11:52:30.729100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 183/321] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:30 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:31.226799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-aeb74aa2-99de-45e1-a73a-2686ddea435b tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:31.227431 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-aeb74aa2-99de-45e1-a73a-2686ddea435b tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:31.234106 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aeb74aa2-99de-45e1-a73a-2686ddea435b tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:31.234554 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aeb74aa2-99de-45e1-a73a-2686ddea435b tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:31.235313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aeb74aa2-99de-45e1-a73a-2686ddea435b tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:31.235773 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aeb74aa2-99de-45e1-a73a-2686ddea435b tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:31.373258 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-aeb74aa2-99de-45e1-a73a-2686ddea435b tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:31.380914 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-aeb74aa2-99de-45e1-a73a-2686ddea435b tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1502 microversion: 2.1 time: 0.157967 Apr 05 11:52:31.381488 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 139/322] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:31 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:31.657818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-13376ce7-b358-4134-9b84-bd6edf763961 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:31.658335 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-13376ce7-b358-4134-9b84-bd6edf763961 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:31.664184 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-13376ce7-b358-4134-9b84-bd6edf763961 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:31.664633 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-13376ce7-b358-4134-9b84-bd6edf763961 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:31.665384 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-13376ce7-b358-4134-9b84-bd6edf763961 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:31.665813 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-13376ce7-b358-4134-9b84-bd6edf763961 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:31.679853 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.wsgi [None req-13376ce7-b358-4134-9b84-bd6edf763961 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] HTTP exception thrown: Instance 30c40921-bbb6-432b-8308-99fd88f854ac could not be found. Apr 05 11:52:31.680509 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-13376ce7-b358-4134-9b84-bd6edf763961 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Returning 404 to user: Instance 30c40921-bbb6-432b-8308-99fd88f854ac could not be found. {{(pid=123358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:52:31.681322 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-13376ce7-b358-4134-9b84-bd6edf763961 tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "DELETE /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 404 len: 111 microversion: 2.1 time: 0.027406 Apr 05 11:52:31.681864 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 184/323] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 11:52:31 2022] DELETE /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:52:31.689836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e5853369-1b8d-4e77-b9ef-66109198994c tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:31.690441 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e5853369-1b8d-4e77-b9ef-66109198994c tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] [instance: 30c40921-bbb6-432b-8308-99fd88f854ac] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:31.696227 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e5853369-1b8d-4e77-b9ef-66109198994c tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:31.696650 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e5853369-1b8d-4e77-b9ef-66109198994c tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:31.697398 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e5853369-1b8d-4e77-b9ef-66109198994c tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:31.697851 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e5853369-1b8d-4e77-b9ef-66109198994c tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:31.711003 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-e5853369-1b8d-4e77-b9ef-66109198994c tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] HTTP exception thrown: Instance 30c40921-bbb6-432b-8308-99fd88f854ac could not be found. Apr 05 11:52:31.711583 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e5853369-1b8d-4e77-b9ef-66109198994c tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] Returning 404 to user: Instance 30c40921-bbb6-432b-8308-99fd88f854ac could not be found. {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:52:31.712415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e5853369-1b8d-4e77-b9ef-66109198994c tempest-DeleteServersTestJSON-1715735579 tempest-DeleteServersTestJSON-1715735579-project] 10.222.0.61 "GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac" status: 404 len: 111 microversion: 2.1 time: 0.026420 Apr 05 11:52:31.712957 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 140/324] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:31 2022] GET /compute/v2.1/servers/30c40921-bbb6-432b-8308-99fd88f854ac => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:52:31.746307 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e79a3512-2654-4498-ad28-8c707df804ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:31.746959 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e79a3512-2654-4498-ad28-8c707df804ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:31.756987 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e79a3512-2654-4498-ad28-8c707df804ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:31.757479 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e79a3512-2654-4498-ad28-8c707df804ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:31.758627 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e79a3512-2654-4498-ad28-8c707df804ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:31.759132 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e79a3512-2654-4498-ad28-8c707df804ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:31.997314 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e79a3512-2654-4498-ad28-8c707df804ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:32.004964 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e79a3512-2654-4498-ad28-8c707df804ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.262686 Apr 05 11:52:32.005530 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 185/325] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:31 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:32.401348 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-764153e6-0641-4967-8e42-e677a11b4866 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:32.402208 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-764153e6-0641-4967-8e42-e677a11b4866 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:32.408960 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-764153e6-0641-4967-8e42-e677a11b4866 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:32.409621 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-764153e6-0641-4967-8e42-e677a11b4866 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:32.410406 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-764153e6-0641-4967-8e42-e677a11b4866 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:32.411015 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-764153e6-0641-4967-8e42-e677a11b4866 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:32.630318 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-764153e6-0641-4967-8e42-e677a11b4866 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:32.637738 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-764153e6-0641-4967-8e42-e677a11b4866 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1502 microversion: 2.1 time: 0.240468 Apr 05 11:52:32.638520 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 141/326] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:32 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1502 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:52:33.021261 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e366ad20-9031-4a5f-bd92-4fe5f53cb499 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:33.022495 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e366ad20-9031-4a5f-bd92-4fe5f53cb499 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:33.028937 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e366ad20-9031-4a5f-bd92-4fe5f53cb499 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:33.029313 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e366ad20-9031-4a5f-bd92-4fe5f53cb499 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:33.030265 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e366ad20-9031-4a5f-bd92-4fe5f53cb499 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:33.031011 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e366ad20-9031-4a5f-bd92-4fe5f53cb499 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:33.225296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e366ad20-9031-4a5f-bd92-4fe5f53cb499 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:33.233221 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e366ad20-9031-4a5f-bd92-4fe5f53cb499 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.215832 Apr 05 11:52:33.233778 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 186/327] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:33 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:33.659131 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3ec4e9d4-4d05-4586-b177-50c32f145aaf tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:33.659736 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3ec4e9d4-4d05-4586-b177-50c32f145aaf tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:33.665962 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3ec4e9d4-4d05-4586-b177-50c32f145aaf tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:33.666394 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3ec4e9d4-4d05-4586-b177-50c32f145aaf tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:33.667149 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3ec4e9d4-4d05-4586-b177-50c32f145aaf tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:33.667638 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3ec4e9d4-4d05-4586-b177-50c32f145aaf tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:33.804968 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3ec4e9d4-4d05-4586-b177-50c32f145aaf tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:33.812884 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3ec4e9d4-4d05-4586-b177-50c32f145aaf tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1502 microversion: 2.1 time: 0.157779 Apr 05 11:52:33.813887 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 142/328] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:33 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:52:34.250661 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ef9763cf-6893-4d85-b134-bcf65047b830 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:34.251391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ef9763cf-6893-4d85-b134-bcf65047b830 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:34.257506 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ef9763cf-6893-4d85-b134-bcf65047b830 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:34.257944 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ef9763cf-6893-4d85-b134-bcf65047b830 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:34.258696 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ef9763cf-6893-4d85-b134-bcf65047b830 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:34.259117 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ef9763cf-6893-4d85-b134-bcf65047b830 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:34.410277 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ef9763cf-6893-4d85-b134-bcf65047b830 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:34.418058 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ef9763cf-6893-4d85-b134-bcf65047b830 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.171652 Apr 05 11:52:34.420429 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 187/329] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:34 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:34.830028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-53694a25-034d-44b9-92f8-9a9c4c99f4f8 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:34.831273 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-53694a25-034d-44b9-92f8-9a9c4c99f4f8 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:34.837957 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-53694a25-034d-44b9-92f8-9a9c4c99f4f8 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:34.838564 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-53694a25-034d-44b9-92f8-9a9c4c99f4f8 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:34.839481 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-53694a25-034d-44b9-92f8-9a9c4c99f4f8 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:34.840061 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-53694a25-034d-44b9-92f8-9a9c4c99f4f8 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:35.003973 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-53694a25-034d-44b9-92f8-9a9c4c99f4f8 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:35.011942 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-53694a25-034d-44b9-92f8-9a9c4c99f4f8 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1502 microversion: 2.1 time: 0.185618 Apr 05 11:52:35.012661 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 143/330] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:34 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1502 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:35.436522 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a4be664e-9546-4db4-bdec-924eee85cbf8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:35.437888 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a4be664e-9546-4db4-bdec-924eee85cbf8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:35.445040 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a4be664e-9546-4db4-bdec-924eee85cbf8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:35.445950 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a4be664e-9546-4db4-bdec-924eee85cbf8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:35.447170 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a4be664e-9546-4db4-bdec-924eee85cbf8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:35.447854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a4be664e-9546-4db4-bdec-924eee85cbf8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:35.599253 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a4be664e-9546-4db4-bdec-924eee85cbf8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:35.607640 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a4be664e-9546-4db4-bdec-924eee85cbf8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.176689 Apr 05 11:52:35.608230 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 188/331] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:35 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:36.029716 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5163e0c3-645b-4260-8fca-f241c39c7587 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:36.030455 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5163e0c3-645b-4260-8fca-f241c39c7587 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:36.036521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5163e0c3-645b-4260-8fca-f241c39c7587 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:36.037284 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5163e0c3-645b-4260-8fca-f241c39c7587 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:36.038262 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5163e0c3-645b-4260-8fca-f241c39c7587 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:36.038961 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5163e0c3-645b-4260-8fca-f241c39c7587 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:36.179384 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5163e0c3-645b-4260-8fca-f241c39c7587 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:36.187041 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5163e0c3-645b-4260-8fca-f241c39c7587 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1502 microversion: 2.1 time: 0.161579 Apr 05 11:52:36.187619 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 144/332] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:36 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:36.624458 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ff611889-d218-4c35-94ec-06d7ac900667 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:36.625709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ff611889-d218-4c35-94ec-06d7ac900667 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:36.631759 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ff611889-d218-4c35-94ec-06d7ac900667 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:36.632620 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ff611889-d218-4c35-94ec-06d7ac900667 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:36.633942 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ff611889-d218-4c35-94ec-06d7ac900667 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:36.634583 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ff611889-d218-4c35-94ec-06d7ac900667 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:36.860263 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ff611889-d218-4c35-94ec-06d7ac900667 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:36.875886 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ff611889-d218-4c35-94ec-06d7ac900667 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.255811 Apr 05 11:52:36.876802 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 189/333] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:36 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:37.204059 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6267d259-f9e6-49a9-a253-c3ff3cca171c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:37.204963 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6267d259-f9e6-49a9-a253-c3ff3cca171c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:37.211776 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6267d259-f9e6-49a9-a253-c3ff3cca171c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:37.212274 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6267d259-f9e6-49a9-a253-c3ff3cca171c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:37.213077 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6267d259-f9e6-49a9-a253-c3ff3cca171c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:37.213497 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6267d259-f9e6-49a9-a253-c3ff3cca171c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:37.294493 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6267d259-f9e6-49a9-a253-c3ff3cca171c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:37.304543 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6267d259-f9e6-49a9-a253-c3ff3cca171c tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1460 microversion: 2.1 time: 0.104254 Apr 05 11:52:37.305056 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 145/334] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:37 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1460 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:37.332774 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-5cf22d21-412e-49da-8b6d-71fde7b168e1 req-f412f6fc-80cc-4518-9616-d47e4cbe2b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a367d561-192f-425f-b13a-b6b4c1c7df6c", "name": "network-vif-deleted", "tag": "5be9ce97-7c72-4967-b97d-c11b277d5394"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:52:37.342127 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-5cf22d21-412e-49da-8b6d-71fde7b168e1 req-f412f6fc-80cc-4518-9616-d47e4cbe2b79 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:37.342558 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-5cf22d21-412e-49da-8b6d-71fde7b168e1 req-f412f6fc-80cc-4518-9616-d47e4cbe2b79 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:37.354710 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-5cf22d21-412e-49da-8b6d-71fde7b168e1 req-f412f6fc-80cc-4518-9616-d47e4cbe2b79 service nova] Creating event network-vif-deleted:5be9ce97-7c72-4967-b97d-c11b277d5394 for instance a367d561-192f-425f-b13a-b6b4c1c7df6c on hv-cinder-82956 Apr 05 11:52:37.360246 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-5cf22d21-412e-49da-8b6d-71fde7b168e1 req-f412f6fc-80cc-4518-9616-d47e4cbe2b79 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032362 Apr 05 11:52:37.360837 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 190/335] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:52:37.893746 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8c185926-7f18-4725-a134-a008eee70c3a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:37.894428 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8c185926-7f18-4725-a134-a008eee70c3a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:37.900798 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c185926-7f18-4725-a134-a008eee70c3a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:37.901361 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c185926-7f18-4725-a134-a008eee70c3a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:37.902251 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c185926-7f18-4725-a134-a008eee70c3a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:37.902525 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c185926-7f18-4725-a134-a008eee70c3a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:38.036944 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8c185926-7f18-4725-a134-a008eee70c3a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:38.044294 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8c185926-7f18-4725-a134-a008eee70c3a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.154459 Apr 05 11:52:38.045111 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 146/336] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:37 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:38.322668 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0f640c0b-cfd8-48cc-a567-eb2b839755cb tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:38.323337 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0f640c0b-cfd8-48cc-a567-eb2b839755cb tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:38.329850 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0f640c0b-cfd8-48cc-a567-eb2b839755cb tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:38.330258 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0f640c0b-cfd8-48cc-a567-eb2b839755cb tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:38.331022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0f640c0b-cfd8-48cc-a567-eb2b839755cb tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:38.331450 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0f640c0b-cfd8-48cc-a567-eb2b839755cb tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:38.362009 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0f640c0b-cfd8-48cc-a567-eb2b839755cb tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:38.362456 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0f640c0b-cfd8-48cc-a567-eb2b839755cb tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:38.362960 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.objects.instance [None req-0f640c0b-cfd8-48cc-a567-eb2b839755cb tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lazy-loading 'fault' on Instance uuid a367d561-192f-425f-b13a-b6b4c1c7df6c {{(pid=123358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:52:38.405586 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0f640c0b-cfd8-48cc-a567-eb2b839755cb tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:38.413188 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0f640c0b-cfd8-48cc-a567-eb2b839755cb tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1302 microversion: 2.1 time: 0.094819 Apr 05 11:52:38.413764 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 191/337] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:38 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1302 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:39.061658 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1cb1692f-e2b0-4aa8-81d3-c11e5b154c3d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:39.062250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1cb1692f-e2b0-4aa8-81d3-c11e5b154c3d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:39.070270 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1cb1692f-e2b0-4aa8-81d3-c11e5b154c3d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:39.070720 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1cb1692f-e2b0-4aa8-81d3-c11e5b154c3d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:39.071466 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1cb1692f-e2b0-4aa8-81d3-c11e5b154c3d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:39.071887 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1cb1692f-e2b0-4aa8-81d3-c11e5b154c3d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:39.202966 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1cb1692f-e2b0-4aa8-81d3-c11e5b154c3d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:39.210442 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1cb1692f-e2b0-4aa8-81d3-c11e5b154c3d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.152677 Apr 05 11:52:39.211012 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 147/338] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:39 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:39.430284 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4f414c5e-4ba6-4253-8f8d-23d738c81ed2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:39.430846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4f414c5e-4ba6-4253-8f8d-23d738c81ed2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:39.437058 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f414c5e-4ba6-4253-8f8d-23d738c81ed2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:39.437507 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f414c5e-4ba6-4253-8f8d-23d738c81ed2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:39.438270 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f414c5e-4ba6-4253-8f8d-23d738c81ed2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:39.438697 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f414c5e-4ba6-4253-8f8d-23d738c81ed2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:39.467945 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f414c5e-4ba6-4253-8f8d-23d738c81ed2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:39.468420 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f414c5e-4ba6-4253-8f8d-23d738c81ed2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:39.468855 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.objects.instance [None req-4f414c5e-4ba6-4253-8f8d-23d738c81ed2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lazy-loading 'fault' on Instance uuid a367d561-192f-425f-b13a-b6b4c1c7df6c {{(pid=123358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:52:39.509148 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4f414c5e-4ba6-4253-8f8d-23d738c81ed2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:39.516819 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4f414c5e-4ba6-4253-8f8d-23d738c81ed2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1302 microversion: 2.1 time: 0.090433 Apr 05 11:52:39.517513 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 192/339] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:39 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1302 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:40.227149 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c16800ea-59ce-42c0-93ec-656931625e55 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:40.227757 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c16800ea-59ce-42c0-93ec-656931625e55 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:40.234459 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c16800ea-59ce-42c0-93ec-656931625e55 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:40.234882 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c16800ea-59ce-42c0-93ec-656931625e55 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:40.235643 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c16800ea-59ce-42c0-93ec-656931625e55 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:40.236089 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c16800ea-59ce-42c0-93ec-656931625e55 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:40.379077 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c16800ea-59ce-42c0-93ec-656931625e55 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:40.387371 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c16800ea-59ce-42c0-93ec-656931625e55 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.164047 Apr 05 11:52:40.387943 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 148/340] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:40 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:40.534048 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-90e651f6-2699-49d8-b8b7-241d2ab58cef tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:40.534577 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-90e651f6-2699-49d8-b8b7-241d2ab58cef tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:40.540556 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90e651f6-2699-49d8-b8b7-241d2ab58cef tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:40.541000 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90e651f6-2699-49d8-b8b7-241d2ab58cef tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:40.541783 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90e651f6-2699-49d8-b8b7-241d2ab58cef tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:40.542206 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90e651f6-2699-49d8-b8b7-241d2ab58cef tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:40.577408 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90e651f6-2699-49d8-b8b7-241d2ab58cef tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:40.577849 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90e651f6-2699-49d8-b8b7-241d2ab58cef tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:40.578284 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.objects.instance [None req-90e651f6-2699-49d8-b8b7-241d2ab58cef tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lazy-loading 'fault' on Instance uuid a367d561-192f-425f-b13a-b6b4c1c7df6c {{(pid=123358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:52:40.619020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-90e651f6-2699-49d8-b8b7-241d2ab58cef tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:40.626423 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-90e651f6-2699-49d8-b8b7-241d2ab58cef tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 200 len: 1302 microversion: 2.1 time: 0.096237 Apr 05 11:52:40.627023 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 193/341] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:40 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 1302 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:41.404931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c7a48382-4849-4fb6-9635-b07771c6e66a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:41.405304 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c7a48382-4849-4fb6-9635-b07771c6e66a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:41.411679 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c7a48382-4849-4fb6-9635-b07771c6e66a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:41.412136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c7a48382-4849-4fb6-9635-b07771c6e66a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:41.412954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c7a48382-4849-4fb6-9635-b07771c6e66a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:41.413396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c7a48382-4849-4fb6-9635-b07771c6e66a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:41.555167 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c7a48382-4849-4fb6-9635-b07771c6e66a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:41.563193 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c7a48382-4849-4fb6-9635-b07771c6e66a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.163131 Apr 05 11:52:41.564006 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 149/342] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:41 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:41.643141 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8a85699c-91f3-4342-ac9f-99e172e6ddcd tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:41.643927 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8a85699c-91f3-4342-ac9f-99e172e6ddcd tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: a367d561-192f-425f-b13a-b6b4c1c7df6c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:41.650448 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8a85699c-91f3-4342-ac9f-99e172e6ddcd tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:41.650960 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8a85699c-91f3-4342-ac9f-99e172e6ddcd tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:41.651943 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8a85699c-91f3-4342-ac9f-99e172e6ddcd tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:41.652462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8a85699c-91f3-4342-ac9f-99e172e6ddcd tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:41.666053 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.wsgi [None req-8a85699c-91f3-4342-ac9f-99e172e6ddcd tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] HTTP exception thrown: Instance a367d561-192f-425f-b13a-b6b4c1c7df6c could not be found. Apr 05 11:52:41.666630 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8a85699c-91f3-4342-ac9f-99e172e6ddcd tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Returning 404 to user: Instance a367d561-192f-425f-b13a-b6b4c1c7df6c could not be found. {{(pid=123358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:52:41.667433 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8a85699c-91f3-4342-ac9f-99e172e6ddcd tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c" status: 404 len: 111 microversion: 2.1 time: 0.028193 Apr 05 11:52:41.668141 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 194/343] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:41 2022] GET /compute/v2.1/servers/a367d561-192f-425f-b13a-b6b4c1c7df6c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:52:41.769586 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2994c71d-6c23-4b83-9244-0c89fdea65ed tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1476954759", "imageRef": "2b657785-cb0b-43ba-956c-1564c27fd10a", "flavorRef": "452", "networks": [{"uuid": "fe38ead3-de1a-4598-9c4f-98d57d249c1e"}]}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:52:41.819276 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.network.neutron [None req-2994c71d-6c23-4b83-9244-0c89fdea65ed tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] validate_networks() for [('fe38ead3-de1a-4598-9c4f-98d57d249c1e', None, None, None, None, None)] {{(pid=123357) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:52:42.247086 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-2994c71d-6c23-4b83-9244-0c89fdea65ed tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Flavor limits 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:52:42.247512 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-2994c71d-6c23-4b83-9244-0c89fdea65ed tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Image limits 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:52:42.248366 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-2994c71d-6c23-4b83-9244-0c89fdea65ed tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Flavor pref 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:52:42.248770 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-2994c71d-6c23-4b83-9244-0c89fdea65ed tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Image pref 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:52:42.249171 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-2994c71d-6c23-4b83-9244-0c89fdea65ed tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:52:42.258823 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2994c71d-6c23-4b83-9244-0c89fdea65ed tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:42.259265 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2994c71d-6c23-4b83-9244-0c89fdea65ed tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:42.260056 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2994c71d-6c23-4b83-9244-0c89fdea65ed tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:42.260508 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2994c71d-6c23-4b83-9244-0c89fdea65ed tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:42.277137 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-2994c71d-6c23-4b83-9244-0c89fdea65ed tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Getting quotas for project 0d972b47694842bea4274943bdfd9ede. Resources: {'ram', 'instances', 'cores'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:52:42.281551 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-2994c71d-6c23-4b83-9244-0c89fdea65ed tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Getting quotas for user 06e3ebdc00fd49ce9350df9efa29e199 and project 0d972b47694842bea4274943bdfd9ede. Resources: {'ram', 'instances', 'cores'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:52:42.292708 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2994c71d-6c23-4b83-9244-0c89fdea65ed tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Going to run 1 instances... {{(pid=123357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:52:42.295022 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2994c71d-6c23-4b83-9244-0c89fdea65ed tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: 0af7353c-a074-4385-9ade-28a9bcbf1e2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b657785-cb0b-43ba-956c-1564c27fd10a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:52:42.339719 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2994c71d-6c23-4b83-9244-0c89fdea65ed tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573922 Apr 05 11:52:42.340489 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 150/344] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Apr 5 11:52:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:52:42.350857 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8f0e0aed-fc73-4a48-97f7-30712ea0ab0b tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:42.351574 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8f0e0aed-fc73-4a48-97f7-30712ea0ab0b tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: 0af7353c-a074-4385-9ade-28a9bcbf1e2c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:42.419683 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8f0e0aed-fc73-4a48-97f7-30712ea0ab0b tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:42.426366 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8f0e0aed-fc73-4a48-97f7-30712ea0ab0b tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c" status: 200 len: 1214 microversion: 2.1 time: 0.079641 Apr 05 11:52:42.426932 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 195/345] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:42 2022] GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:42.584025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fd10034f-c6ef-40dc-9bcc-65094b447167 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:42.584770 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fd10034f-c6ef-40dc-9bcc-65094b447167 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:42.591471 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd10034f-c6ef-40dc-9bcc-65094b447167 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:42.591995 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd10034f-c6ef-40dc-9bcc-65094b447167 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:42.593002 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd10034f-c6ef-40dc-9bcc-65094b447167 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:42.593643 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd10034f-c6ef-40dc-9bcc-65094b447167 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:42.760374 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fd10034f-c6ef-40dc-9bcc-65094b447167 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:42.793837 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fd10034f-c6ef-40dc-9bcc-65094b447167 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.191760 Apr 05 11:52:42.796690 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 151/346] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:42 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:43.446934 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c07b8565-148e-4f9c-9260-a930c8d76204 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:43.447619 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c07b8565-148e-4f9c-9260-a930c8d76204 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: 0af7353c-a074-4385-9ade-28a9bcbf1e2c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:43.454096 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c07b8565-148e-4f9c-9260-a930c8d76204 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:43.454603 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c07b8565-148e-4f9c-9260-a930c8d76204 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:43.455364 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c07b8565-148e-4f9c-9260-a930c8d76204 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:43.455784 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c07b8565-148e-4f9c-9260-a930c8d76204 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:43.523242 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c07b8565-148e-4f9c-9260-a930c8d76204 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:43.531069 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c07b8565-148e-4f9c-9260-a930c8d76204 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c" status: 200 len: 1266 microversion: 2.1 time: 0.088894 Apr 05 11:52:43.531644 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 196/347] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:43 2022] GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:52:43.814133 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f353ba87-0da4-482a-a9fb-8b4d4db9f054 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:43.814942 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f353ba87-0da4-482a-a9fb-8b4d4db9f054 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:43.822862 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f353ba87-0da4-482a-a9fb-8b4d4db9f054 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:43.823404 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f353ba87-0da4-482a-a9fb-8b4d4db9f054 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:43.824344 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f353ba87-0da4-482a-a9fb-8b4d4db9f054 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:43.825104 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f353ba87-0da4-482a-a9fb-8b4d4db9f054 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:43.987345 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f353ba87-0da4-482a-a9fb-8b4d4db9f054 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:43.996891 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f353ba87-0da4-482a-a9fb-8b4d4db9f054 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.188040 Apr 05 11:52:43.997568 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 152/348] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:43 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:44.548334 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-15070f53-31f8-4590-b9f2-2809fe0d0026 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:44.548941 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-15070f53-31f8-4590-b9f2-2809fe0d0026 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: 0af7353c-a074-4385-9ade-28a9bcbf1e2c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:44.555099 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-15070f53-31f8-4590-b9f2-2809fe0d0026 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:44.555561 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-15070f53-31f8-4590-b9f2-2809fe0d0026 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:44.556360 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-15070f53-31f8-4590-b9f2-2809fe0d0026 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:44.556792 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-15070f53-31f8-4590-b9f2-2809fe0d0026 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:44.699669 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-15070f53-31f8-4590-b9f2-2809fe0d0026 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:44.705361 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-15070f53-31f8-4590-b9f2-2809fe0d0026 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c" status: 200 len: 1314 microversion: 2.1 time: 0.160870 Apr 05 11:52:44.705926 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 197/349] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:44 2022] GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:45.014203 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ec57ef1c-2e8e-4680-8b92-9a3beac0eba4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:45.014819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ec57ef1c-2e8e-4680-8b92-9a3beac0eba4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:45.021665 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec57ef1c-2e8e-4680-8b92-9a3beac0eba4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:45.022121 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec57ef1c-2e8e-4680-8b92-9a3beac0eba4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:45.022908 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec57ef1c-2e8e-4680-8b92-9a3beac0eba4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:45.023319 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec57ef1c-2e8e-4680-8b92-9a3beac0eba4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:45.157909 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ec57ef1c-2e8e-4680-8b92-9a3beac0eba4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:45.165400 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ec57ef1c-2e8e-4680-8b92-9a3beac0eba4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.155209 Apr 05 11:52:45.165964 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 153/350] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:45 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:45.726621 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cf2cb604-fcfa-4a93-b2c3-bb1fa99fe5e2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:45.727709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cf2cb604-fcfa-4a93-b2c3-bb1fa99fe5e2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: 0af7353c-a074-4385-9ade-28a9bcbf1e2c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:45.738030 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cf2cb604-fcfa-4a93-b2c3-bb1fa99fe5e2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:45.738451 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cf2cb604-fcfa-4a93-b2c3-bb1fa99fe5e2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:45.739257 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cf2cb604-fcfa-4a93-b2c3-bb1fa99fe5e2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:45.739686 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cf2cb604-fcfa-4a93-b2c3-bb1fa99fe5e2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:45.986816 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cf2cb604-fcfa-4a93-b2c3-bb1fa99fe5e2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:45.994727 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cf2cb604-fcfa-4a93-b2c3-bb1fa99fe5e2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c" status: 200 len: 1314 microversion: 2.1 time: 0.274677 Apr 05 11:52:45.995304 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 198/351] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:45 2022] GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:46.182849 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a248ba84-dd01-4559-b184-181a5c8555ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:46.183478 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a248ba84-dd01-4559-b184-181a5c8555ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:46.191267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a248ba84-dd01-4559-b184-181a5c8555ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:46.191267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a248ba84-dd01-4559-b184-181a5c8555ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:46.191969 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a248ba84-dd01-4559-b184-181a5c8555ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:46.192478 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a248ba84-dd01-4559-b184-181a5c8555ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:46.327863 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a248ba84-dd01-4559-b184-181a5c8555ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:46.335751 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a248ba84-dd01-4559-b184-181a5c8555ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.156820 Apr 05 11:52:46.336418 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 154/352] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:46 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:46.349681 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-be918282-874d-4553-93d1-ebfa462a5175 req-b94a68d9-7bc9-4c2b-add2-451eced81d22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0af7353c-a074-4385-9ade-28a9bcbf1e2c", "tag": "773fe886-7ea6-42c0-99a1-0a4014959f83"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:52:46.357953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-be918282-874d-4553-93d1-ebfa462a5175 req-b94a68d9-7bc9-4c2b-add2-451eced81d22 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:46.358379 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-be918282-874d-4553-93d1-ebfa462a5175 req-b94a68d9-7bc9-4c2b-add2-451eced81d22 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:46.370198 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-be918282-874d-4553-93d1-ebfa462a5175 req-b94a68d9-7bc9-4c2b-add2-451eced81d22 service nova] Creating event network-changed:773fe886-7ea6-42c0-99a1-0a4014959f83 for instance 0af7353c-a074-4385-9ade-28a9bcbf1e2c on hv-cinder-82956 Apr 05 11:52:46.374941 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-be918282-874d-4553-93d1-ebfa462a5175 req-b94a68d9-7bc9-4c2b-add2-451eced81d22 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029067 Apr 05 11:52:46.375527 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 199/353] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:52:47.012093 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6cde535a-9355-44ba-92a7-0bc39327aae2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:47.012805 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6cde535a-9355-44ba-92a7-0bc39327aae2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: 0af7353c-a074-4385-9ade-28a9bcbf1e2c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:47.019016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6cde535a-9355-44ba-92a7-0bc39327aae2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:47.019519 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6cde535a-9355-44ba-92a7-0bc39327aae2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:47.020325 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6cde535a-9355-44ba-92a7-0bc39327aae2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:47.020756 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6cde535a-9355-44ba-92a7-0bc39327aae2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:47.154792 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6cde535a-9355-44ba-92a7-0bc39327aae2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:47.162141 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6cde535a-9355-44ba-92a7-0bc39327aae2 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c" status: 200 len: 1314 microversion: 2.1 time: 0.154017 Apr 05 11:52:47.162685 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 155/354] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:47 2022] GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:47.354046 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4e60e280-567e-4842-8c51-f905b8d8e277 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:47.354984 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4e60e280-567e-4842-8c51-f905b8d8e277 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:47.362851 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e60e280-567e-4842-8c51-f905b8d8e277 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:47.363287 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e60e280-567e-4842-8c51-f905b8d8e277 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:47.364056 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e60e280-567e-4842-8c51-f905b8d8e277 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:47.364508 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e60e280-567e-4842-8c51-f905b8d8e277 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:47.821638 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4e60e280-567e-4842-8c51-f905b8d8e277 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:47.829663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4e60e280-567e-4842-8c51-f905b8d8e277 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.480018 Apr 05 11:52:47.830230 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 200/355] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:47 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:48.180837 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ad894607-aa60-4469-ab04-2603e3b549ff tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:48.181456 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ad894607-aa60-4469-ab04-2603e3b549ff tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: 0af7353c-a074-4385-9ade-28a9bcbf1e2c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:48.202658 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ad894607-aa60-4469-ab04-2603e3b549ff tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:48.203101 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ad894607-aa60-4469-ab04-2603e3b549ff tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:48.203895 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ad894607-aa60-4469-ab04-2603e3b549ff tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:48.204361 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ad894607-aa60-4469-ab04-2603e3b549ff tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:48.369473 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ad894607-aa60-4469-ab04-2603e3b549ff tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:48.377225 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ad894607-aa60-4469-ab04-2603e3b549ff tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c" status: 200 len: 1314 microversion: 2.1 time: 0.202313 Apr 05 11:52:48.377798 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 156/356] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:48 2022] GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:48.847445 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8bf8d660-5c43-4e8b-ab5b-8f5a37563105 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:48.848161 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8bf8d660-5c43-4e8b-ab5b-8f5a37563105 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:48.854311 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8bf8d660-5c43-4e8b-ab5b-8f5a37563105 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:48.854813 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8bf8d660-5c43-4e8b-ab5b-8f5a37563105 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:48.856036 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8bf8d660-5c43-4e8b-ab5b-8f5a37563105 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:48.856501 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8bf8d660-5c43-4e8b-ab5b-8f5a37563105 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:48.998245 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8bf8d660-5c43-4e8b-ab5b-8f5a37563105 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:49.007639 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8bf8d660-5c43-4e8b-ab5b-8f5a37563105 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.164055 Apr 05 11:52:49.008270 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 201/357] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:48 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:49.396626 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-50f05e3f-e50b-4954-8484-3b12b81f204f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:49.397239 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-50f05e3f-e50b-4954-8484-3b12b81f204f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: 0af7353c-a074-4385-9ade-28a9bcbf1e2c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:49.405592 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-50f05e3f-e50b-4954-8484-3b12b81f204f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:49.406089 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-50f05e3f-e50b-4954-8484-3b12b81f204f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:49.406940 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-50f05e3f-e50b-4954-8484-3b12b81f204f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:49.407419 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-50f05e3f-e50b-4954-8484-3b12b81f204f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:49.541875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-50f05e3f-e50b-4954-8484-3b12b81f204f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:49.549662 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-50f05e3f-e50b-4954-8484-3b12b81f204f tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c" status: 200 len: 1314 microversion: 2.1 time: 0.159325 Apr 05 11:52:49.550336 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 157/358] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:49 2022] GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:50.026978 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-aaebb8c8-dd61-4dcc-8d1d-5804f01931df tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:50.027759 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-aaebb8c8-dd61-4dcc-8d1d-5804f01931df tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:50.035472 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aaebb8c8-dd61-4dcc-8d1d-5804f01931df tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:50.035919 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aaebb8c8-dd61-4dcc-8d1d-5804f01931df tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:50.036709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aaebb8c8-dd61-4dcc-8d1d-5804f01931df tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:50.037137 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aaebb8c8-dd61-4dcc-8d1d-5804f01931df tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:50.181551 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-aaebb8c8-dd61-4dcc-8d1d-5804f01931df tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:50.188987 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-aaebb8c8-dd61-4dcc-8d1d-5804f01931df tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.167301 Apr 05 11:52:50.189575 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 202/359] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:50 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:50.571685 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a5b32e53-35c9-4e2e-ba43-43aa982a3527 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:50.572327 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a5b32e53-35c9-4e2e-ba43-43aa982a3527 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: 0af7353c-a074-4385-9ade-28a9bcbf1e2c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:50.578707 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a5b32e53-35c9-4e2e-ba43-43aa982a3527 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:50.579155 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a5b32e53-35c9-4e2e-ba43-43aa982a3527 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:50.579910 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a5b32e53-35c9-4e2e-ba43-43aa982a3527 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:50.580370 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a5b32e53-35c9-4e2e-ba43-43aa982a3527 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:50.722634 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a5b32e53-35c9-4e2e-ba43-43aa982a3527 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:50.730794 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a5b32e53-35c9-4e2e-ba43-43aa982a3527 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c" status: 200 len: 1314 microversion: 2.1 time: 0.162572 Apr 05 11:52:50.731353 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 158/360] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:50 2022] GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:51.206159 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-55978642-8b27-4729-a987-a221ac939282 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:51.206890 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-55978642-8b27-4729-a987-a221ac939282 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:51.212980 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-55978642-8b27-4729-a987-a221ac939282 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:51.213421 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-55978642-8b27-4729-a987-a221ac939282 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:51.214168 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-55978642-8b27-4729-a987-a221ac939282 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:51.214592 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-55978642-8b27-4729-a987-a221ac939282 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:51.350575 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-55978642-8b27-4729-a987-a221ac939282 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:51.359344 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-55978642-8b27-4729-a987-a221ac939282 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.157097 Apr 05 11:52:51.359947 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 203/361] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:51 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:51.749069 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cf1fa10f-e750-400d-b16b-9ece39c51569 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:51.749683 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cf1fa10f-e750-400d-b16b-9ece39c51569 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: 0af7353c-a074-4385-9ade-28a9bcbf1e2c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:51.756123 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cf1fa10f-e750-400d-b16b-9ece39c51569 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:51.756577 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cf1fa10f-e750-400d-b16b-9ece39c51569 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:51.757334 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cf1fa10f-e750-400d-b16b-9ece39c51569 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:51.757765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cf1fa10f-e750-400d-b16b-9ece39c51569 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:51.899383 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-cf1fa10f-e750-400d-b16b-9ece39c51569 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:51.910187 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cf1fa10f-e750-400d-b16b-9ece39c51569 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c" status: 200 len: 1314 microversion: 2.1 time: 0.164784 Apr 05 11:52:51.910881 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 159/362] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:51 2022] GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:52.378220 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9dc2f93f-ebe4-458b-8fbe-2ce2e256e8f8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:52.379694 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9dc2f93f-ebe4-458b-8fbe-2ce2e256e8f8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:52.393158 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9dc2f93f-ebe4-458b-8fbe-2ce2e256e8f8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:52.393940 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9dc2f93f-ebe4-458b-8fbe-2ce2e256e8f8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:52.395011 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9dc2f93f-ebe4-458b-8fbe-2ce2e256e8f8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:52.395668 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9dc2f93f-ebe4-458b-8fbe-2ce2e256e8f8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:52.576663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9dc2f93f-ebe4-458b-8fbe-2ce2e256e8f8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:52.583961 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9dc2f93f-ebe4-458b-8fbe-2ce2e256e8f8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.210479 Apr 05 11:52:52.584747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 204/363] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:52 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:52.927095 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-617d4f02-724f-4bc9-aecd-583b8b55d146 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:52.928102 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-617d4f02-724f-4bc9-aecd-583b8b55d146 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: 0af7353c-a074-4385-9ade-28a9bcbf1e2c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:52.934899 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-617d4f02-724f-4bc9-aecd-583b8b55d146 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:52.935425 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-617d4f02-724f-4bc9-aecd-583b8b55d146 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:52.936300 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-617d4f02-724f-4bc9-aecd-583b8b55d146 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:52.936791 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-617d4f02-724f-4bc9-aecd-583b8b55d146 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:53.024609 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-99f1f879-d46e-49d1-990e-6667c6934542 req-1973f0f9-1df6-47a6-81ff-b940390b2a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af7353c-a074-4385-9ade-28a9bcbf1e2c", "name": "network-vif-plugged", "status": "completed", "tag": "773fe886-7ea6-42c0-99a1-0a4014959f83"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:52:53.033135 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-99f1f879-d46e-49d1-990e-6667c6934542 req-1973f0f9-1df6-47a6-81ff-b940390b2a6e service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:53.033727 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-99f1f879-d46e-49d1-990e-6667c6934542 req-1973f0f9-1df6-47a6-81ff-b940390b2a6e service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:53.046034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-99f1f879-d46e-49d1-990e-6667c6934542 req-1973f0f9-1df6-47a6-81ff-b940390b2a6e service nova] Creating event network-vif-plugged:773fe886-7ea6-42c0-99a1-0a4014959f83 for instance 0af7353c-a074-4385-9ade-28a9bcbf1e2c on hv-cinder-82956 Apr 05 11:52:53.052516 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-99f1f879-d46e-49d1-990e-6667c6934542 req-1973f0f9-1df6-47a6-81ff-b940390b2a6e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031470 Apr 05 11:52:53.053800 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 205/364] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:52:53.088733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-617d4f02-724f-4bc9-aecd-583b8b55d146 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:53.098498 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-617d4f02-724f-4bc9-aecd-583b8b55d146 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c" status: 200 len: 1314 microversion: 2.1 time: 0.175301 Apr 05 11:52:53.112144 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 160/365] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:52 2022] GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:53.603689 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-94bd6e22-d50d-4169-a8de-c0cdc2f9a67c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:53.604359 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-94bd6e22-d50d-4169-a8de-c0cdc2f9a67c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:53.611091 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94bd6e22-d50d-4169-a8de-c0cdc2f9a67c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:53.611532 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94bd6e22-d50d-4169-a8de-c0cdc2f9a67c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:53.612461 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94bd6e22-d50d-4169-a8de-c0cdc2f9a67c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:53.612801 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94bd6e22-d50d-4169-a8de-c0cdc2f9a67c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:53.771057 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-94bd6e22-d50d-4169-a8de-c0cdc2f9a67c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:53.781185 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-94bd6e22-d50d-4169-a8de-c0cdc2f9a67c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1522 microversion: 2.1 time: 0.181580 Apr 05 11:52:53.782574 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 206/366] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:53 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:54.116739 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f9054414-82ea-49bb-adda-0ce8887bcd68 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:54.118316 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f9054414-82ea-49bb-adda-0ce8887bcd68 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: 0af7353c-a074-4385-9ade-28a9bcbf1e2c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:54.125036 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f9054414-82ea-49bb-adda-0ce8887bcd68 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:54.125930 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f9054414-82ea-49bb-adda-0ce8887bcd68 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:54.127024 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f9054414-82ea-49bb-adda-0ce8887bcd68 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:54.127541 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f9054414-82ea-49bb-adda-0ce8887bcd68 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:54.262214 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f9054414-82ea-49bb-adda-0ce8887bcd68 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:54.269819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f9054414-82ea-49bb-adda-0ce8887bcd68 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c" status: 200 len: 1314 microversion: 2.1 time: 0.157092 Apr 05 11:52:54.270388 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 161/367] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:54 2022] GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:54.801404 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7b317047-c386-4d2e-9721-15c0fcbd7a2b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:54.802109 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7b317047-c386-4d2e-9721-15c0fcbd7a2b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:54.808825 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b317047-c386-4d2e-9721-15c0fcbd7a2b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:54.809271 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b317047-c386-4d2e-9721-15c0fcbd7a2b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:54.810097 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b317047-c386-4d2e-9721-15c0fcbd7a2b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:54.810556 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b317047-c386-4d2e-9721-15c0fcbd7a2b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:54.943487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7b317047-c386-4d2e-9721-15c0fcbd7a2b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:54.950792 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7b317047-c386-4d2e-9721-15c0fcbd7a2b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1502 microversion: 2.1 time: 0.153407 Apr 05 11:52:54.951359 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 207/368] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:54 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:54.966958 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a552f1ca-8590-4a9b-9d4d-94b1344528c1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:54.967593 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a552f1ca-8590-4a9b-9d4d-94b1344528c1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:54.973361 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a552f1ca-8590-4a9b-9d4d-94b1344528c1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:54.973802 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a552f1ca-8590-4a9b-9d4d-94b1344528c1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:54.974560 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a552f1ca-8590-4a9b-9d4d-94b1344528c1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:54.974988 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a552f1ca-8590-4a9b-9d4d-94b1344528c1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:55.110162 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a552f1ca-8590-4a9b-9d4d-94b1344528c1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:55.117533 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a552f1ca-8590-4a9b-9d4d-94b1344528c1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1514 microversion: 2.1 time: 0.154538 Apr 05 11:52:55.118115 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 162/369] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:54 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:55.287217 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-064f4a3b-c985-4422-8138-fb5f519421bd tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:55.288177 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-064f4a3b-c985-4422-8138-fb5f519421bd tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: 0af7353c-a074-4385-9ade-28a9bcbf1e2c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:55.294015 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-064f4a3b-c985-4422-8138-fb5f519421bd tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:55.294599 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-064f4a3b-c985-4422-8138-fb5f519421bd tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:55.295361 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-064f4a3b-c985-4422-8138-fb5f519421bd tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:55.295793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-064f4a3b-c985-4422-8138-fb5f519421bd tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:55.466902 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-064f4a3b-c985-4422-8138-fb5f519421bd tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:55.475113 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-064f4a3b-c985-4422-8138-fb5f519421bd tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c" status: 200 len: 1314 microversion: 2.1 time: 0.192145 Apr 05 11:52:55.475803 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 208/370] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:55 2022] GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:56.480345 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d78a2296-7362-4a5c-81c1-9b5491db2c5c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:52:56.481387 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d78a2296-7362-4a5c-81c1-9b5491db2c5c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:56.488363 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d78a2296-7362-4a5c-81c1-9b5491db2c5c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:56.488851 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d78a2296-7362-4a5c-81c1-9b5491db2c5c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:56.489632 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d78a2296-7362-4a5c-81c1-9b5491db2c5c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:56.490064 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d78a2296-7362-4a5c-81c1-9b5491db2c5c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:56.493087 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c82e6060-c564-4e19-bf02-95b387befded tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:56.493727 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c82e6060-c564-4e19-bf02-95b387befded tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: 0af7353c-a074-4385-9ade-28a9bcbf1e2c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:56.500130 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c82e6060-c564-4e19-bf02-95b387befded tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:56.500609 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c82e6060-c564-4e19-bf02-95b387befded tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:56.501370 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c82e6060-c564-4e19-bf02-95b387befded tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:56.501799 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c82e6060-c564-4e19-bf02-95b387befded tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:56.514672 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.objects.instance [None req-d78a2296-7362-4a5c-81c1-9b5491db2c5c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lazy-loading 'flavor' on Instance uuid 590c9148-99a5-4120-8b46-235860f6eca2 {{(pid=123357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:52:56.627529 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d78a2296-7362-4a5c-81c1-9b5491db2c5c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "POST /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2/action" status: 200 len: 32 microversion: 2.1 time: 0.151471 Apr 05 11:52:56.632171 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 163/371] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Apr 5 11:52:56 2022] POST /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2/action => generated 32 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 11:52:56.636716 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c82e6060-c564-4e19-bf02-95b387befded tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:56.638483 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c1596bca-8283-430a-8f3a-f5dcf2a11580 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:56.639329 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c1596bca-8283-430a-8f3a-f5dcf2a11580 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:56.644301 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c82e6060-c564-4e19-bf02-95b387befded tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c" status: 200 len: 1499 microversion: 2.1 time: 0.155165 Apr 05 11:52:56.644868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 209/372] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:56 2022] GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c => generated 1499 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:56.645584 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1596bca-8283-430a-8f3a-f5dcf2a11580 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:56.646028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1596bca-8283-430a-8f3a-f5dcf2a11580 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:56.646798 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1596bca-8283-430a-8f3a-f5dcf2a11580 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:56.647230 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1596bca-8283-430a-8f3a-f5dcf2a11580 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:56.782655 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c1596bca-8283-430a-8f3a-f5dcf2a11580 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:56.790340 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c1596bca-8283-430a-8f3a-f5dcf2a11580 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.156791 Apr 05 11:52:56.790913 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 164/373] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:56 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:52:57.226389 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8e31f614-81d8-4bf6-8809-e9e6661e10d0 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:57.227044 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8e31f614-81d8-4bf6-8809-e9e6661e10d0 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: 0af7353c-a074-4385-9ade-28a9bcbf1e2c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:57.233646 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e31f614-81d8-4bf6-8809-e9e6661e10d0 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:57.234092 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e31f614-81d8-4bf6-8809-e9e6661e10d0 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:57.234829 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e31f614-81d8-4bf6-8809-e9e6661e10d0 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:57.235254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e31f614-81d8-4bf6-8809-e9e6661e10d0 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:57.259345 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8e31f614-81d8-4bf6-8809-e9e6661e10d0 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: 0af7353c-a074-4385-9ade-28a9bcbf1e2c] Going to try to terminate instance {{(pid=123358) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:52:57.337106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8e31f614-81d8-4bf6-8809-e9e6661e10d0 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c" status: 204 len: 0 microversion: 2.1 time: 0.114245 Apr 05 11:52:57.338088 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 210/374] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 11:52:57 2022] DELETE /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:52:57.346081 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1a554771-d659-4c4a-9645-46c33772f233 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:57.346890 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1a554771-d659-4c4a-9645-46c33772f233 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: 0af7353c-a074-4385-9ade-28a9bcbf1e2c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:57.362963 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1a554771-d659-4c4a-9645-46c33772f233 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:57.363474 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1a554771-d659-4c4a-9645-46c33772f233 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:57.364845 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1a554771-d659-4c4a-9645-46c33772f233 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:57.365264 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1a554771-d659-4c4a-9645-46c33772f233 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:57.511496 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1a554771-d659-4c4a-9645-46c33772f233 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:57.519028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1a554771-d659-4c4a-9645-46c33772f233 tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c" status: 200 len: 1505 microversion: 2.1 time: 0.176642 Apr 05 11:52:57.519645 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 165/375] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:57 2022] GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c => generated 1505 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:57.809163 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-887d73b3-8087-4c09-ba98-a5ef64925ede tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:57.809792 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-887d73b3-8087-4c09-ba98-a5ef64925ede tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:57.816451 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-887d73b3-8087-4c09-ba98-a5ef64925ede tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:57.816896 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-887d73b3-8087-4c09-ba98-a5ef64925ede tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:57.817651 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-887d73b3-8087-4c09-ba98-a5ef64925ede tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:57.818074 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-887d73b3-8087-4c09-ba98-a5ef64925ede tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:57.953021 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-887d73b3-8087-4c09-ba98-a5ef64925ede tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:57.961292 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-887d73b3-8087-4c09-ba98-a5ef64925ede tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.156918 Apr 05 11:52:57.961869 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 211/376] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:57 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:58.537357 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-22c07def-e3d7-4851-b9b6-e2735f53329a tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:58.538031 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-22c07def-e3d7-4851-b9b6-e2735f53329a tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: 0af7353c-a074-4385-9ade-28a9bcbf1e2c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:58.545004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-22c07def-e3d7-4851-b9b6-e2735f53329a tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:58.545375 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-22c07def-e3d7-4851-b9b6-e2735f53329a tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:58.546109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-22c07def-e3d7-4851-b9b6-e2735f53329a tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:58.546546 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-22c07def-e3d7-4851-b9b6-e2735f53329a tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:58.680815 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-22c07def-e3d7-4851-b9b6-e2735f53329a tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:58.688218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-22c07def-e3d7-4851-b9b6-e2735f53329a tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c" status: 200 len: 1505 microversion: 2.1 time: 0.155171 Apr 05 11:52:58.688777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 166/377] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:58 2022] GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:58.978955 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8efc0986-81a0-4a10-a7ab-b803cc099da1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:58.979546 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8efc0986-81a0-4a10-a7ab-b803cc099da1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:58.985921 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8efc0986-81a0-4a10-a7ab-b803cc099da1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:58.986368 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8efc0986-81a0-4a10-a7ab-b803cc099da1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:58.987113 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8efc0986-81a0-4a10-a7ab-b803cc099da1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:58.987546 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8efc0986-81a0-4a10-a7ab-b803cc099da1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:59.166675 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8efc0986-81a0-4a10-a7ab-b803cc099da1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:59.174470 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8efc0986-81a0-4a10-a7ab-b803cc099da1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.199417 Apr 05 11:52:59.175408 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 212/378] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:58 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:52:59.705729 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-dd259d54-af8e-4cb4-8bc8-9e46c493a51a tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:52:59.706335 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-dd259d54-af8e-4cb4-8bc8-9e46c493a51a tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: 0af7353c-a074-4385-9ade-28a9bcbf1e2c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:52:59.713646 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd259d54-af8e-4cb4-8bc8-9e46c493a51a tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:59.714151 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd259d54-af8e-4cb4-8bc8-9e46c493a51a tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:59.714969 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd259d54-af8e-4cb4-8bc8-9e46c493a51a tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:52:59.715404 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd259d54-af8e-4cb4-8bc8-9e46c493a51a tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:52:59.874640 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-dd259d54-af8e-4cb4-8bc8-9e46c493a51a tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:52:59.882804 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-dd259d54-af8e-4cb4-8bc8-9e46c493a51a tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c" status: 200 len: 1505 microversion: 2.1 time: 0.180978 Apr 05 11:52:59.883384 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 167/379] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:52:59 2022] GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c => generated 1505 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:00.191934 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-90411d4b-8507-4c5f-99d7-b9339c1f67f6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:00.192445 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-90411d4b-8507-4c5f-99d7-b9339c1f67f6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:00.199003 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90411d4b-8507-4c5f-99d7-b9339c1f67f6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:00.199439 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90411d4b-8507-4c5f-99d7-b9339c1f67f6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:00.200229 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90411d4b-8507-4c5f-99d7-b9339c1f67f6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:00.200638 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90411d4b-8507-4c5f-99d7-b9339c1f67f6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:00.421519 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-90411d4b-8507-4c5f-99d7-b9339c1f67f6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:00.428826 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-90411d4b-8507-4c5f-99d7-b9339c1f67f6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.240819 Apr 05 11:53:00.429632 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 213/380] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:00 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:00.771465 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-b29890f3-8fd6-4260-8fe6-c8d9674cce3f req-e132e4e3-c4da-43cc-a224-bc1fbdb6552e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af7353c-a074-4385-9ade-28a9bcbf1e2c", "name": "network-vif-deleted", "tag": "773fe886-7ea6-42c0-99a1-0a4014959f83"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:53:00.779876 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-b29890f3-8fd6-4260-8fe6-c8d9674cce3f req-e132e4e3-c4da-43cc-a224-bc1fbdb6552e service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:00.780343 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-b29890f3-8fd6-4260-8fe6-c8d9674cce3f req-e132e4e3-c4da-43cc-a224-bc1fbdb6552e service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:00.792354 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-b29890f3-8fd6-4260-8fe6-c8d9674cce3f req-e132e4e3-c4da-43cc-a224-bc1fbdb6552e service nova] Creating event network-vif-deleted:773fe886-7ea6-42c0-99a1-0a4014959f83 for instance 0af7353c-a074-4385-9ade-28a9bcbf1e2c on hv-cinder-82956 Apr 05 11:53:00.797256 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-b29890f3-8fd6-4260-8fe6-c8d9674cce3f req-e132e4e3-c4da-43cc-a224-bc1fbdb6552e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029589 Apr 05 11:53:00.797858 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 168/381] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:53:00.902415 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2392cd0e-10d9-4050-9415-052a58311cec tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:00.903295 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2392cd0e-10d9-4050-9415-052a58311cec tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: 0af7353c-a074-4385-9ade-28a9bcbf1e2c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:00.909554 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2392cd0e-10d9-4050-9415-052a58311cec tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:00.909999 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2392cd0e-10d9-4050-9415-052a58311cec tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:00.910770 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2392cd0e-10d9-4050-9415-052a58311cec tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:00.912135 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2392cd0e-10d9-4050-9415-052a58311cec tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:00.944727 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2392cd0e-10d9-4050-9415-052a58311cec tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:00.945175 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2392cd0e-10d9-4050-9415-052a58311cec tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:00.945619 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.objects.instance [None req-2392cd0e-10d9-4050-9415-052a58311cec tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lazy-loading 'fault' on Instance uuid 0af7353c-a074-4385-9ade-28a9bcbf1e2c {{(pid=123358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:53:00.984360 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2392cd0e-10d9-4050-9415-052a58311cec tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e3ebdc00fd49ce9350df9efa29e199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d972b47694842bea4274943bdfd9ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:00.991903 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2392cd0e-10d9-4050-9415-052a58311cec tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c" status: 200 len: 1304 microversion: 2.1 time: 0.096185 Apr 05 11:53:00.992478 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 214/382] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:00 2022] GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:01.447639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2de5aee3-0dff-4de2-afe8-e541fd7cd88f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:01.448432 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2de5aee3-0dff-4de2-afe8-e541fd7cd88f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:01.455279 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2de5aee3-0dff-4de2-afe8-e541fd7cd88f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:01.455723 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2de5aee3-0dff-4de2-afe8-e541fd7cd88f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:01.456835 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2de5aee3-0dff-4de2-afe8-e541fd7cd88f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:01.457451 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2de5aee3-0dff-4de2-afe8-e541fd7cd88f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:01.593547 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2de5aee3-0dff-4de2-afe8-e541fd7cd88f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:01.600848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2de5aee3-0dff-4de2-afe8-e541fd7cd88f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.158329 Apr 05 11:53:01.601427 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 169/383] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:01 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:02.011047 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f200c6bb-6288-42a0-93d3-ad60074af8ec tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:02.011865 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f200c6bb-6288-42a0-93d3-ad60074af8ec tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] [instance: 0af7353c-a074-4385-9ade-28a9bcbf1e2c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:02.019927 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f200c6bb-6288-42a0-93d3-ad60074af8ec tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:02.020563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f200c6bb-6288-42a0-93d3-ad60074af8ec tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:02.021405 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f200c6bb-6288-42a0-93d3-ad60074af8ec tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:02.021881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f200c6bb-6288-42a0-93d3-ad60074af8ec tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:02.039309 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.wsgi [None req-f200c6bb-6288-42a0-93d3-ad60074af8ec tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] HTTP exception thrown: Instance 0af7353c-a074-4385-9ade-28a9bcbf1e2c could not be found. Apr 05 11:53:02.039896 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f200c6bb-6288-42a0-93d3-ad60074af8ec tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] Returning 404 to user: Instance 0af7353c-a074-4385-9ade-28a9bcbf1e2c could not be found. {{(pid=123358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:53:02.040719 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f200c6bb-6288-42a0-93d3-ad60074af8ec tempest-VolumesActionsTest-1152474734 tempest-VolumesActionsTest-1152474734-project] 10.222.0.61 "GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c" status: 404 len: 111 microversion: 2.1 time: 0.035365 Apr 05 11:53:02.041212 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 215/384] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:02 2022] GET /compute/v2.1/servers/0af7353c-a074-4385-9ade-28a9bcbf1e2c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:53:02.618889 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-33ac5838-70cf-43f2-9421-9beaaf1a2412 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:02.619476 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-33ac5838-70cf-43f2-9421-9beaaf1a2412 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:02.626332 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-33ac5838-70cf-43f2-9421-9beaaf1a2412 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:02.626777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-33ac5838-70cf-43f2-9421-9beaaf1a2412 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:02.627508 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-33ac5838-70cf-43f2-9421-9beaaf1a2412 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:02.627953 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-33ac5838-70cf-43f2-9421-9beaaf1a2412 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:02.770692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-33ac5838-70cf-43f2-9421-9beaaf1a2412 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:02.779990 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-33ac5838-70cf-43f2-9421-9beaaf1a2412 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.163226 Apr 05 11:53:02.779990 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 170/385] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:02 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:03.798443 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8acfdc87-f6f1-4129-bef0-e5f58fd0770e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:03.799042 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8acfdc87-f6f1-4129-bef0-e5f58fd0770e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:03.805439 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8acfdc87-f6f1-4129-bef0-e5f58fd0770e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:03.805879 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8acfdc87-f6f1-4129-bef0-e5f58fd0770e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:03.806626 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8acfdc87-f6f1-4129-bef0-e5f58fd0770e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:03.807050 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8acfdc87-f6f1-4129-bef0-e5f58fd0770e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:03.943128 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8acfdc87-f6f1-4129-bef0-e5f58fd0770e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:03.954263 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8acfdc87-f6f1-4129-bef0-e5f58fd0770e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.161764 Apr 05 11:53:03.955026 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 216/386] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:03 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:04.975890 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6c5fd45f-95c1-4c92-bbfb-5f8f9a2e2aff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:04.976613 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6c5fd45f-95c1-4c92-bbfb-5f8f9a2e2aff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:04.984425 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6c5fd45f-95c1-4c92-bbfb-5f8f9a2e2aff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:04.984914 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6c5fd45f-95c1-4c92-bbfb-5f8f9a2e2aff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:04.985747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6c5fd45f-95c1-4c92-bbfb-5f8f9a2e2aff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:04.986218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6c5fd45f-95c1-4c92-bbfb-5f8f9a2e2aff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:05.122437 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6c5fd45f-95c1-4c92-bbfb-5f8f9a2e2aff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:05.129759 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6c5fd45f-95c1-4c92-bbfb-5f8f9a2e2aff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.160306 Apr 05 11:53:05.130296 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 171/387] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:04 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:06.151263 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e2447073-7de2-42d6-b673-bc967d05b1b2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:06.152342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e2447073-7de2-42d6-b673-bc967d05b1b2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:06.162039 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e2447073-7de2-42d6-b673-bc967d05b1b2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:06.162776 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e2447073-7de2-42d6-b673-bc967d05b1b2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:06.164067 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e2447073-7de2-42d6-b673-bc967d05b1b2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:06.164835 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e2447073-7de2-42d6-b673-bc967d05b1b2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:06.315619 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e2447073-7de2-42d6-b673-bc967d05b1b2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:06.323529 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e2447073-7de2-42d6-b673-bc967d05b1b2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.178789 Apr 05 11:53:06.324108 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 217/388] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:06 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:07.345254 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-df912bef-600a-4241-af09-ee6cb26c3b8a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:07.346176 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-df912bef-600a-4241-af09-ee6cb26c3b8a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:07.357229 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-df912bef-600a-4241-af09-ee6cb26c3b8a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:07.357966 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-df912bef-600a-4241-af09-ee6cb26c3b8a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:07.359218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-df912bef-600a-4241-af09-ee6cb26c3b8a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:07.359944 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-df912bef-600a-4241-af09-ee6cb26c3b8a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:07.502600 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-df912bef-600a-4241-af09-ee6cb26c3b8a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:07.510286 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-df912bef-600a-4241-af09-ee6cb26c3b8a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.171600 Apr 05 11:53:07.510854 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 172/389] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:07 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:08.528107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4e0c2ba1-d0ae-4621-a045-e95a61e2c02e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:08.528739 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4e0c2ba1-d0ae-4621-a045-e95a61e2c02e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:08.535727 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e0c2ba1-d0ae-4621-a045-e95a61e2c02e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:08.536383 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e0c2ba1-d0ae-4621-a045-e95a61e2c02e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:08.537302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e0c2ba1-d0ae-4621-a045-e95a61e2c02e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:08.537745 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e0c2ba1-d0ae-4621-a045-e95a61e2c02e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:08.671393 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4e0c2ba1-d0ae-4621-a045-e95a61e2c02e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:08.678773 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4e0c2ba1-d0ae-4621-a045-e95a61e2c02e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.155524 Apr 05 11:53:08.679529 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 218/390] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:08 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:09.697133 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-25e54e00-b5e6-46d9-a0ab-a00c6b7adac5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:09.697942 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-25e54e00-b5e6-46d9-a0ab-a00c6b7adac5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:09.705392 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-25e54e00-b5e6-46d9-a0ab-a00c6b7adac5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:09.706121 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-25e54e00-b5e6-46d9-a0ab-a00c6b7adac5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:09.707146 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-25e54e00-b5e6-46d9-a0ab-a00c6b7adac5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:09.707574 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-25e54e00-b5e6-46d9-a0ab-a00c6b7adac5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:09.889000 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-25e54e00-b5e6-46d9-a0ab-a00c6b7adac5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:09.910985 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-25e54e00-b5e6-46d9-a0ab-a00c6b7adac5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.217488 Apr 05 11:53:09.911980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 173/391] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:09 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:53:10.931364 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7f5ac340-4df8-40f7-82fa-9cf7b964cd37 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:10.934511 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7f5ac340-4df8-40f7-82fa-9cf7b964cd37 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:10.944289 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7f5ac340-4df8-40f7-82fa-9cf7b964cd37 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:10.945346 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7f5ac340-4df8-40f7-82fa-9cf7b964cd37 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:10.947638 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7f5ac340-4df8-40f7-82fa-9cf7b964cd37 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:10.948678 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7f5ac340-4df8-40f7-82fa-9cf7b964cd37 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:11.183428 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7f5ac340-4df8-40f7-82fa-9cf7b964cd37 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:11.193560 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7f5ac340-4df8-40f7-82fa-9cf7b964cd37 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.267906 Apr 05 11:53:11.195949 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 219/392] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:10 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:53:12.217747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-adb84d7e-3329-4dcf-aefb-9d775c799ee6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:12.219392 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-adb84d7e-3329-4dcf-aefb-9d775c799ee6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:12.228338 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-adb84d7e-3329-4dcf-aefb-9d775c799ee6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:12.229777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-adb84d7e-3329-4dcf-aefb-9d775c799ee6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:12.230855 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-adb84d7e-3329-4dcf-aefb-9d775c799ee6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:12.231726 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-adb84d7e-3329-4dcf-aefb-9d775c799ee6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:12.412693 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-adb84d7e-3329-4dcf-aefb-9d775c799ee6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:12.423322 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-adb84d7e-3329-4dcf-aefb-9d775c799ee6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.213540 Apr 05 11:53:12.423938 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 174/393] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:12 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:13.440938 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6f0391f1-bdc4-44c8-bf5a-4a745701adc6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:13.442287 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6f0391f1-bdc4-44c8-bf5a-4a745701adc6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:13.451080 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f0391f1-bdc4-44c8-bf5a-4a745701adc6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:13.451640 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f0391f1-bdc4-44c8-bf5a-4a745701adc6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:13.452519 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f0391f1-bdc4-44c8-bf5a-4a745701adc6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:13.453130 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f0391f1-bdc4-44c8-bf5a-4a745701adc6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:13.605850 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6f0391f1-bdc4-44c8-bf5a-4a745701adc6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:13.613353 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6f0391f1-bdc4-44c8-bf5a-4a745701adc6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.176686 Apr 05 11:53:13.613923 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 220/394] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:13 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:14.630896 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5235d2c5-9226-4d45-9019-f5ef65663c6a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:14.632372 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5235d2c5-9226-4d45-9019-f5ef65663c6a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:14.639208 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5235d2c5-9226-4d45-9019-f5ef65663c6a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:14.639887 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5235d2c5-9226-4d45-9019-f5ef65663c6a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:14.640651 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5235d2c5-9226-4d45-9019-f5ef65663c6a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:14.641287 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5235d2c5-9226-4d45-9019-f5ef65663c6a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:15.022873 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5235d2c5-9226-4d45-9019-f5ef65663c6a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:15.031032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5235d2c5-9226-4d45-9019-f5ef65663c6a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.404014 Apr 05 11:53:15.031809 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 175/395] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:14 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:16.048331 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7b78c3b9-793c-4b69-a425-7d00646391cf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:16.049735 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7b78c3b9-793c-4b69-a425-7d00646391cf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:16.056291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b78c3b9-793c-4b69-a425-7d00646391cf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:16.056976 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b78c3b9-793c-4b69-a425-7d00646391cf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:16.057952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b78c3b9-793c-4b69-a425-7d00646391cf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:16.058594 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b78c3b9-793c-4b69-a425-7d00646391cf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:16.205130 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7b78c3b9-793c-4b69-a425-7d00646391cf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:16.213594 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7b78c3b9-793c-4b69-a425-7d00646391cf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.168936 Apr 05 11:53:16.223567 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 221/396] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:16 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:17.231305 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-91d4d588-7e7c-4091-bbe8-85e8267d95ce tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:17.232599 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-91d4d588-7e7c-4091-bbe8-85e8267d95ce tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:17.238978 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-91d4d588-7e7c-4091-bbe8-85e8267d95ce tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:17.239444 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-91d4d588-7e7c-4091-bbe8-85e8267d95ce tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:17.240273 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-91d4d588-7e7c-4091-bbe8-85e8267d95ce tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:17.240744 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-91d4d588-7e7c-4091-bbe8-85e8267d95ce tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:17.373552 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-91d4d588-7e7c-4091-bbe8-85e8267d95ce tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:17.381345 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-91d4d588-7e7c-4091-bbe8-85e8267d95ce tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.154377 Apr 05 11:53:17.390757 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 176/397] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:17 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:18.398757 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f166fd44-1e93-4211-a53c-552075afe2e8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:18.399334 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f166fd44-1e93-4211-a53c-552075afe2e8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:18.406803 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f166fd44-1e93-4211-a53c-552075afe2e8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:18.407289 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f166fd44-1e93-4211-a53c-552075afe2e8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:18.408052 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f166fd44-1e93-4211-a53c-552075afe2e8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:18.408504 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f166fd44-1e93-4211-a53c-552075afe2e8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:18.554114 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f166fd44-1e93-4211-a53c-552075afe2e8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:18.561959 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f166fd44-1e93-4211-a53c-552075afe2e8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.167335 Apr 05 11:53:18.562719 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 222/398] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:18 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:19.580092 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f6dd2f34-834a-452c-b247-e21551dd8cf4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:19.580923 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f6dd2f34-834a-452c-b247-e21551dd8cf4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:19.587992 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f6dd2f34-834a-452c-b247-e21551dd8cf4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:19.588548 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f6dd2f34-834a-452c-b247-e21551dd8cf4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:19.589422 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f6dd2f34-834a-452c-b247-e21551dd8cf4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:19.589956 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f6dd2f34-834a-452c-b247-e21551dd8cf4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:19.732559 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f6dd2f34-834a-452c-b247-e21551dd8cf4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:19.741088 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f6dd2f34-834a-452c-b247-e21551dd8cf4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.165137 Apr 05 11:53:19.753495 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 177/399] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:19 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:20.761357 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d60b38ae-8fb5-4097-bd97-6e848dfb6b91 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:20.762643 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d60b38ae-8fb5-4097-bd97-6e848dfb6b91 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:20.768969 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d60b38ae-8fb5-4097-bd97-6e848dfb6b91 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:20.769686 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d60b38ae-8fb5-4097-bd97-6e848dfb6b91 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:20.770843 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d60b38ae-8fb5-4097-bd97-6e848dfb6b91 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:20.771459 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d60b38ae-8fb5-4097-bd97-6e848dfb6b91 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:20.957230 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d60b38ae-8fb5-4097-bd97-6e848dfb6b91 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:20.966202 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d60b38ae-8fb5-4097-bd97-6e848dfb6b91 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.208938 Apr 05 11:53:20.966812 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 223/400] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:20 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:21.983450 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4ad61a87-10f2-4140-97a2-5e9834fc9843 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:21.984836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4ad61a87-10f2-4140-97a2-5e9834fc9843 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:22.012437 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4ad61a87-10f2-4140-97a2-5e9834fc9843 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:22.013255 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4ad61a87-10f2-4140-97a2-5e9834fc9843 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:22.014084 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4ad61a87-10f2-4140-97a2-5e9834fc9843 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:22.014516 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4ad61a87-10f2-4140-97a2-5e9834fc9843 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:22.163108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4ad61a87-10f2-4140-97a2-5e9834fc9843 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:22.171396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4ad61a87-10f2-4140-97a2-5e9834fc9843 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.192005 Apr 05 11:53:22.181131 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 178/401] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:21 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:23.189026 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-535e4928-8a39-430b-8c60-798be6d9b1d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:23.189604 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-535e4928-8a39-430b-8c60-798be6d9b1d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:23.195641 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-535e4928-8a39-430b-8c60-798be6d9b1d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:23.196089 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-535e4928-8a39-430b-8c60-798be6d9b1d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:23.196849 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-535e4928-8a39-430b-8c60-798be6d9b1d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:23.197269 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-535e4928-8a39-430b-8c60-798be6d9b1d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:23.342397 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-535e4928-8a39-430b-8c60-798be6d9b1d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:23.350118 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-535e4928-8a39-430b-8c60-798be6d9b1d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.165457 Apr 05 11:53:23.350998 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 224/402] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:23 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:24.368225 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ee2de5f2-f257-4ad9-b235-4ab0c5852cbc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:24.368972 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ee2de5f2-f257-4ad9-b235-4ab0c5852cbc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:24.374802 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee2de5f2-f257-4ad9-b235-4ab0c5852cbc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:24.375443 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee2de5f2-f257-4ad9-b235-4ab0c5852cbc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:24.376236 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee2de5f2-f257-4ad9-b235-4ab0c5852cbc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:24.376674 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee2de5f2-f257-4ad9-b235-4ab0c5852cbc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:24.561944 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ee2de5f2-f257-4ad9-b235-4ab0c5852cbc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:24.569483 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ee2de5f2-f257-4ad9-b235-4ab0c5852cbc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.205381 Apr 05 11:53:24.570093 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 179/403] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:24 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:25.590281 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fc89a66d-bb6b-4a19-a1b2-0fe88ba674db tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:25.590868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fc89a66d-bb6b-4a19-a1b2-0fe88ba674db tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:25.597202 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc89a66d-bb6b-4a19-a1b2-0fe88ba674db tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:25.597646 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc89a66d-bb6b-4a19-a1b2-0fe88ba674db tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:25.598405 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc89a66d-bb6b-4a19-a1b2-0fe88ba674db tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:25.598841 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc89a66d-bb6b-4a19-a1b2-0fe88ba674db tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:25.737177 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fc89a66d-bb6b-4a19-a1b2-0fe88ba674db tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:25.744628 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fc89a66d-bb6b-4a19-a1b2-0fe88ba674db tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1500 microversion: 2.1 time: 0.158386 Apr 05 11:53:25.745189 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 225/404] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:25 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1500 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:25.765289 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-46c6fe51-f07f-452b-a639-334194bf89dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ff75137-ced5-444d-bbc0-c60eaba65fb2"}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:53:25.766355 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-46c6fe51-f07f-452b-a639-334194bf89dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:25.772932 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-46c6fe51-f07f-452b-a639-334194bf89dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:25.773356 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-46c6fe51-f07f-452b-a639-334194bf89dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:25.774176 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-46c6fe51-f07f-452b-a639-334194bf89dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:25.774578 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-46c6fe51-f07f-452b-a639-334194bf89dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:25.797066 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-46c6fe51-f07f-452b-a639-334194bf89dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] HTTP exception thrown: Cannot 'attach_volume' instance 590c9148-99a5-4120-8b46-235860f6eca2 while it is in vm_state rescued Apr 05 11:53:25.797644 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-46c6fe51-f07f-452b-a639-334194bf89dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Returning 409 to user: Cannot 'attach_volume' instance 590c9148-99a5-4120-8b46-235860f6eca2 while it is in vm_state rescued {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:53:25.798454 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-46c6fe51-f07f-452b-a639-334194bf89dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "POST /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.037279 Apr 05 11:53:25.798988 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 180/405] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Apr 5 11:53:25 2022] POST /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2/os-volume_attachments => generated 152 bytes in 38 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 05 11:53:25.810349 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1c7e9b18-a600-4c74-8e40-f31d101de7a5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:53:25.811151 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1c7e9b18-a600-4c74-8e40-f31d101de7a5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:25.820385 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1c7e9b18-a600-4c74-8e40-f31d101de7a5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:25.820827 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1c7e9b18-a600-4c74-8e40-f31d101de7a5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:25.821574 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1c7e9b18-a600-4c74-8e40-f31d101de7a5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:25.821997 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1c7e9b18-a600-4c74-8e40-f31d101de7a5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:25.889700 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1c7e9b18-a600-4c74-8e40-f31d101de7a5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "POST /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2/action" status: 202 len: 0 microversion: 2.1 time: 0.085437 Apr 05 11:53:25.890231 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 226/406] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Apr 5 11:53:25 2022] POST /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:53:25.898602 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-599151ce-fccd-4e4c-a5fe-e000d977d3bf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:25.899248 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-599151ce-fccd-4e4c-a5fe-e000d977d3bf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:25.906130 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-599151ce-fccd-4e4c-a5fe-e000d977d3bf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:25.906584 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-599151ce-fccd-4e4c-a5fe-e000d977d3bf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:25.907315 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-599151ce-fccd-4e4c-a5fe-e000d977d3bf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:25.907949 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-599151ce-fccd-4e4c-a5fe-e000d977d3bf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:26.039113 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-599151ce-fccd-4e4c-a5fe-e000d977d3bf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:26.046574 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-599151ce-fccd-4e4c-a5fe-e000d977d3bf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1508 microversion: 2.1 time: 0.151989 Apr 05 11:53:26.047152 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 181/407] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:25 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:27.065262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d97874e4-79b7-40d0-aca6-0ad5f39922bc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:27.065977 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d97874e4-79b7-40d0-aca6-0ad5f39922bc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:27.072379 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d97874e4-79b7-40d0-aca6-0ad5f39922bc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:27.072828 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d97874e4-79b7-40d0-aca6-0ad5f39922bc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:27.073655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d97874e4-79b7-40d0-aca6-0ad5f39922bc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:27.074084 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d97874e4-79b7-40d0-aca6-0ad5f39922bc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:27.206101 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d97874e4-79b7-40d0-aca6-0ad5f39922bc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:27.213430 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d97874e4-79b7-40d0-aca6-0ad5f39922bc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1508 microversion: 2.1 time: 0.152587 Apr 05 11:53:27.213993 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 227/408] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:27 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:53:28.231276 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f387fe91-4332-4226-9ff7-a1ae76b9f6a8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:28.231838 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f387fe91-4332-4226-9ff7-a1ae76b9f6a8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:28.238575 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f387fe91-4332-4226-9ff7-a1ae76b9f6a8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:28.239020 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f387fe91-4332-4226-9ff7-a1ae76b9f6a8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:28.239786 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f387fe91-4332-4226-9ff7-a1ae76b9f6a8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:28.240225 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f387fe91-4332-4226-9ff7-a1ae76b9f6a8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:28.381943 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f387fe91-4332-4226-9ff7-a1ae76b9f6a8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:28.389529 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f387fe91-4332-4226-9ff7-a1ae76b9f6a8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1508 microversion: 2.1 time: 0.162547 Apr 05 11:53:28.390103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 182/409] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:28 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:29.408292 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f12980b9-c2bd-48b3-bff9-9dfebb54af95 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:29.408857 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f12980b9-c2bd-48b3-bff9-9dfebb54af95 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:29.415045 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f12980b9-c2bd-48b3-bff9-9dfebb54af95 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:29.415529 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f12980b9-c2bd-48b3-bff9-9dfebb54af95 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:29.416330 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f12980b9-c2bd-48b3-bff9-9dfebb54af95 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:29.416763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f12980b9-c2bd-48b3-bff9-9dfebb54af95 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:29.558754 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f12980b9-c2bd-48b3-bff9-9dfebb54af95 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:29.566066 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f12980b9-c2bd-48b3-bff9-9dfebb54af95 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1508 microversion: 2.1 time: 0.161714 Apr 05 11:53:29.566810 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 228/410] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:29 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:30.583257 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6fc796ba-a13b-45c7-bccc-8eb3e78260fb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:30.583874 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6fc796ba-a13b-45c7-bccc-8eb3e78260fb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:30.590409 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6fc796ba-a13b-45c7-bccc-8eb3e78260fb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:30.590945 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6fc796ba-a13b-45c7-bccc-8eb3e78260fb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:30.591871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6fc796ba-a13b-45c7-bccc-8eb3e78260fb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:30.592376 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6fc796ba-a13b-45c7-bccc-8eb3e78260fb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:30.778612 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6fc796ba-a13b-45c7-bccc-8eb3e78260fb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:30.786063 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6fc796ba-a13b-45c7-bccc-8eb3e78260fb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1514 microversion: 2.1 time: 0.206991 Apr 05 11:53:30.786769 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 183/411] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:30 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1514 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:32.123862 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9e294488-8048-498a-81d7-e45054273c86 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Action: 'create', calling method: .version_select at 0x7f161c440f70>, body: {"keypair": {"name": "tempest-keypair-229201080"}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:53:32.138285 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-9e294488-8048-498a-81d7-e45054273c86 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Getting quotas for project 08d2f825a8f74e66b348121301942a89. Resources: {'key_pairs'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:53:32.142173 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-9e294488-8048-498a-81d7-e45054273c86 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Getting quotas for user 947e4bea28244cfb8a2b1be51c639815 and project 08d2f825a8f74e66b348121301942a89. Resources: {'key_pairs'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:53:32.297582 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-9e294488-8048-498a-81d7-e45054273c86 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Getting quotas for project 08d2f825a8f74e66b348121301942a89. Resources: {'key_pairs'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:53:32.304480 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-9e294488-8048-498a-81d7-e45054273c86 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Getting quotas for user 947e4bea28244cfb8a2b1be51c639815 and project 08d2f825a8f74e66b348121301942a89. Resources: {'key_pairs'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:53:32.318709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9e294488-8048-498a-81d7-e45054273c86 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.198807 Apr 05 11:53:32.319609 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 229/412] 10.222.0.61 () {60 vars in 1157 bytes} [Tue Apr 5 11:53:32 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:32.559819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0e06b350-2855-4b31-9b7e-4c9cd117d08c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:32.560921 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0e06b350-2855-4b31-9b7e-4c9cd117d08c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:32.567215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0e06b350-2855-4b31-9b7e-4c9cd117d08c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:32.567867 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0e06b350-2855-4b31-9b7e-4c9cd117d08c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:32.568651 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0e06b350-2855-4b31-9b7e-4c9cd117d08c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:32.569232 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0e06b350-2855-4b31-9b7e-4c9cd117d08c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:32.593570 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0e06b350-2855-4b31-9b7e-4c9cd117d08c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/ips" status: 200 len: 147 microversion: 2.1 time: 0.038924 Apr 05 11:53:32.594418 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 184/413] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Apr 5 11:53:32 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:53:33.650527 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ffd53b8d-eea3-4f06-8853-10134c86ace5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1965128593", "imageRef": "2b657785-cb0b-43ba-956c-1564c27fd10a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc0532d2-42df-4cc1-ab69-ba84b5a7e573"}], "security_groups": [{"name": "tempest-securitygroup--344115791"}], "key_name": "tempest-keypair-229201080", "user_data": "}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:53:33.755081 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.network.neutron [None req-ffd53b8d-eea3-4f06-8853-10134c86ace5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] validate_networks() for [('dc0532d2-42df-4cc1-ab69-ba84b5a7e573', None, None, None, None, None)] {{(pid=123358) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:53:33.816925 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-dac911fd-789f-4b3c-b33f-57dde586c469 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1025865873", "imageRef": "2b657785-cb0b-43ba-956c-1564c27fd10a", "flavorRef": "452", "networks": [{"uuid": "a0b4e9ed-dad4-4277-921e-a25e81ebf3d5"}]}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:53:33.868993 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.network.neutron [None req-dac911fd-789f-4b3c-b33f-57dde586c469 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] validate_networks() for [('a0b4e9ed-dad4-4277-921e-a25e81ebf3d5', None, None, None, None, None)] {{(pid=123357) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:53:34.137338 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-ffd53b8d-eea3-4f06-8853-10134c86ace5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Flavor limits 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:53:34.137822 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-ffd53b8d-eea3-4f06-8853-10134c86ace5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Image limits 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:53:34.138402 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-ffd53b8d-eea3-4f06-8853-10134c86ace5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Flavor pref 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:53:34.138883 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-ffd53b8d-eea3-4f06-8853-10134c86ace5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Image pref 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:53:34.139351 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-ffd53b8d-eea3-4f06-8853-10134c86ace5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:53:34.148748 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ffd53b8d-eea3-4f06-8853-10134c86ace5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:34.149186 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ffd53b8d-eea3-4f06-8853-10134c86ace5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:34.149971 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ffd53b8d-eea3-4f06-8853-10134c86ace5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:34.150397 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ffd53b8d-eea3-4f06-8853-10134c86ace5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:34.167390 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-ffd53b8d-eea3-4f06-8853-10134c86ace5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Getting quotas for project 08d2f825a8f74e66b348121301942a89. Resources: {'ram', 'instances', 'cores'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:53:34.171480 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-ffd53b8d-eea3-4f06-8853-10134c86ace5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Getting quotas for user 947e4bea28244cfb8a2b1be51c639815 and project 08d2f825a8f74e66b348121301942a89. Resources: {'ram', 'instances', 'cores'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:53:34.182677 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ffd53b8d-eea3-4f06-8853-10134c86ace5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Going to run 1 instances... {{(pid=123358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:53:34.185123 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ffd53b8d-eea3-4f06-8853-10134c86ace5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b657785-cb0b-43ba-956c-1564c27fd10a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:53:34.221626 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-dac911fd-789f-4b3c-b33f-57dde586c469 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Flavor limits 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:53:34.222045 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-dac911fd-789f-4b3c-b33f-57dde586c469 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Image limits 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:53:34.222518 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-dac911fd-789f-4b3c-b33f-57dde586c469 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Flavor pref 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:53:34.222922 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-dac911fd-789f-4b3c-b33f-57dde586c469 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Image pref 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:53:34.223359 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-dac911fd-789f-4b3c-b33f-57dde586c469 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:53:34.233269 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ffd53b8d-eea3-4f06-8853-10134c86ace5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.586997 Apr 05 11:53:34.233919 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 230/414] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Apr 5 11:53:33 2022] POST /compute/v2.1/servers => generated 408 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:53:34.242006 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dac911fd-789f-4b3c-b33f-57dde586c469 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:34.242437 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dac911fd-789f-4b3c-b33f-57dde586c469 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:34.243280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dac911fd-789f-4b3c-b33f-57dde586c469 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:34.243690 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dac911fd-789f-4b3c-b33f-57dde586c469 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:34.244098 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-178bceea-d8fa-4cbf-8aa3-3dea86e7521b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:34.244777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-178bceea-d8fa-4cbf-8aa3-3dea86e7521b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:34.260727 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-dac911fd-789f-4b3c-b33f-57dde586c469 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Getting quotas for project 400dd74b011a4bbabde6ed53ce0250d3. Resources: {'ram', 'instances', 'cores'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:53:34.264980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-dac911fd-789f-4b3c-b33f-57dde586c469 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Getting quotas for user 7a8653b849b6413283176a098faebb95 and project 400dd74b011a4bbabde6ed53ce0250d3. Resources: {'ram', 'instances', 'cores'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:53:34.276313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-dac911fd-789f-4b3c-b33f-57dde586c469 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Going to run 1 instances... {{(pid=123357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:53:34.278896 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-dac911fd-789f-4b3c-b33f-57dde586c469 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 1a6b36d8-6a9a-421b-bbda-e56342ccca79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b657785-cb0b-43ba-956c-1564c27fd10a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:53:34.302298 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-178bceea-d8fa-4cbf-8aa3-3dea86e7521b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:34.309575 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-178bceea-d8fa-4cbf-8aa3-3dea86e7521b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1245 microversion: 2.1 time: 0.069404 Apr 05 11:53:34.310227 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 231/415] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:34 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1245 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:53:34.339385 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-dac911fd-789f-4b3c-b33f-57dde586c469 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526400 Apr 05 11:53:34.340384 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 185/416] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Apr 5 11:53:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 05 11:53:34.349906 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c599bd11-4f5d-43fb-bcd1-97875eabf946 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:34.350602 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c599bd11-4f5d-43fb-bcd1-97875eabf946 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 1a6b36d8-6a9a-421b-bbda-e56342ccca79] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:34.402071 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c599bd11-4f5d-43fb-bcd1-97875eabf946 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:34.409004 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c599bd11-4f5d-43fb-bcd1-97875eabf946 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79" status: 200 len: 1219 microversion: 2.1 time: 0.062752 Apr 05 11:53:34.409879 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 232/417] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:34 2022] GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79 => generated 1219 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:35.332420 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a179f1f1-20cc-4ce2-a156-7c68ef48dfc6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:35.333438 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a179f1f1-20cc-4ce2-a156-7c68ef48dfc6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:35.342609 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a179f1f1-20cc-4ce2-a156-7c68ef48dfc6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:35.343051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a179f1f1-20cc-4ce2-a156-7c68ef48dfc6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:35.343802 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a179f1f1-20cc-4ce2-a156-7c68ef48dfc6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:35.344257 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a179f1f1-20cc-4ce2-a156-7c68ef48dfc6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:35.413651 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a179f1f1-20cc-4ce2-a156-7c68ef48dfc6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:35.421695 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a179f1f1-20cc-4ce2-a156-7c68ef48dfc6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1297 microversion: 2.1 time: 0.096389 Apr 05 11:53:35.426881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e187c3cc-32b6-4dea-9639-6f8823f2974e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:35.427626 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e187c3cc-32b6-4dea-9639-6f8823f2974e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 1a6b36d8-6a9a-421b-bbda-e56342ccca79] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:35.437208 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 186/418] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:35 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1297 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:35.437382 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e187c3cc-32b6-4dea-9639-6f8823f2974e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:35.437382 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e187c3cc-32b6-4dea-9639-6f8823f2974e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:35.437382 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e187c3cc-32b6-4dea-9639-6f8823f2974e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:35.437382 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e187c3cc-32b6-4dea-9639-6f8823f2974e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:35.504468 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e187c3cc-32b6-4dea-9639-6f8823f2974e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:35.512066 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e187c3cc-32b6-4dea-9639-6f8823f2974e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79" status: 200 len: 1271 microversion: 2.1 time: 0.089345 Apr 05 11:53:35.512691 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 233/419] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:35 2022] GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79 => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:36.445296 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ce8f9aaf-00d7-4e34-9287-32f91a865ea3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:36.445891 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ce8f9aaf-00d7-4e34-9287-32f91a865ea3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:36.452918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ce8f9aaf-00d7-4e34-9287-32f91a865ea3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:36.453334 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ce8f9aaf-00d7-4e34-9287-32f91a865ea3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:36.454138 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ce8f9aaf-00d7-4e34-9287-32f91a865ea3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:36.454587 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ce8f9aaf-00d7-4e34-9287-32f91a865ea3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:36.514671 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ce8f9aaf-00d7-4e34-9287-32f91a865ea3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:36.521859 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ce8f9aaf-00d7-4e34-9287-32f91a865ea3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1303 microversion: 2.1 time: 0.080919 Apr 05 11:53:36.522435 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 187/420] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:36 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1303 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:36.531952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3a8307ec-fd7d-429e-b9ca-dd6e0de6ab3c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:36.531952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3a8307ec-fd7d-429e-b9ca-dd6e0de6ab3c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 1a6b36d8-6a9a-421b-bbda-e56342ccca79] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:36.536324 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a8307ec-fd7d-429e-b9ca-dd6e0de6ab3c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:36.536831 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a8307ec-fd7d-429e-b9ca-dd6e0de6ab3c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:36.537654 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a8307ec-fd7d-429e-b9ca-dd6e0de6ab3c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:36.538140 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a8307ec-fd7d-429e-b9ca-dd6e0de6ab3c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:36.639400 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3a8307ec-fd7d-429e-b9ca-dd6e0de6ab3c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:36.648033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3a8307ec-fd7d-429e-b9ca-dd6e0de6ab3c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79" status: 200 len: 1277 microversion: 2.1 time: 0.122222 Apr 05 11:53:36.648638 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 234/421] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:36 2022] GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79 => generated 1277 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:36.733277 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-019cde6d-1098-4d35-9240-e09679335375 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:36.733768 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-019cde6d-1098-4d35-9240-e09679335375 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:36.739973 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-019cde6d-1098-4d35-9240-e09679335375 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:36.740447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-019cde6d-1098-4d35-9240-e09679335375 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:36.741199 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-019cde6d-1098-4d35-9240-e09679335375 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:36.741639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-019cde6d-1098-4d35-9240-e09679335375 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:36.764410 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-019cde6d-1098-4d35-9240-e09679335375 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/ips" status: 200 len: 151 microversion: 2.20 time: 0.035209 Apr 05 11:53:36.765177 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 188/422] 10.222.0.61 () {60 vars in 1288 bytes} [Tue Apr 5 11:53:36 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:53:37.540420 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1ddab569-e790-4d41-bf57-8988d9aa6118 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:37.541137 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1ddab569-e790-4d41-bf57-8988d9aa6118 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:37.547457 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1ddab569-e790-4d41-bf57-8988d9aa6118 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:37.547913 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1ddab569-e790-4d41-bf57-8988d9aa6118 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:37.548711 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1ddab569-e790-4d41-bf57-8988d9aa6118 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:37.549147 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1ddab569-e790-4d41-bf57-8988d9aa6118 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:37.665538 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-619e3d81-561e-4628-a5a9-5efd4a07a563 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:37.666153 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-619e3d81-561e-4628-a5a9-5efd4a07a563 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 1a6b36d8-6a9a-421b-bbda-e56342ccca79] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:37.672661 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-619e3d81-561e-4628-a5a9-5efd4a07a563 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:37.673109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-619e3d81-561e-4628-a5a9-5efd4a07a563 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:37.673886 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-619e3d81-561e-4628-a5a9-5efd4a07a563 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:37.674300 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-619e3d81-561e-4628-a5a9-5efd4a07a563 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:37.807865 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-619e3d81-561e-4628-a5a9-5efd4a07a563 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:37.815414 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-619e3d81-561e-4628-a5a9-5efd4a07a563 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79" status: 200 len: 1319 microversion: 2.1 time: 0.153847 Apr 05 11:53:37.816177 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 189/423] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:37 2022] GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:53:37.927358 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1ddab569-e790-4d41-bf57-8988d9aa6118 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:37.935274 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1ddab569-e790-4d41-bf57-8988d9aa6118 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1370 microversion: 2.1 time: 0.399397 Apr 05 11:53:37.935853 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 235/424] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:37 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1370 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:38.460980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-0c526618-8468-4ea2-aeb9-5bcc7a32a449 req-78e06ae9-179f-4a11-a491-0038be5e0d30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99328563-d12a-4ef5-952b-c6c86929a22d", "tag": "d788cf01-8528-46be-b9ed-aa38fac571ee"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:53:38.470257 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-0c526618-8468-4ea2-aeb9-5bcc7a32a449 req-78e06ae9-179f-4a11-a491-0038be5e0d30 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:38.471242 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-0c526618-8468-4ea2-aeb9-5bcc7a32a449 req-78e06ae9-179f-4a11-a491-0038be5e0d30 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:38.484624 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-0c526618-8468-4ea2-aeb9-5bcc7a32a449 req-78e06ae9-179f-4a11-a491-0038be5e0d30 service nova] Creating event network-changed:d788cf01-8528-46be-b9ed-aa38fac571ee for instance 99328563-d12a-4ef5-952b-c6c86929a22d on hv-cinder-82956 Apr 05 11:53:38.500918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-0c526618-8468-4ea2-aeb9-5bcc7a32a449 req-78e06ae9-179f-4a11-a491-0038be5e0d30 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044863 Apr 05 11:53:38.502804 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 190/425] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:53:38.678732 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d673fe1b-44e1-4d6d-ad28-dd353b5cc714 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aea50f3b-2e24-4934-88dd-e8f274d213d4"}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:53:38.679889 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d673fe1b-44e1-4d6d-ad28-dd353b5cc714 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:38.686356 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d673fe1b-44e1-4d6d-ad28-dd353b5cc714 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:38.686801 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d673fe1b-44e1-4d6d-ad28-dd353b5cc714 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:38.687576 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d673fe1b-44e1-4d6d-ad28-dd353b5cc714 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:38.688006 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d673fe1b-44e1-4d6d-ad28-dd353b5cc714 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:38.834255 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f2e91235-0876-408e-acc9-05fd12c6ddc0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:38.834964 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f2e91235-0876-408e-acc9-05fd12c6ddc0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 1a6b36d8-6a9a-421b-bbda-e56342ccca79] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:38.841664 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f2e91235-0876-408e-acc9-05fd12c6ddc0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:38.842708 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f2e91235-0876-408e-acc9-05fd12c6ddc0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:38.843670 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f2e91235-0876-408e-acc9-05fd12c6ddc0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:38.844276 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f2e91235-0876-408e-acc9-05fd12c6ddc0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:38.993807 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d673fe1b-44e1-4d6d-ad28-dd353b5cc714 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "POST /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318938 Apr 05 11:53:38.994706 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 236/426] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Apr 5 11:53:38 2022] POST /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:53:38.999947 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-14b85d3d-f521-4132-b55a-7d52b1f71f3f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:39.000781 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-14b85d3d-f521-4132-b55a-7d52b1f71f3f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:39.018246 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f2e91235-0876-408e-acc9-05fd12c6ddc0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:39.021531 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14b85d3d-f521-4132-b55a-7d52b1f71f3f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:39.022173 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14b85d3d-f521-4132-b55a-7d52b1f71f3f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:39.023559 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14b85d3d-f521-4132-b55a-7d52b1f71f3f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:39.024179 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14b85d3d-f521-4132-b55a-7d52b1f71f3f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:39.027489 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f2e91235-0876-408e-acc9-05fd12c6ddc0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79" status: 200 len: 1319 microversion: 2.1 time: 0.197923 Apr 05 11:53:39.039821 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 191/427] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:38 2022] GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:39.082611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d2f65deb-835d-4bac-a5eb-d71992e571b7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:53:39.083144 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d2f65deb-835d-4bac-a5eb-d71992e571b7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:39.089560 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d2f65deb-835d-4bac-a5eb-d71992e571b7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:39.090270 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d2f65deb-835d-4bac-a5eb-d71992e571b7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:39.091198 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d2f65deb-835d-4bac-a5eb-d71992e571b7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:39.091775 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d2f65deb-835d-4bac-a5eb-d71992e571b7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:39.116868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.objects.instance [None req-d2f65deb-835d-4bac-a5eb-d71992e571b7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lazy-loading 'flavor' on Instance uuid 98a3437c-94c0-4133-a629-9386b4639a2d {{(pid=123357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:53:39.332782 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-14b85d3d-f521-4132-b55a-7d52b1f71f3f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:39.342341 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-14b85d3d-f521-4132-b55a-7d52b1f71f3f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1370 microversion: 2.1 time: 0.346137 Apr 05 11:53:39.351103 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 237/428] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:38 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1370 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:39.390360 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d2f65deb-835d-4bac-a5eb-d71992e571b7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "POST /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/action" status: 202 len: 0 microversion: 2.20 time: 0.311829 Apr 05 11:53:39.394302 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 192/429] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Apr 5 11:53:39 2022] POST /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 05 11:53:39.399692 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-923ce0c8-6ec3-48cc-80ec-720d4b1d2790 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:39.400400 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-923ce0c8-6ec3-48cc-80ec-720d4b1d2790 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:39.407751 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-923ce0c8-6ec3-48cc-80ec-720d4b1d2790 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:39.408236 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-923ce0c8-6ec3-48cc-80ec-720d4b1d2790 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:39.409005 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-923ce0c8-6ec3-48cc-80ec-720d4b1d2790 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:39.409438 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-923ce0c8-6ec3-48cc-80ec-720d4b1d2790 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:39.475726 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d8e9ce82-0595-482b-afa9-1c6fef0d3f1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:39.476335 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d8e9ce82-0595-482b-afa9-1c6fef0d3f1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:39.483266 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d8e9ce82-0595-482b-afa9-1c6fef0d3f1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:39.483715 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d8e9ce82-0595-482b-afa9-1c6fef0d3f1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:39.484518 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d8e9ce82-0595-482b-afa9-1c6fef0d3f1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:39.484952 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d8e9ce82-0595-482b-afa9-1c6fef0d3f1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:39.516257 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d8e9ce82-0595-482b-afa9-1c6fef0d3f1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/ips" status: 200 len: 147 microversion: 2.1 time: 0.044781 Apr 05 11:53:39.516804 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 193/430] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Apr 5 11:53:39 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/ips => generated 147 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:53:39.659738 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-923ce0c8-6ec3-48cc-80ec-720d4b1d2790 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:39.669417 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-923ce0c8-6ec3-48cc-80ec-720d4b1d2790 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:39.671116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-923ce0c8-6ec3-48cc-80ec-720d4b1d2790 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:39.672893 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-923ce0c8-6ec3-48cc-80ec-720d4b1d2790 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1722 microversion: 2.20 time: 0.277296 Apr 05 11:53:39.673849 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 238/431] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:53:39 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:53:40.050029 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-37686b8f-8fe3-4d16-b3c3-0ad3388cb82d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:40.051065 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-37686b8f-8fe3-4d16-b3c3-0ad3388cb82d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 1a6b36d8-6a9a-421b-bbda-e56342ccca79] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:40.060519 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37686b8f-8fe3-4d16-b3c3-0ad3388cb82d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:40.060952 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37686b8f-8fe3-4d16-b3c3-0ad3388cb82d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:40.061704 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37686b8f-8fe3-4d16-b3c3-0ad3388cb82d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:40.062133 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37686b8f-8fe3-4d16-b3c3-0ad3388cb82d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:40.194521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-37686b8f-8fe3-4d16-b3c3-0ad3388cb82d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:40.202012 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-37686b8f-8fe3-4d16-b3c3-0ad3388cb82d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79" status: 200 len: 1319 microversion: 2.1 time: 0.158453 Apr 05 11:53:40.202544 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 194/432] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:40 2022] GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:40.361847 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-569e286b-c7a7-4665-a851-db93874bacfd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:40.362561 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-569e286b-c7a7-4665-a851-db93874bacfd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:40.370372 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-569e286b-c7a7-4665-a851-db93874bacfd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:40.370821 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-569e286b-c7a7-4665-a851-db93874bacfd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:40.371708 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-569e286b-c7a7-4665-a851-db93874bacfd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:40.372253 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-569e286b-c7a7-4665-a851-db93874bacfd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:40.523850 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-569e286b-c7a7-4665-a851-db93874bacfd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:40.530879 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-2be39bbe-b8a7-42ea-9266-d45838334f62 req-9251a422-ba47-4752-80db-453cb6c41b4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a6b36d8-6a9a-421b-bbda-e56342ccca79", "tag": "57f5dfab-7c49-46c4-9032-7d2d1bc47160"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:53:40.531654 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-569e286b-c7a7-4665-a851-db93874bacfd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1370 microversion: 2.1 time: 0.174348 Apr 05 11:53:40.532278 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 239/433] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:40 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:40.539276 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-2be39bbe-b8a7-42ea-9266-d45838334f62 req-9251a422-ba47-4752-80db-453cb6c41b4d service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:40.539703 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-2be39bbe-b8a7-42ea-9266-d45838334f62 req-9251a422-ba47-4752-80db-453cb6c41b4d service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:40.550809 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-2be39bbe-b8a7-42ea-9266-d45838334f62 req-9251a422-ba47-4752-80db-453cb6c41b4d service nova] Creating event network-changed:57f5dfab-7c49-46c4-9032-7d2d1bc47160 for instance 1a6b36d8-6a9a-421b-bbda-e56342ccca79 on hv-cinder-82956 Apr 05 11:53:40.555610 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-2be39bbe-b8a7-42ea-9266-d45838334f62 req-9251a422-ba47-4752-80db-453cb6c41b4d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028348 Apr 05 11:53:40.556189 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 195/434] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:53:40.693704 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-57a1d72b-d696-4e3c-b138-9613f83830a2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:40.694224 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-57a1d72b-d696-4e3c-b138-9613f83830a2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:40.700712 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-57a1d72b-d696-4e3c-b138-9613f83830a2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:40.701154 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-57a1d72b-d696-4e3c-b138-9613f83830a2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:40.701896 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-57a1d72b-d696-4e3c-b138-9613f83830a2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:40.702323 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-57a1d72b-d696-4e3c-b138-9613f83830a2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:40.849351 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-57a1d72b-d696-4e3c-b138-9613f83830a2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:40.857521 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-57a1d72b-d696-4e3c-b138-9613f83830a2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:40.859019 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-57a1d72b-d696-4e3c-b138-9613f83830a2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:40.860195 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-57a1d72b-d696-4e3c-b138-9613f83830a2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1722 microversion: 2.20 time: 0.170500 Apr 05 11:53:40.870909 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 240/435] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:53:40 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:53:40.877461 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fddbe406-6a0c-4a8c-9b72-f76788fb014b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b56dc4a2-608f-4b3e-8481-37d73cee6b2f"}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:53:40.878596 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fddbe406-6a0c-4a8c-9b72-f76788fb014b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:40.884957 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fddbe406-6a0c-4a8c-9b72-f76788fb014b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:40.885389 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fddbe406-6a0c-4a8c-9b72-f76788fb014b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:40.886139 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fddbe406-6a0c-4a8c-9b72-f76788fb014b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:40.886563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fddbe406-6a0c-4a8c-9b72-f76788fb014b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:41.222801 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a2d0e5a5-7524-4ad5-bacd-11aaf2b88aa6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:41.223386 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a2d0e5a5-7524-4ad5-bacd-11aaf2b88aa6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 1a6b36d8-6a9a-421b-bbda-e56342ccca79] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:41.230248 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a2d0e5a5-7524-4ad5-bacd-11aaf2b88aa6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:41.230693 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a2d0e5a5-7524-4ad5-bacd-11aaf2b88aa6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:41.231436 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a2d0e5a5-7524-4ad5-bacd-11aaf2b88aa6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:41.231861 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a2d0e5a5-7524-4ad5-bacd-11aaf2b88aa6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:41.369489 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a2d0e5a5-7524-4ad5-bacd-11aaf2b88aa6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:41.377405 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a2d0e5a5-7524-4ad5-bacd-11aaf2b88aa6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79" status: 200 len: 1319 microversion: 2.1 time: 0.158443 Apr 05 11:53:41.377977 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 241/436] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:41 2022] GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:41.552696 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8f9d197f-86d1-4967-876e-9f36575f8fd7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:41.553682 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8f9d197f-86d1-4967-876e-9f36575f8fd7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:41.563275 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8f9d197f-86d1-4967-876e-9f36575f8fd7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:41.563712 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8f9d197f-86d1-4967-876e-9f36575f8fd7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:41.564493 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8f9d197f-86d1-4967-876e-9f36575f8fd7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:41.564925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8f9d197f-86d1-4967-876e-9f36575f8fd7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:41.699649 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8f9d197f-86d1-4967-876e-9f36575f8fd7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:41.707132 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8f9d197f-86d1-4967-876e-9f36575f8fd7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1370 microversion: 2.1 time: 0.160888 Apr 05 11:53:41.707685 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 242/437] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:41 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:41.883932 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1cbeea17-10c5-4014-981f-413f6b025fbe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:41.884824 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1cbeea17-10c5-4014-981f-413f6b025fbe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:41.893437 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1cbeea17-10c5-4014-981f-413f6b025fbe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:41.893900 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1cbeea17-10c5-4014-981f-413f6b025fbe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:41.894717 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1cbeea17-10c5-4014-981f-413f6b025fbe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:41.895141 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1cbeea17-10c5-4014-981f-413f6b025fbe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:42.035698 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1cbeea17-10c5-4014-981f-413f6b025fbe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:42.047487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1cbeea17-10c5-4014-981f-413f6b025fbe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:42.049941 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1cbeea17-10c5-4014-981f-413f6b025fbe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:42.051650 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1cbeea17-10c5-4014-981f-413f6b025fbe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1722 microversion: 2.20 time: 0.174421 Apr 05 11:53:42.052495 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 243/438] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:53:41 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:53:42.395361 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6d76353f-21b2-487b-8d21-385b09e7fdac tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:42.395973 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6d76353f-21b2-487b-8d21-385b09e7fdac tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 1a6b36d8-6a9a-421b-bbda-e56342ccca79] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:42.402726 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6d76353f-21b2-487b-8d21-385b09e7fdac tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:42.403171 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6d76353f-21b2-487b-8d21-385b09e7fdac tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:42.403926 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6d76353f-21b2-487b-8d21-385b09e7fdac tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:42.404394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6d76353f-21b2-487b-8d21-385b09e7fdac tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:42.539175 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6d76353f-21b2-487b-8d21-385b09e7fdac tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:42.546739 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6d76353f-21b2-487b-8d21-385b09e7fdac tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79" status: 200 len: 1319 microversion: 2.1 time: 0.155314 Apr 05 11:53:42.547304 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 244/439] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:42 2022] GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:42.725389 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-75eb0403-766d-4ac6-a2cd-255d8b3d6efb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:42.726446 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-75eb0403-766d-4ac6-a2cd-255d8b3d6efb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:42.733114 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-75eb0403-766d-4ac6-a2cd-255d8b3d6efb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:42.733553 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-75eb0403-766d-4ac6-a2cd-255d8b3d6efb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:42.734310 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-75eb0403-766d-4ac6-a2cd-255d8b3d6efb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:42.734736 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-75eb0403-766d-4ac6-a2cd-255d8b3d6efb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:42.900984 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fddbe406-6a0c-4a8c-9b72-f76788fb014b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "POST /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.027747 Apr 05 11:53:42.901964 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 196/440] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Apr 5 11:53:40 2022] POST /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 194 bytes in 2030 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:53:43.061870 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-75eb0403-766d-4ac6-a2cd-255d8b3d6efb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:43.074278 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-62e7f546-c4dc-40d4-a2f7-ae3f7abdbab2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:43.075068 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-62e7f546-c4dc-40d4-a2f7-ae3f7abdbab2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:43.080177 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-75eb0403-766d-4ac6-a2cd-255d8b3d6efb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1370 microversion: 2.1 time: 0.358408 Apr 05 11:53:43.080928 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 245/441] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:42 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1370 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:53:43.081546 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-62e7f546-c4dc-40d4-a2f7-ae3f7abdbab2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:43.082060 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-62e7f546-c4dc-40d4-a2f7-ae3f7abdbab2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:43.082924 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-62e7f546-c4dc-40d4-a2f7-ae3f7abdbab2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:43.083415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-62e7f546-c4dc-40d4-a2f7-ae3f7abdbab2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:43.225674 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-62e7f546-c4dc-40d4-a2f7-ae3f7abdbab2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:43.235754 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-62e7f546-c4dc-40d4-a2f7-ae3f7abdbab2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:43.237519 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-62e7f546-c4dc-40d4-a2f7-ae3f7abdbab2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:43.238928 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-62e7f546-c4dc-40d4-a2f7-ae3f7abdbab2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1722 microversion: 2.20 time: 0.169518 Apr 05 11:53:43.239496 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 197/442] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:53:43 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:53:43.562904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8c2418a3-b6f0-4acd-968a-92a18d8d6d31 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:43.563626 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8c2418a3-b6f0-4acd-968a-92a18d8d6d31 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 1a6b36d8-6a9a-421b-bbda-e56342ccca79] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:43.570470 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8c2418a3-b6f0-4acd-968a-92a18d8d6d31 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:43.570922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8c2418a3-b6f0-4acd-968a-92a18d8d6d31 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:43.571698 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8c2418a3-b6f0-4acd-968a-92a18d8d6d31 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:43.572165 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8c2418a3-b6f0-4acd-968a-92a18d8d6d31 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:43.757946 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8c2418a3-b6f0-4acd-968a-92a18d8d6d31 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:43.767213 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8c2418a3-b6f0-4acd-968a-92a18d8d6d31 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79" status: 200 len: 1319 microversion: 2.1 time: 0.208055 Apr 05 11:53:43.768251 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 246/443] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:43 2022] GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:44.101300 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c7bd9a18-141a-4a96-ac2b-64d249bcded1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:44.102211 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c7bd9a18-141a-4a96-ac2b-64d249bcded1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:44.112724 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c7bd9a18-141a-4a96-ac2b-64d249bcded1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:44.113175 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c7bd9a18-141a-4a96-ac2b-64d249bcded1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:44.113942 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c7bd9a18-141a-4a96-ac2b-64d249bcded1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:44.114372 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c7bd9a18-141a-4a96-ac2b-64d249bcded1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:44.257687 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ab89015f-c49c-4bcc-88dd-a45e9ed2ae7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:44.258204 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ab89015f-c49c-4bcc-88dd-a45e9ed2ae7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:44.262505 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c7bd9a18-141a-4a96-ac2b-64d249bcded1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:44.264566 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ab89015f-c49c-4bcc-88dd-a45e9ed2ae7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:44.265016 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ab89015f-c49c-4bcc-88dd-a45e9ed2ae7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:44.265795 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ab89015f-c49c-4bcc-88dd-a45e9ed2ae7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:44.266228 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ab89015f-c49c-4bcc-88dd-a45e9ed2ae7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:44.270002 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c7bd9a18-141a-4a96-ac2b-64d249bcded1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1370 microversion: 2.1 time: 0.175110 Apr 05 11:53:44.270579 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 198/444] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:44 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:44.400560 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ab89015f-c49c-4bcc-88dd-a45e9ed2ae7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:44.408368 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ab89015f-c49c-4bcc-88dd-a45e9ed2ae7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:44.409964 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ab89015f-c49c-4bcc-88dd-a45e9ed2ae7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:44.411109 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ab89015f-c49c-4bcc-88dd-a45e9ed2ae7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1722 microversion: 2.20 time: 0.157567 Apr 05 11:53:44.411683 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 247/445] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:53:44 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:53:44.791668 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9e84adde-bc89-4885-9ceb-da4d4f93c1cc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:44.792317 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9e84adde-bc89-4885-9ceb-da4d4f93c1cc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 1a6b36d8-6a9a-421b-bbda-e56342ccca79] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:44.802253 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9e84adde-bc89-4885-9ceb-da4d4f93c1cc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:44.802697 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9e84adde-bc89-4885-9ceb-da4d4f93c1cc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:44.803481 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9e84adde-bc89-4885-9ceb-da4d4f93c1cc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:44.803908 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9e84adde-bc89-4885-9ceb-da4d4f93c1cc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:44.942816 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9e84adde-bc89-4885-9ceb-da4d4f93c1cc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:44.950187 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9e84adde-bc89-4885-9ceb-da4d4f93c1cc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79" status: 200 len: 1319 microversion: 2.1 time: 0.164251 Apr 05 11:53:44.950783 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 199/446] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:44 2022] GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:45.287542 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9fb091ab-53db-4fcb-95b3-cbdd3e777631 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:45.288055 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9fb091ab-53db-4fcb-95b3-cbdd3e777631 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:45.294308 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fb091ab-53db-4fcb-95b3-cbdd3e777631 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:45.294781 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fb091ab-53db-4fcb-95b3-cbdd3e777631 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:45.295566 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fb091ab-53db-4fcb-95b3-cbdd3e777631 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:45.295989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fb091ab-53db-4fcb-95b3-cbdd3e777631 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:45.358988 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-8f70cfc3-9ab2-4a49-8c8f-c91d6a3825a7 req-e8bb6770-d91b-422d-9be8-3c1aedb517c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6b36d8-6a9a-421b-bbda-e56342ccca79", "name": "network-vif-plugged", "status": "completed", "tag": "57f5dfab-7c49-46c4-9032-7d2d1bc47160"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:53:45.370857 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-8f70cfc3-9ab2-4a49-8c8f-c91d6a3825a7 req-e8bb6770-d91b-422d-9be8-3c1aedb517c3 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:45.371333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-8f70cfc3-9ab2-4a49-8c8f-c91d6a3825a7 req-e8bb6770-d91b-422d-9be8-3c1aedb517c3 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:45.387627 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-8f70cfc3-9ab2-4a49-8c8f-c91d6a3825a7 req-e8bb6770-d91b-422d-9be8-3c1aedb517c3 service nova] Creating event network-vif-plugged:57f5dfab-7c49-46c4-9032-7d2d1bc47160 for instance 1a6b36d8-6a9a-421b-bbda-e56342ccca79 on hv-cinder-82956 Apr 05 11:53:45.394603 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-8f70cfc3-9ab2-4a49-8c8f-c91d6a3825a7 req-e8bb6770-d91b-422d-9be8-3c1aedb517c3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038156 Apr 05 11:53:45.395216 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 200/447] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:53:45.429846 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-67a24ce0-e18c-49eb-a4fd-09a55635a1c4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:45.430623 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-67a24ce0-e18c-49eb-a4fd-09a55635a1c4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:45.438682 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-67a24ce0-e18c-49eb-a4fd-09a55635a1c4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:45.439330 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-67a24ce0-e18c-49eb-a4fd-09a55635a1c4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:45.440430 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-67a24ce0-e18c-49eb-a4fd-09a55635a1c4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:45.440864 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-67a24ce0-e18c-49eb-a4fd-09a55635a1c4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:45.456988 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9fb091ab-53db-4fcb-95b3-cbdd3e777631 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:45.464582 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9fb091ab-53db-4fcb-95b3-cbdd3e777631 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1370 microversion: 2.1 time: 0.181180 Apr 05 11:53:45.465757 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 248/448] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:45 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:45.587661 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-67a24ce0-e18c-49eb-a4fd-09a55635a1c4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:45.596037 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-67a24ce0-e18c-49eb-a4fd-09a55635a1c4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:45.597616 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-67a24ce0-e18c-49eb-a4fd-09a55635a1c4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:45.598780 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-67a24ce0-e18c-49eb-a4fd-09a55635a1c4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1722 microversion: 2.20 time: 0.173723 Apr 05 11:53:45.599355 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 201/449] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:53:45 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:53:45.971556 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9fc9b8b1-2943-401a-89f7-5b9ba96025a9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:45.972521 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9fc9b8b1-2943-401a-89f7-5b9ba96025a9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 1a6b36d8-6a9a-421b-bbda-e56342ccca79] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:45.980714 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fc9b8b1-2943-401a-89f7-5b9ba96025a9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:45.981273 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fc9b8b1-2943-401a-89f7-5b9ba96025a9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:45.982225 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fc9b8b1-2943-401a-89f7-5b9ba96025a9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:45.982770 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fc9b8b1-2943-401a-89f7-5b9ba96025a9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:46.118227 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9fc9b8b1-2943-401a-89f7-5b9ba96025a9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:46.125746 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9fc9b8b1-2943-401a-89f7-5b9ba96025a9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79" status: 200 len: 1319 microversion: 2.1 time: 0.160545 Apr 05 11:53:46.126195 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 249/450] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:45 2022] GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:46.482451 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-74915b42-4d43-4fd5-929c-ddf4ac70d48b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:46.483060 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-74915b42-4d43-4fd5-929c-ddf4ac70d48b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:46.489799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-74915b42-4d43-4fd5-929c-ddf4ac70d48b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:46.490239 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-74915b42-4d43-4fd5-929c-ddf4ac70d48b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:46.490997 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-74915b42-4d43-4fd5-929c-ddf4ac70d48b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:46.491422 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-74915b42-4d43-4fd5-929c-ddf4ac70d48b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:46.617086 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-78411857-9630-464f-a2cd-aff380d6055a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:46.617677 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-78411857-9630-464f-a2cd-aff380d6055a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:46.624066 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-78411857-9630-464f-a2cd-aff380d6055a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:46.624548 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-78411857-9630-464f-a2cd-aff380d6055a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:46.625316 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-78411857-9630-464f-a2cd-aff380d6055a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:46.625755 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-78411857-9630-464f-a2cd-aff380d6055a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:46.629798 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-74915b42-4d43-4fd5-929c-ddf4ac70d48b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:46.637399 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-74915b42-4d43-4fd5-929c-ddf4ac70d48b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1370 microversion: 2.1 time: 0.158779 Apr 05 11:53:46.637931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 202/451] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:46 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:46.765739 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-78411857-9630-464f-a2cd-aff380d6055a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:46.774038 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-78411857-9630-464f-a2cd-aff380d6055a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:46.775591 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-78411857-9630-464f-a2cd-aff380d6055a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:46.776746 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-78411857-9630-464f-a2cd-aff380d6055a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1722 microversion: 2.20 time: 0.163664 Apr 05 11:53:46.777314 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 250/452] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:53:46 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:53:47.141868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8f53396f-6c3a-43e4-9c87-5042f2994ffa tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:47.143294 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8f53396f-6c3a-43e4-9c87-5042f2994ffa tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 1a6b36d8-6a9a-421b-bbda-e56342ccca79] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:47.150914 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f53396f-6c3a-43e4-9c87-5042f2994ffa tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:47.151357 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f53396f-6c3a-43e4-9c87-5042f2994ffa tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:47.152134 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f53396f-6c3a-43e4-9c87-5042f2994ffa tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:47.152567 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f53396f-6c3a-43e4-9c87-5042f2994ffa tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:47.301926 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8f53396f-6c3a-43e4-9c87-5042f2994ffa tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:47.309663 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8f53396f-6c3a-43e4-9c87-5042f2994ffa tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79" status: 200 len: 1319 microversion: 2.1 time: 0.171692 Apr 05 11:53:47.310776 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 203/453] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:47 2022] GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:47.414089 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-4286dc87-90a2-4bfb-ac82-f1264ff400b6 req-26024a94-e8a2-4589-bb7b-1d80f653ec94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99328563-d12a-4ef5-952b-c6c86929a22d", "name": "network-vif-plugged", "status": "completed", "tag": "d788cf01-8528-46be-b9ed-aa38fac571ee"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:53:47.422622 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-4286dc87-90a2-4bfb-ac82-f1264ff400b6 req-26024a94-e8a2-4589-bb7b-1d80f653ec94 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:47.423060 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-4286dc87-90a2-4bfb-ac82-f1264ff400b6 req-26024a94-e8a2-4589-bb7b-1d80f653ec94 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:47.433870 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-4286dc87-90a2-4bfb-ac82-f1264ff400b6 req-26024a94-e8a2-4589-bb7b-1d80f653ec94 service nova] Creating event network-vif-plugged:d788cf01-8528-46be-b9ed-aa38fac571ee for instance 99328563-d12a-4ef5-952b-c6c86929a22d on hv-cinder-82956 Apr 05 11:53:47.439029 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-4286dc87-90a2-4bfb-ac82-f1264ff400b6 req-26024a94-e8a2-4589-bb7b-1d80f653ec94 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028622 Apr 05 11:53:47.439780 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 251/454] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:53:47.658913 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ef7de1b4-b3a1-42f6-bdd4-1e384df04047 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:47.659794 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ef7de1b4-b3a1-42f6-bdd4-1e384df04047 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:47.670830 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef7de1b4-b3a1-42f6-bdd4-1e384df04047 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:47.671565 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef7de1b4-b3a1-42f6-bdd4-1e384df04047 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:47.672871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef7de1b4-b3a1-42f6-bdd4-1e384df04047 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:47.673579 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef7de1b4-b3a1-42f6-bdd4-1e384df04047 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:47.796021 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c0ff19f1-3d99-4705-9175-b0ffb0505fb1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:47.797577 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c0ff19f1-3d99-4705-9175-b0ffb0505fb1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:47.804058 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c0ff19f1-3d99-4705-9175-b0ffb0505fb1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:47.804537 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c0ff19f1-3d99-4705-9175-b0ffb0505fb1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:47.805500 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c0ff19f1-3d99-4705-9175-b0ffb0505fb1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:47.805939 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c0ff19f1-3d99-4705-9175-b0ffb0505fb1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:47.822725 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ef7de1b4-b3a1-42f6-bdd4-1e384df04047 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:47.831743 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ef7de1b4-b3a1-42f6-bdd4-1e384df04047 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1370 microversion: 2.1 time: 0.178990 Apr 05 11:53:47.832475 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 204/455] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:47 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:47.941309 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c0ff19f1-3d99-4705-9175-b0ffb0505fb1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:47.949134 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c0ff19f1-3d99-4705-9175-b0ffb0505fb1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:47.950622 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c0ff19f1-3d99-4705-9175-b0ffb0505fb1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:47.951748 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c0ff19f1-3d99-4705-9175-b0ffb0505fb1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1722 microversion: 2.20 time: 0.160568 Apr 05 11:53:47.952377 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 252/456] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:53:47 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:53:48.331175 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bee63e96-dd9d-483c-9bb3-0f55942e797e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:48.331807 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bee63e96-dd9d-483c-9bb3-0f55942e797e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 1a6b36d8-6a9a-421b-bbda-e56342ccca79] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:48.339041 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bee63e96-dd9d-483c-9bb3-0f55942e797e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:48.339500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bee63e96-dd9d-483c-9bb3-0f55942e797e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:48.340266 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bee63e96-dd9d-483c-9bb3-0f55942e797e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:48.340693 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bee63e96-dd9d-483c-9bb3-0f55942e797e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:48.476365 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-bee63e96-dd9d-483c-9bb3-0f55942e797e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:48.487122 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bee63e96-dd9d-483c-9bb3-0f55942e797e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79" status: 200 len: 1508 microversion: 2.1 time: 0.162696 Apr 05 11:53:48.487786 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 205/457] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:48 2022] GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:48.850161 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-24caff57-c28c-4097-a7dd-059079c5e903 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:48.850970 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-24caff57-c28c-4097-a7dd-059079c5e903 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:48.859750 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24caff57-c28c-4097-a7dd-059079c5e903 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:48.861615 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24caff57-c28c-4097-a7dd-059079c5e903 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:48.863283 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24caff57-c28c-4097-a7dd-059079c5e903 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:48.863938 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24caff57-c28c-4097-a7dd-059079c5e903 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:48.971192 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fbab5373-1704-423e-bcda-e27c43a73974 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:48.971920 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fbab5373-1704-423e-bcda-e27c43a73974 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:48.986485 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fbab5373-1704-423e-bcda-e27c43a73974 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:48.986876 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fbab5373-1704-423e-bcda-e27c43a73974 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:48.987719 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fbab5373-1704-423e-bcda-e27c43a73974 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:48.988267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fbab5373-1704-423e-bcda-e27c43a73974 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:49.097512 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-24caff57-c28c-4097-a7dd-059079c5e903 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:49.105274 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-24caff57-c28c-4097-a7dd-059079c5e903 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1370 microversion: 2.1 time: 0.259901 Apr 05 11:53:49.105924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 253/458] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:48 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1370 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:49.127829 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fbab5373-1704-423e-bcda-e27c43a73974 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:49.135601 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fbab5373-1704-423e-bcda-e27c43a73974 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:49.137168 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fbab5373-1704-423e-bcda-e27c43a73974 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:49.138318 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fbab5373-1704-423e-bcda-e27c43a73974 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1722 microversion: 2.20 time: 0.172227 Apr 05 11:53:49.138879 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 206/459] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:53:48 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:53:49.707805 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bbf87695-1d57-4f53-9b1f-eb6a4ac0ed15 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:53:49.713945 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bbf87695-1d57-4f53-9b1f-eb6a4ac0ed15 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:49.714383 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bbf87695-1d57-4f53-9b1f-eb6a4ac0ed15 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:49.776303 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bbf87695-1d57-4f53-9b1f-eb6a4ac0ed15 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Going to try to stop instance {{(pid=123358) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 05 11:53:49.820321 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bbf87695-1d57-4f53-9b1f-eb6a4ac0ed15 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "POST /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/action" status: 202 len: 0 microversion: 2.1 time: 0.116340 Apr 05 11:53:49.820929 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 254/460] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Apr 5 11:53:49 2022] POST /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:53:49.829168 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9ef2dadf-2d50-412e-a343-391bd5743c0f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:49.829782 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9ef2dadf-2d50-412e-a343-391bd5743c0f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:49.835948 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9ef2dadf-2d50-412e-a343-391bd5743c0f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:49.836436 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9ef2dadf-2d50-412e-a343-391bd5743c0f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:49.837220 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9ef2dadf-2d50-412e-a343-391bd5743c0f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:49.837652 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9ef2dadf-2d50-412e-a343-391bd5743c0f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:49.974438 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9ef2dadf-2d50-412e-a343-391bd5743c0f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:49.983459 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9ef2dadf-2d50-412e-a343-391bd5743c0f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1724 microversion: 2.1 time: 0.158186 Apr 05 11:53:49.984043 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 207/461] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:49 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:50.127343 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9723b684-27fc-4f92-9b56-0fbdc739fe96 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:50.128540 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9723b684-27fc-4f92-9b56-0fbdc739fe96 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:50.139173 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9723b684-27fc-4f92-9b56-0fbdc739fe96 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:50.139907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9723b684-27fc-4f92-9b56-0fbdc739fe96 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:50.141453 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9723b684-27fc-4f92-9b56-0fbdc739fe96 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:50.141905 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9723b684-27fc-4f92-9b56-0fbdc739fe96 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:50.156939 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-69cbdccb-8c45-4d4a-b811-66dd02e09497 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:50.162951 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-69cbdccb-8c45-4d4a-b811-66dd02e09497 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:50.175926 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-69cbdccb-8c45-4d4a-b811-66dd02e09497 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:50.176301 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-69cbdccb-8c45-4d4a-b811-66dd02e09497 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:50.177084 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-69cbdccb-8c45-4d4a-b811-66dd02e09497 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:50.177529 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-69cbdccb-8c45-4d4a-b811-66dd02e09497 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:50.293812 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9723b684-27fc-4f92-9b56-0fbdc739fe96 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:50.303387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9723b684-27fc-4f92-9b56-0fbdc739fe96 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1370 microversion: 2.1 time: 0.183805 Apr 05 11:53:50.304981 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 255/462] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:50 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:50.327918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-69cbdccb-8c45-4d4a-b811-66dd02e09497 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:50.343102 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-69cbdccb-8c45-4d4a-b811-66dd02e09497 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:50.344676 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-69cbdccb-8c45-4d4a-b811-66dd02e09497 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:50.346844 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-69cbdccb-8c45-4d4a-b811-66dd02e09497 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1722 microversion: 2.20 time: 0.193991 Apr 05 11:53:50.348202 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 208/463] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:53:50 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:53:51.005715 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-66740786-1703-4353-ab7b-2a1b05bf0a3a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:51.006786 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-66740786-1703-4353-ab7b-2a1b05bf0a3a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:51.012801 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-66740786-1703-4353-ab7b-2a1b05bf0a3a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:51.013234 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-66740786-1703-4353-ab7b-2a1b05bf0a3a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:51.014000 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-66740786-1703-4353-ab7b-2a1b05bf0a3a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:51.014428 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-66740786-1703-4353-ab7b-2a1b05bf0a3a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:51.146963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-66740786-1703-4353-ab7b-2a1b05bf0a3a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:51.155593 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-66740786-1703-4353-ab7b-2a1b05bf0a3a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1724 microversion: 2.1 time: 0.156608 Apr 05 11:53:51.156219 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 256/464] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:50 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:51.324967 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-032e5c9f-3879-413f-bcef-e9036cff6ae3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:51.326111 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-032e5c9f-3879-413f-bcef-e9036cff6ae3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:51.336244 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-032e5c9f-3879-413f-bcef-e9036cff6ae3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:51.336696 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-032e5c9f-3879-413f-bcef-e9036cff6ae3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:51.337449 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-032e5c9f-3879-413f-bcef-e9036cff6ae3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:51.337874 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-032e5c9f-3879-413f-bcef-e9036cff6ae3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:51.367204 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a8a73ea6-60bf-4918-8db0-20a46a5d8b3e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:51.367922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a8a73ea6-60bf-4918-8db0-20a46a5d8b3e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:51.374227 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a8a73ea6-60bf-4918-8db0-20a46a5d8b3e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:51.374674 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a8a73ea6-60bf-4918-8db0-20a46a5d8b3e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:51.375444 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a8a73ea6-60bf-4918-8db0-20a46a5d8b3e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:51.376038 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a8a73ea6-60bf-4918-8db0-20a46a5d8b3e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:51.483136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-032e5c9f-3879-413f-bcef-e9036cff6ae3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:51.496132 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-032e5c9f-3879-413f-bcef-e9036cff6ae3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1370 microversion: 2.1 time: 0.177240 Apr 05 11:53:51.496738 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 209/465] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:51 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:51.523295 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a8a73ea6-60bf-4918-8db0-20a46a5d8b3e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:51.531148 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a8a73ea6-60bf-4918-8db0-20a46a5d8b3e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:51.532678 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a8a73ea6-60bf-4918-8db0-20a46a5d8b3e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:51.533835 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a8a73ea6-60bf-4918-8db0-20a46a5d8b3e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1722 microversion: 2.20 time: 0.170961 Apr 05 11:53:51.534397 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 257/466] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:53:51 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:53:52.173074 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-54627bd6-ffbf-4816-96d0-227fd56ede8a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:52.173680 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-54627bd6-ffbf-4816-96d0-227fd56ede8a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:52.180020 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54627bd6-ffbf-4816-96d0-227fd56ede8a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:52.180499 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54627bd6-ffbf-4816-96d0-227fd56ede8a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:52.181259 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54627bd6-ffbf-4816-96d0-227fd56ede8a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:52.181681 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54627bd6-ffbf-4816-96d0-227fd56ede8a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:52.330064 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-54627bd6-ffbf-4816-96d0-227fd56ede8a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:52.338619 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-54627bd6-ffbf-4816-96d0-227fd56ede8a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1724 microversion: 2.1 time: 0.169363 Apr 05 11:53:52.339126 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 210/467] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:52 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:52.513706 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3bb44241-fc21-491c-b445-ca2088fade4c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:52.514336 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3bb44241-fc21-491c-b445-ca2088fade4c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:52.523140 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3bb44241-fc21-491c-b445-ca2088fade4c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:52.523771 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3bb44241-fc21-491c-b445-ca2088fade4c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:52.524857 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3bb44241-fc21-491c-b445-ca2088fade4c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:52.525399 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3bb44241-fc21-491c-b445-ca2088fade4c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:52.552358 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e4069c31-4ab3-4f2f-9ad5-2119ff4a7bc1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:52.552965 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e4069c31-4ab3-4f2f-9ad5-2119ff4a7bc1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:52.559370 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e4069c31-4ab3-4f2f-9ad5-2119ff4a7bc1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:52.559821 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e4069c31-4ab3-4f2f-9ad5-2119ff4a7bc1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:52.560642 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e4069c31-4ab3-4f2f-9ad5-2119ff4a7bc1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:52.561076 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e4069c31-4ab3-4f2f-9ad5-2119ff4a7bc1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:52.668369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3bb44241-fc21-491c-b445-ca2088fade4c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:52.675743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3bb44241-fc21-491c-b445-ca2088fade4c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1564 microversion: 2.1 time: 0.166515 Apr 05 11:53:52.676366 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 258/468] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:52 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:52.691859 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-07494bf6-0db6-4cd6-bef6-411b35e660a7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:52.692378 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-07494bf6-0db6-4cd6-bef6-411b35e660a7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:52.696696 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e4069c31-4ab3-4f2f-9ad5-2119ff4a7bc1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:52.698307 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-07494bf6-0db6-4cd6-bef6-411b35e660a7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:52.698762 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-07494bf6-0db6-4cd6-bef6-411b35e660a7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:52.699525 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-07494bf6-0db6-4cd6-bef6-411b35e660a7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:52.699962 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-07494bf6-0db6-4cd6-bef6-411b35e660a7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:52.704623 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e4069c31-4ab3-4f2f-9ad5-2119ff4a7bc1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:52.706119 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e4069c31-4ab3-4f2f-9ad5-2119ff4a7bc1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:52.707278 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e4069c31-4ab3-4f2f-9ad5-2119ff4a7bc1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1722 microversion: 2.20 time: 0.158958 Apr 05 11:53:52.707860 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 211/469] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:53:52 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:53:52.784455 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-07494bf6-0db6-4cd6-bef6-411b35e660a7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096272 Apr 05 11:53:52.785846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 259/470] 10.222.0.61 () {58 vars in 1274 bytes} [Tue Apr 5 11:53:52 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:53:53.357130 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7039a49f-a03a-4f23-ade0-4c3f6951cfab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:53.357838 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7039a49f-a03a-4f23-ade0-4c3f6951cfab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:53.364447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7039a49f-a03a-4f23-ade0-4c3f6951cfab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:53.364900 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7039a49f-a03a-4f23-ade0-4c3f6951cfab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:53.366012 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7039a49f-a03a-4f23-ade0-4c3f6951cfab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:53.366591 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7039a49f-a03a-4f23-ade0-4c3f6951cfab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:53.513644 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7039a49f-a03a-4f23-ade0-4c3f6951cfab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:53.521406 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7039a49f-a03a-4f23-ade0-4c3f6951cfab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1724 microversion: 2.1 time: 0.168278 Apr 05 11:53:53.522239 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 212/471] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:53 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:53.726448 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-dc5ee00b-2444-4f9a-8a58-88fc44691713 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:53.727473 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-dc5ee00b-2444-4f9a-8a58-88fc44691713 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:53.735499 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dc5ee00b-2444-4f9a-8a58-88fc44691713 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:53.735499 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dc5ee00b-2444-4f9a-8a58-88fc44691713 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:53.735499 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dc5ee00b-2444-4f9a-8a58-88fc44691713 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:53.735947 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dc5ee00b-2444-4f9a-8a58-88fc44691713 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:53.813813 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-47015b92-d2ea-41d8-a891-e309ef5afa21 req-bf7992e2-092d-411d-abd6-73a503a56252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99328563-d12a-4ef5-952b-c6c86929a22d", "tag": "d788cf01-8528-46be-b9ed-aa38fac571ee"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:53:53.822750 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-47015b92-d2ea-41d8-a891-e309ef5afa21 req-bf7992e2-092d-411d-abd6-73a503a56252 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:53.823531 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-47015b92-d2ea-41d8-a891-e309ef5afa21 req-bf7992e2-092d-411d-abd6-73a503a56252 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:53.835241 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-47015b92-d2ea-41d8-a891-e309ef5afa21 req-bf7992e2-092d-411d-abd6-73a503a56252 service nova] Creating event network-changed:d788cf01-8528-46be-b9ed-aa38fac571ee for instance 99328563-d12a-4ef5-952b-c6c86929a22d on hv-cinder-82956 Apr 05 11:53:53.840391 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-47015b92-d2ea-41d8-a891-e309ef5afa21 req-bf7992e2-092d-411d-abd6-73a503a56252 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034522 Apr 05 11:53:53.841325 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 213/472] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:53:53.902931 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-dc5ee00b-2444-4f9a-8a58-88fc44691713 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:53.911718 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-dc5ee00b-2444-4f9a-8a58-88fc44691713 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:53.914176 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-dc5ee00b-2444-4f9a-8a58-88fc44691713 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:53.915453 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-dc5ee00b-2444-4f9a-8a58-88fc44691713 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1722 microversion: 2.20 time: 0.193681 Apr 05 11:53:53.918926 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 260/473] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:53:53 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:53:54.539248 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5f818012-ff66-4ab4-bbeb-11ba9b20ee98 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:54.539940 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5f818012-ff66-4ab4-bbeb-11ba9b20ee98 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:54.546265 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5f818012-ff66-4ab4-bbeb-11ba9b20ee98 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:54.548142 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5f818012-ff66-4ab4-bbeb-11ba9b20ee98 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:54.548142 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5f818012-ff66-4ab4-bbeb-11ba9b20ee98 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:54.548142 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5f818012-ff66-4ab4-bbeb-11ba9b20ee98 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:54.699302 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5f818012-ff66-4ab4-bbeb-11ba9b20ee98 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:54.707481 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5f818012-ff66-4ab4-bbeb-11ba9b20ee98 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1724 microversion: 2.1 time: 0.172830 Apr 05 11:53:54.708213 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 214/474] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:54 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:54.935218 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e0579b92-7902-4909-8d19-39f280765d65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:54.935997 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e0579b92-7902-4909-8d19-39f280765d65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:54.943323 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0579b92-7902-4909-8d19-39f280765d65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:54.944773 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0579b92-7902-4909-8d19-39f280765d65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:54.946251 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0579b92-7902-4909-8d19-39f280765d65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:54.946705 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0579b92-7902-4909-8d19-39f280765d65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:55.084892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e0579b92-7902-4909-8d19-39f280765d65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:55.093189 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e0579b92-7902-4909-8d19-39f280765d65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:55.094683 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e0579b92-7902-4909-8d19-39f280765d65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:55.095841 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e0579b92-7902-4909-8d19-39f280765d65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1722 microversion: 2.20 time: 0.165291 Apr 05 11:53:55.096449 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 261/475] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:53:54 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:53:55.729123 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ef25c88c-70c1-4d3c-8e89-9f067629dfe9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:55.730060 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ef25c88c-70c1-4d3c-8e89-9f067629dfe9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:55.741121 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef25c88c-70c1-4d3c-8e89-9f067629dfe9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:55.741566 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef25c88c-70c1-4d3c-8e89-9f067629dfe9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:55.742363 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef25c88c-70c1-4d3c-8e89-9f067629dfe9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:55.742796 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef25c88c-70c1-4d3c-8e89-9f067629dfe9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:55.881697 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ef25c88c-70c1-4d3c-8e89-9f067629dfe9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:55.893685 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ef25c88c-70c1-4d3c-8e89-9f067629dfe9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1724 microversion: 2.1 time: 0.171197 Apr 05 11:53:55.894335 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 215/476] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:55 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:56.119307 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d9015913-159d-46a0-a462-f34182a66ede tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:56.120214 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d9015913-159d-46a0-a462-f34182a66ede tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:56.130935 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d9015913-159d-46a0-a462-f34182a66ede tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:56.131941 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d9015913-159d-46a0-a462-f34182a66ede tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:56.132871 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d9015913-159d-46a0-a462-f34182a66ede tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:56.133304 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d9015913-159d-46a0-a462-f34182a66ede tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:56.285808 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d9015913-159d-46a0-a462-f34182a66ede tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:56.294351 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d9015913-159d-46a0-a462-f34182a66ede tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:56.295815 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d9015913-159d-46a0-a462-f34182a66ede tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:56.297117 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d9015913-159d-46a0-a462-f34182a66ede tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1722 microversion: 2.20 time: 0.184380 Apr 05 11:53:56.297546 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 262/477] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:53:56 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:53:56.915597 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-281a6f92-3a79-4f3e-a015-7e7049a61038 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:56.916195 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-281a6f92-3a79-4f3e-a015-7e7049a61038 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:56.922977 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-281a6f92-3a79-4f3e-a015-7e7049a61038 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:56.923422 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-281a6f92-3a79-4f3e-a015-7e7049a61038 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:56.924209 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-281a6f92-3a79-4f3e-a015-7e7049a61038 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:56.924646 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-281a6f92-3a79-4f3e-a015-7e7049a61038 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:57.064476 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-281a6f92-3a79-4f3e-a015-7e7049a61038 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:57.074327 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-281a6f92-3a79-4f3e-a015-7e7049a61038 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1724 microversion: 2.1 time: 0.165389 Apr 05 11:53:57.074885 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 216/478] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:56 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:57.325157 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3b790ef6-669f-4d1f-a9df-3988bf6fe3aa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:57.326437 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3b790ef6-669f-4d1f-a9df-3988bf6fe3aa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:57.337428 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b790ef6-669f-4d1f-a9df-3988bf6fe3aa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:57.337849 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b790ef6-669f-4d1f-a9df-3988bf6fe3aa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:57.338664 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b790ef6-669f-4d1f-a9df-3988bf6fe3aa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:57.339090 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b790ef6-669f-4d1f-a9df-3988bf6fe3aa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:57.477216 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3b790ef6-669f-4d1f-a9df-3988bf6fe3aa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:57.485474 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3b790ef6-669f-4d1f-a9df-3988bf6fe3aa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:57.486956 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3b790ef6-669f-4d1f-a9df-3988bf6fe3aa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:57.488098 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3b790ef6-669f-4d1f-a9df-3988bf6fe3aa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1722 microversion: 2.20 time: 0.170587 Apr 05 11:53:57.488665 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 263/479] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:53:57 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:53:58.095350 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bd308473-1df7-4c9c-a915-fd27dbdc8948 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:58.096220 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bd308473-1df7-4c9c-a915-fd27dbdc8948 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:58.107461 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bd308473-1df7-4c9c-a915-fd27dbdc8948 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:58.108271 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bd308473-1df7-4c9c-a915-fd27dbdc8948 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:58.109527 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bd308473-1df7-4c9c-a915-fd27dbdc8948 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:58.110242 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bd308473-1df7-4c9c-a915-fd27dbdc8948 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:58.244460 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-bd308473-1df7-4c9c-a915-fd27dbdc8948 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:58.252553 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bd308473-1df7-4c9c-a915-fd27dbdc8948 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1724 microversion: 2.1 time: 0.163780 Apr 05 11:53:58.253159 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 217/480] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:58 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:58.507512 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0b6e1a8b-9d7c-48bb-8f49-bb5ff84f1ce6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:58.508131 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0b6e1a8b-9d7c-48bb-8f49-bb5ff84f1ce6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:58.514453 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0b6e1a8b-9d7c-48bb-8f49-bb5ff84f1ce6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:58.514907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0b6e1a8b-9d7c-48bb-8f49-bb5ff84f1ce6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:58.515666 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0b6e1a8b-9d7c-48bb-8f49-bb5ff84f1ce6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:58.516102 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0b6e1a8b-9d7c-48bb-8f49-bb5ff84f1ce6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:58.649406 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0b6e1a8b-9d7c-48bb-8f49-bb5ff84f1ce6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:58.658554 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0b6e1a8b-9d7c-48bb-8f49-bb5ff84f1ce6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:58.660418 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0b6e1a8b-9d7c-48bb-8f49-bb5ff84f1ce6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:58.661597 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0b6e1a8b-9d7c-48bb-8f49-bb5ff84f1ce6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1722 microversion: 2.20 time: 0.158797 Apr 05 11:53:58.662164 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 264/481] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:53:58 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:53:58.901382 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f5906716-b874-4e13-ae6f-d5d11e22cde2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Action: 'create', calling method: .version_select at 0x7f161c358dc0>, body: {"keypair": {"name": "tempest-keypair-1320201504"}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:53:58.914895 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-f5906716-b874-4e13-ae6f-d5d11e22cde2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Getting quotas for project 0f6e126c0851462ca2607a90c7581616. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:53:58.918635 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-f5906716-b874-4e13-ae6f-d5d11e22cde2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Getting quotas for user e5ae307df96e45ec9ac6d4b383c84abb and project 0f6e126c0851462ca2607a90c7581616. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:53:59.057640 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-f5906716-b874-4e13-ae6f-d5d11e22cde2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Getting quotas for project 0f6e126c0851462ca2607a90c7581616. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:53:59.061249 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-f5906716-b874-4e13-ae6f-d5d11e22cde2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Getting quotas for user e5ae307df96e45ec9ac6d4b383c84abb and project 0f6e126c0851462ca2607a90c7581616. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:53:59.074662 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f5906716-b874-4e13-ae6f-d5d11e22cde2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.177237 Apr 05 11:53:59.075260 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 218/482] 10.222.0.61 () {60 vars in 1157 bytes} [Tue Apr 5 11:53:58 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:59.269907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-93a9787a-f09f-4853-8d0b-3bad60c366e7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:59.270512 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-93a9787a-f09f-4853-8d0b-3bad60c366e7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:59.276628 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-93a9787a-f09f-4853-8d0b-3bad60c366e7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:59.277070 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-93a9787a-f09f-4853-8d0b-3bad60c366e7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:59.278130 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-93a9787a-f09f-4853-8d0b-3bad60c366e7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:59.278770 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-93a9787a-f09f-4853-8d0b-3bad60c366e7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:59.425979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-93a9787a-f09f-4853-8d0b-3bad60c366e7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:59.437164 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-93a9787a-f09f-4853-8d0b-3bad60c366e7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1724 microversion: 2.1 time: 0.171071 Apr 05 11:53:59.437750 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 265/483] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:53:59 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:53:59.680814 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-61675700-768d-4cb7-863b-254b3d0cf3b5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:53:59.681386 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-61675700-768d-4cb7-863b-254b3d0cf3b5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:53:59.687357 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-61675700-768d-4cb7-863b-254b3d0cf3b5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:59.687888 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-61675700-768d-4cb7-863b-254b3d0cf3b5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:59.688717 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-61675700-768d-4cb7-863b-254b3d0cf3b5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:53:59.689148 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-61675700-768d-4cb7-863b-254b3d0cf3b5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:53:59.922244 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-61675700-768d-4cb7-863b-254b3d0cf3b5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:59.930205 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-61675700-768d-4cb7-863b-254b3d0cf3b5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:59.931718 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-61675700-768d-4cb7-863b-254b3d0cf3b5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:53:59.932971 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-61675700-768d-4cb7-863b-254b3d0cf3b5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1722 microversion: 2.20 time: 0.257064 Apr 05 11:53:59.933540 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 219/484] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:53:59 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:00.454350 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6f62c3af-9d3d-48de-842d-49a7613e432c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:00.455011 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6f62c3af-9d3d-48de-842d-49a7613e432c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:00.462344 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f62c3af-9d3d-48de-842d-49a7613e432c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:00.463007 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f62c3af-9d3d-48de-842d-49a7613e432c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:00.463809 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f62c3af-9d3d-48de-842d-49a7613e432c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:00.464414 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f62c3af-9d3d-48de-842d-49a7613e432c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:00.499643 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f0b747aa-ac63-4600-84ce-5f2fa1e8ed41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-571910777", "imageRef": "2b657785-cb0b-43ba-956c-1564c27fd10a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "655b7336-f06e-410c-ae4e-8aa6ab359991"}], "security_groups": [{"name": "tempest-securitygroup--831130559"}], "key_name": "tempest-keypair-1320201504", "user_data": "}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:54:00.602795 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6f62c3af-9d3d-48de-842d-49a7613e432c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:00.608746 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.network.neutron [None req-f0b747aa-ac63-4600-84ce-5f2fa1e8ed41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] validate_networks() for [('655b7336-f06e-410c-ae4e-8aa6ab359991', None, None, None, None, None)] {{(pid=123357) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:54:00.610794 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6f62c3af-9d3d-48de-842d-49a7613e432c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1724 microversion: 2.1 time: 0.160364 Apr 05 11:54:00.611347 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 266/485] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:00 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:00.951417 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6faff1f8-bbc4-45d2-b46d-c8b53174237b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:00.952139 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6faff1f8-bbc4-45d2-b46d-c8b53174237b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:00.958361 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6faff1f8-bbc4-45d2-b46d-c8b53174237b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:00.958884 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6faff1f8-bbc4-45d2-b46d-c8b53174237b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:00.959647 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6faff1f8-bbc4-45d2-b46d-c8b53174237b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:00.960101 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6faff1f8-bbc4-45d2-b46d-c8b53174237b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:00.996942 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-f0b747aa-ac63-4600-84ce-5f2fa1e8ed41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Flavor limits 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:54:00.997481 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-f0b747aa-ac63-4600-84ce-5f2fa1e8ed41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Image limits 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:54:00.997806 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-f0b747aa-ac63-4600-84ce-5f2fa1e8ed41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Flavor pref 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:54:00.998230 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-f0b747aa-ac63-4600-84ce-5f2fa1e8ed41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Image pref 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:54:00.998941 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-f0b747aa-ac63-4600-84ce-5f2fa1e8ed41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:54:01.007421 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f0b747aa-ac63-4600-84ce-5f2fa1e8ed41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:01.007802 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f0b747aa-ac63-4600-84ce-5f2fa1e8ed41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:01.008793 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f0b747aa-ac63-4600-84ce-5f2fa1e8ed41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:01.009252 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f0b747aa-ac63-4600-84ce-5f2fa1e8ed41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:01.026013 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-f0b747aa-ac63-4600-84ce-5f2fa1e8ed41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Getting quotas for project 0f6e126c0851462ca2607a90c7581616. Resources: {'ram', 'instances', 'cores'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:54:01.030117 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-f0b747aa-ac63-4600-84ce-5f2fa1e8ed41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Getting quotas for user e5ae307df96e45ec9ac6d4b383c84abb and project 0f6e126c0851462ca2607a90c7581616. Resources: {'ram', 'instances', 'cores'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:54:01.041549 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f0b747aa-ac63-4600-84ce-5f2fa1e8ed41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Going to run 1 instances... {{(pid=123357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:54:01.043817 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f0b747aa-ac63-4600-84ce-5f2fa1e8ed41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b657785-cb0b-43ba-956c-1564c27fd10a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:54:01.092288 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f0b747aa-ac63-4600-84ce-5f2fa1e8ed41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.596719 Apr 05 11:54:01.093445 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 220/486] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Apr 5 11:54:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 05 11:54:01.094570 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6faff1f8-bbc4-45d2-b46d-c8b53174237b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:01.103103 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6faff1f8-bbc4-45d2-b46d-c8b53174237b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:01.103816 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-66184659-3773-4853-a6e1-a4de0426a8da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:01.104510 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-66184659-3773-4853-a6e1-a4de0426a8da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:01.104636 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6faff1f8-bbc4-45d2-b46d-c8b53174237b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:01.105892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6faff1f8-bbc4-45d2-b46d-c8b53174237b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1722 microversion: 2.20 time: 0.158316 Apr 05 11:54:01.106775 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 267/487] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:00 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:01.160337 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-66184659-3773-4853-a6e1-a4de0426a8da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:01.167343 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-66184659-3773-4853-a6e1-a4de0426a8da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1241 microversion: 2.1 time: 0.068230 Apr 05 11:54:01.167925 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 221/488] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:01 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:01.628554 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-697eb655-8cd4-4cc6-b893-0fae56e4be16 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:01.629115 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-697eb655-8cd4-4cc6-b893-0fae56e4be16 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:01.635536 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-697eb655-8cd4-4cc6-b893-0fae56e4be16 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:01.635974 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-697eb655-8cd4-4cc6-b893-0fae56e4be16 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:01.636759 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-697eb655-8cd4-4cc6-b893-0fae56e4be16 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:01.637322 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-697eb655-8cd4-4cc6-b893-0fae56e4be16 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:01.777641 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-697eb655-8cd4-4cc6-b893-0fae56e4be16 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:01.785507 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-697eb655-8cd4-4cc6-b893-0fae56e4be16 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1724 microversion: 2.1 time: 0.160942 Apr 05 11:54:01.786085 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 268/489] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:01 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:02.128955 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-19e8dcc7-e30b-4845-ad88-6f0d479322e5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:02.129984 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-19e8dcc7-e30b-4845-ad88-6f0d479322e5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:02.139246 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-19e8dcc7-e30b-4845-ad88-6f0d479322e5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:02.139685 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-19e8dcc7-e30b-4845-ad88-6f0d479322e5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:02.140501 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-19e8dcc7-e30b-4845-ad88-6f0d479322e5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:02.140923 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-19e8dcc7-e30b-4845-ad88-6f0d479322e5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:02.184763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-41956764-2ff5-4ce4-b695-020dfedc1637 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:02.185372 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-41956764-2ff5-4ce4-b695-020dfedc1637 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:02.191643 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-41956764-2ff5-4ce4-b695-020dfedc1637 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:02.192112 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-41956764-2ff5-4ce4-b695-020dfedc1637 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:02.192875 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-41956764-2ff5-4ce4-b695-020dfedc1637 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:02.193307 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-41956764-2ff5-4ce4-b695-020dfedc1637 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:02.255872 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-41956764-2ff5-4ce4-b695-020dfedc1637 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:02.263764 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-41956764-2ff5-4ce4-b695-020dfedc1637 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1293 microversion: 2.1 time: 0.082842 Apr 05 11:54:02.273430 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 269/490] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:02 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:02.277839 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-19e8dcc7-e30b-4845-ad88-6f0d479322e5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:02.285686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-19e8dcc7-e30b-4845-ad88-6f0d479322e5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:02.287338 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-19e8dcc7-e30b-4845-ad88-6f0d479322e5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:02.288704 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-19e8dcc7-e30b-4845-ad88-6f0d479322e5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1722 microversion: 2.20 time: 0.166422 Apr 05 11:54:02.289456 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 222/491] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:02 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:02.803109 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4891480b-7757-4d39-bb17-a31d7ac0b851 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:02.803684 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4891480b-7757-4d39-bb17-a31d7ac0b851 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:02.810443 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4891480b-7757-4d39-bb17-a31d7ac0b851 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:02.810883 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4891480b-7757-4d39-bb17-a31d7ac0b851 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:02.811641 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4891480b-7757-4d39-bb17-a31d7ac0b851 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:02.812064 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4891480b-7757-4d39-bb17-a31d7ac0b851 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:03.043231 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4891480b-7757-4d39-bb17-a31d7ac0b851 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:03.051716 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4891480b-7757-4d39-bb17-a31d7ac0b851 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1724 microversion: 2.1 time: 0.252586 Apr 05 11:54:03.052363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 270/492] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:02 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:03.290918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b4225346-392e-42c2-99e8-30cc9c2cda2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:03.291639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b4225346-392e-42c2-99e8-30cc9c2cda2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:03.298097 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b4225346-392e-42c2-99e8-30cc9c2cda2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:03.298616 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b4225346-392e-42c2-99e8-30cc9c2cda2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:03.299453 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b4225346-392e-42c2-99e8-30cc9c2cda2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:03.299956 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b4225346-392e-42c2-99e8-30cc9c2cda2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:03.306953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5f271f35-9b15-4b48-b858-9b50027b2ae1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:03.307563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5f271f35-9b15-4b48-b858-9b50027b2ae1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:03.314256 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5f271f35-9b15-4b48-b858-9b50027b2ae1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:03.315179 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5f271f35-9b15-4b48-b858-9b50027b2ae1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:03.316015 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5f271f35-9b15-4b48-b858-9b50027b2ae1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:03.316544 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5f271f35-9b15-4b48-b858-9b50027b2ae1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:03.458078 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b4225346-392e-42c2-99e8-30cc9c2cda2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:03.466136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b4225346-392e-42c2-99e8-30cc9c2cda2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1366 microversion: 2.1 time: 0.179471 Apr 05 11:54:03.466769 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 223/493] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:03 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:03.819769 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5f271f35-9b15-4b48-b858-9b50027b2ae1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:03.828145 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5f271f35-9b15-4b48-b858-9b50027b2ae1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:03.829621 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5f271f35-9b15-4b48-b858-9b50027b2ae1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:03.830766 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5f271f35-9b15-4b48-b858-9b50027b2ae1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1722 microversion: 2.20 time: 0.528075 Apr 05 11:54:03.831379 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 271/494] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:03 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1722 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:54:04.068975 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cc8b6fb8-f3cc-49a6-80c5-90d82040b47c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:04.069723 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cc8b6fb8-f3cc-49a6-80c5-90d82040b47c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:04.075633 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cc8b6fb8-f3cc-49a6-80c5-90d82040b47c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:04.076132 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cc8b6fb8-f3cc-49a6-80c5-90d82040b47c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:04.076852 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cc8b6fb8-f3cc-49a6-80c5-90d82040b47c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:04.077437 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cc8b6fb8-f3cc-49a6-80c5-90d82040b47c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:04.154734 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-d8f73566-eb1f-47bf-80e4-eeecefd27cb4 req-6d39bcf6-6860-4f89-a86f-79e2ffe2f228 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26584178-5dc8-4126-93eb-1126296c8e93", "tag": "e2222d8b-4df5-4df4-8bd2-7f837c08f6aa"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:54:04.165887 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-d8f73566-eb1f-47bf-80e4-eeecefd27cb4 req-6d39bcf6-6860-4f89-a86f-79e2ffe2f228 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:04.166695 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-d8f73566-eb1f-47bf-80e4-eeecefd27cb4 req-6d39bcf6-6860-4f89-a86f-79e2ffe2f228 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:04.186452 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-d8f73566-eb1f-47bf-80e4-eeecefd27cb4 req-6d39bcf6-6860-4f89-a86f-79e2ffe2f228 service nova] Creating event network-changed:e2222d8b-4df5-4df4-8bd2-7f837c08f6aa for instance 26584178-5dc8-4126-93eb-1126296c8e93 on hv-cinder-82956 Apr 05 11:54:04.192594 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-d8f73566-eb1f-47bf-80e4-eeecefd27cb4 req-6d39bcf6-6860-4f89-a86f-79e2ffe2f228 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044596 Apr 05 11:54:04.193768 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 272/495] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:54:04.244402 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-cc8b6fb8-f3cc-49a6-80c5-90d82040b47c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:04.253001 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cc8b6fb8-f3cc-49a6-80c5-90d82040b47c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1724 microversion: 2.1 time: 0.187795 Apr 05 11:54:04.256107 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 224/496] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:04 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:04.484256 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a1ec42d4-22d8-4710-b99f-d408b77c7ab5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:04.484951 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a1ec42d4-22d8-4710-b99f-d408b77c7ab5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:04.492727 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a1ec42d4-22d8-4710-b99f-d408b77c7ab5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:04.494689 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a1ec42d4-22d8-4710-b99f-d408b77c7ab5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:04.495218 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a1ec42d4-22d8-4710-b99f-d408b77c7ab5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:04.495780 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a1ec42d4-22d8-4710-b99f-d408b77c7ab5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:04.706385 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a1ec42d4-22d8-4710-b99f-d408b77c7ab5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:04.714308 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a1ec42d4-22d8-4710-b99f-d408b77c7ab5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1366 microversion: 2.1 time: 0.234666 Apr 05 11:54:04.714863 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 273/497] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:04 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:04.853833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b10960e2-aef1-4c86-b22c-eca041d65b8c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:04.854806 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b10960e2-aef1-4c86-b22c-eca041d65b8c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:04.865383 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b10960e2-aef1-4c86-b22c-eca041d65b8c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:04.866118 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b10960e2-aef1-4c86-b22c-eca041d65b8c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:04.867368 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b10960e2-aef1-4c86-b22c-eca041d65b8c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:04.868110 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b10960e2-aef1-4c86-b22c-eca041d65b8c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:05.008506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b10960e2-aef1-4c86-b22c-eca041d65b8c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:05.016819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b10960e2-aef1-4c86-b22c-eca041d65b8c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:05.018304 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b10960e2-aef1-4c86-b22c-eca041d65b8c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:05.019446 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b10960e2-aef1-4c86-b22c-eca041d65b8c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1722 microversion: 2.20 time: 0.172625 Apr 05 11:54:05.020006 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 225/498] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:04 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:05.275624 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cca0834b-46fd-4311-a6e1-cdea1a76a21c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:05.276529 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cca0834b-46fd-4311-a6e1-cdea1a76a21c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:05.287291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cca0834b-46fd-4311-a6e1-cdea1a76a21c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:05.288053 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cca0834b-46fd-4311-a6e1-cdea1a76a21c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:05.289354 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cca0834b-46fd-4311-a6e1-cdea1a76a21c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:05.290073 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cca0834b-46fd-4311-a6e1-cdea1a76a21c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:05.427483 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cca0834b-46fd-4311-a6e1-cdea1a76a21c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:05.436143 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cca0834b-46fd-4311-a6e1-cdea1a76a21c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1724 microversion: 2.1 time: 0.167102 Apr 05 11:54:05.436741 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 274/499] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:05 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:05.731593 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3b92a853-3e05-4962-ac7b-353d5213354c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:05.732248 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3b92a853-3e05-4962-ac7b-353d5213354c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:05.738787 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b92a853-3e05-4962-ac7b-353d5213354c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:05.739229 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b92a853-3e05-4962-ac7b-353d5213354c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:05.739985 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b92a853-3e05-4962-ac7b-353d5213354c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:05.740446 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b92a853-3e05-4962-ac7b-353d5213354c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:05.879457 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3b92a853-3e05-4962-ac7b-353d5213354c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:05.888638 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3b92a853-3e05-4962-ac7b-353d5213354c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1366 microversion: 2.1 time: 0.161058 Apr 05 11:54:05.889220 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 226/500] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:05 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:06.037618 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-717b3e36-cb9f-476e-912a-b59404fbd6a7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:06.038128 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-717b3e36-cb9f-476e-912a-b59404fbd6a7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:06.044428 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-717b3e36-cb9f-476e-912a-b59404fbd6a7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:06.044894 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-717b3e36-cb9f-476e-912a-b59404fbd6a7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:06.045635 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-717b3e36-cb9f-476e-912a-b59404fbd6a7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:06.046114 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-717b3e36-cb9f-476e-912a-b59404fbd6a7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:06.186511 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-717b3e36-cb9f-476e-912a-b59404fbd6a7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:06.198368 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-717b3e36-cb9f-476e-912a-b59404fbd6a7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:06.200644 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-717b3e36-cb9f-476e-912a-b59404fbd6a7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:06.202250 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-717b3e36-cb9f-476e-912a-b59404fbd6a7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1722 microversion: 2.20 time: 0.168522 Apr 05 11:54:06.203045 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 275/501] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:06 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:06.457305 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8cdbe7ac-ff44-46ef-9c1c-1b547c9626df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:06.458373 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8cdbe7ac-ff44-46ef-9c1c-1b547c9626df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:06.467260 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8cdbe7ac-ff44-46ef-9c1c-1b547c9626df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:06.467702 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8cdbe7ac-ff44-46ef-9c1c-1b547c9626df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:06.468519 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8cdbe7ac-ff44-46ef-9c1c-1b547c9626df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:06.468981 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8cdbe7ac-ff44-46ef-9c1c-1b547c9626df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:06.608201 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8cdbe7ac-ff44-46ef-9c1c-1b547c9626df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:06.616635 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8cdbe7ac-ff44-46ef-9c1c-1b547c9626df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1724 microversion: 2.1 time: 0.165846 Apr 05 11:54:06.617217 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 227/502] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:06 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:06.905759 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7a351796-d0e4-434c-9350-090d296d4a28 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:06.906339 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7a351796-d0e4-434c-9350-090d296d4a28 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:06.912986 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a351796-d0e4-434c-9350-090d296d4a28 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:06.913433 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a351796-d0e4-434c-9350-090d296d4a28 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:06.914200 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a351796-d0e4-434c-9350-090d296d4a28 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:06.914626 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a351796-d0e4-434c-9350-090d296d4a28 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:07.051493 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7a351796-d0e4-434c-9350-090d296d4a28 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:07.059302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7a351796-d0e4-434c-9350-090d296d4a28 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1366 microversion: 2.1 time: 0.157908 Apr 05 11:54:07.059848 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 276/503] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:06 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:07.225906 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-66e359f8-3718-45d3-9eb3-c5e825de5406 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:07.228319 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-66e359f8-3718-45d3-9eb3-c5e825de5406 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:07.235811 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66e359f8-3718-45d3-9eb3-c5e825de5406 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:07.236664 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66e359f8-3718-45d3-9eb3-c5e825de5406 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:07.237627 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66e359f8-3718-45d3-9eb3-c5e825de5406 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:07.238067 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66e359f8-3718-45d3-9eb3-c5e825de5406 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:07.372138 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-66e359f8-3718-45d3-9eb3-c5e825de5406 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:07.379928 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-66e359f8-3718-45d3-9eb3-c5e825de5406 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:07.381442 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-66e359f8-3718-45d3-9eb3-c5e825de5406 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:07.382592 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-66e359f8-3718-45d3-9eb3-c5e825de5406 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1722 microversion: 2.20 time: 0.163999 Apr 05 11:54:07.392176 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 228/504] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:07 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:07.634681 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5a1f94cd-183c-4064-bb58-1afb1bd01cc4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:07.635287 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5a1f94cd-183c-4064-bb58-1afb1bd01cc4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:07.641279 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5a1f94cd-183c-4064-bb58-1afb1bd01cc4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:07.641732 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5a1f94cd-183c-4064-bb58-1afb1bd01cc4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:07.642476 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5a1f94cd-183c-4064-bb58-1afb1bd01cc4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:07.642908 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5a1f94cd-183c-4064-bb58-1afb1bd01cc4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:07.798375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5a1f94cd-183c-4064-bb58-1afb1bd01cc4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:07.806260 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5a1f94cd-183c-4064-bb58-1afb1bd01cc4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1724 microversion: 2.1 time: 0.175866 Apr 05 11:54:07.806856 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 277/505] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:07 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:08.078297 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8f62b885-416d-4d6e-90ce-c96a87bf5269 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:08.078808 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8f62b885-416d-4d6e-90ce-c96a87bf5269 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:08.085404 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f62b885-416d-4d6e-90ce-c96a87bf5269 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:08.085840 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f62b885-416d-4d6e-90ce-c96a87bf5269 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:08.086616 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f62b885-416d-4d6e-90ce-c96a87bf5269 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:08.087050 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f62b885-416d-4d6e-90ce-c96a87bf5269 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:08.221980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8f62b885-416d-4d6e-90ce-c96a87bf5269 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:08.230144 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8f62b885-416d-4d6e-90ce-c96a87bf5269 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1366 microversion: 2.1 time: 0.156145 Apr 05 11:54:08.230821 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 229/506] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:08 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:08.401388 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d9533e86-c4e7-4460-9dc0-65f4e9a0a068 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:08.401967 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d9533e86-c4e7-4460-9dc0-65f4e9a0a068 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:08.408824 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d9533e86-c4e7-4460-9dc0-65f4e9a0a068 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:08.409310 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d9533e86-c4e7-4460-9dc0-65f4e9a0a068 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:08.410079 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d9533e86-c4e7-4460-9dc0-65f4e9a0a068 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:08.410511 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d9533e86-c4e7-4460-9dc0-65f4e9a0a068 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:08.553793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d9533e86-c4e7-4460-9dc0-65f4e9a0a068 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:08.563319 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d9533e86-c4e7-4460-9dc0-65f4e9a0a068 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:08.564834 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d9533e86-c4e7-4460-9dc0-65f4e9a0a068 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:08.565982 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d9533e86-c4e7-4460-9dc0-65f4e9a0a068 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1743 microversion: 2.20 time: 0.168614 Apr 05 11:54:08.566551 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 278/507] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:08 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:08.827770 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3229c78e-e8d3-44a3-b658-aa1b66d8d11a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:08.828817 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3229c78e-e8d3-44a3-b658-aa1b66d8d11a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:08.839561 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3229c78e-e8d3-44a3-b658-aa1b66d8d11a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:08.840549 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3229c78e-e8d3-44a3-b658-aa1b66d8d11a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:08.841808 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3229c78e-e8d3-44a3-b658-aa1b66d8d11a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:08.842523 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3229c78e-e8d3-44a3-b658-aa1b66d8d11a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:08.985016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3229c78e-e8d3-44a3-b658-aa1b66d8d11a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:08.993743 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3229c78e-e8d3-44a3-b658-aa1b66d8d11a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1724 microversion: 2.1 time: 0.172568 Apr 05 11:54:08.994330 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 230/508] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:08 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:09.247048 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-42ce72bd-0839-4d34-9112-b5ea83c25cc3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:09.247646 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-42ce72bd-0839-4d34-9112-b5ea83c25cc3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:09.253928 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-42ce72bd-0839-4d34-9112-b5ea83c25cc3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:09.254365 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-42ce72bd-0839-4d34-9112-b5ea83c25cc3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:09.255118 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-42ce72bd-0839-4d34-9112-b5ea83c25cc3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:09.255540 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-42ce72bd-0839-4d34-9112-b5ea83c25cc3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:09.394125 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-42ce72bd-0839-4d34-9112-b5ea83c25cc3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:09.401674 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-42ce72bd-0839-4d34-9112-b5ea83c25cc3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1366 microversion: 2.1 time: 0.158565 Apr 05 11:54:09.402342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 279/509] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:09 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:09.584470 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1727a43c-2256-4546-8746-0502ce6a6cff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:09.585068 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1727a43c-2256-4546-8746-0502ce6a6cff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:09.591228 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1727a43c-2256-4546-8746-0502ce6a6cff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:09.591675 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1727a43c-2256-4546-8746-0502ce6a6cff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:09.592461 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1727a43c-2256-4546-8746-0502ce6a6cff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:09.592887 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1727a43c-2256-4546-8746-0502ce6a6cff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:09.725819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1727a43c-2256-4546-8746-0502ce6a6cff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:09.734150 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1727a43c-2256-4546-8746-0502ce6a6cff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:09.735646 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1727a43c-2256-4546-8746-0502ce6a6cff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:09.736832 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1727a43c-2256-4546-8746-0502ce6a6cff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1743 microversion: 2.20 time: 0.156355 Apr 05 11:54:09.737372 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 231/510] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:09 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:10.010714 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1794b85c-5b33-40db-ab9c-546ea042f42b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:10.011327 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1794b85c-5b33-40db-ab9c-546ea042f42b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:10.017437 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1794b85c-5b33-40db-ab9c-546ea042f42b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:10.017882 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1794b85c-5b33-40db-ab9c-546ea042f42b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:10.018633 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1794b85c-5b33-40db-ab9c-546ea042f42b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:10.019063 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1794b85c-5b33-40db-ab9c-546ea042f42b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:10.154438 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1794b85c-5b33-40db-ab9c-546ea042f42b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:10.162776 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1794b85c-5b33-40db-ab9c-546ea042f42b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1724 microversion: 2.1 time: 0.155958 Apr 05 11:54:10.163380 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 280/511] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:10 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:10.417888 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-97e1f125-78f2-43b7-b36b-6e84e8e07b89 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:10.418589 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-97e1f125-78f2-43b7-b36b-6e84e8e07b89 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:10.425229 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-97e1f125-78f2-43b7-b36b-6e84e8e07b89 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:10.425674 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-97e1f125-78f2-43b7-b36b-6e84e8e07b89 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:10.426435 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-97e1f125-78f2-43b7-b36b-6e84e8e07b89 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:10.426868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-97e1f125-78f2-43b7-b36b-6e84e8e07b89 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:10.560182 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-97e1f125-78f2-43b7-b36b-6e84e8e07b89 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:10.568111 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-97e1f125-78f2-43b7-b36b-6e84e8e07b89 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1366 microversion: 2.1 time: 0.154173 Apr 05 11:54:10.568701 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 232/512] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:10 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:10.757301 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fe6c6610-91d5-4225-8106-d07b238c1352 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:10.758129 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fe6c6610-91d5-4225-8106-d07b238c1352 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:10.766675 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fe6c6610-91d5-4225-8106-d07b238c1352 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:10.767263 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fe6c6610-91d5-4225-8106-d07b238c1352 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:10.768317 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fe6c6610-91d5-4225-8106-d07b238c1352 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:10.768886 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fe6c6610-91d5-4225-8106-d07b238c1352 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:10.914117 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fe6c6610-91d5-4225-8106-d07b238c1352 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:10.923869 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fe6c6610-91d5-4225-8106-d07b238c1352 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:10.925399 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fe6c6610-91d5-4225-8106-d07b238c1352 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:10.926554 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fe6c6610-91d5-4225-8106-d07b238c1352 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1743 microversion: 2.20 time: 0.174495 Apr 05 11:54:10.927124 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 281/513] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:10 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1743 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:11.187063 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-909baa81-adab-494a-9a6f-4b39488f56c3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:11.188315 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-909baa81-adab-494a-9a6f-4b39488f56c3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:11.198193 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-909baa81-adab-494a-9a6f-4b39488f56c3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:11.198946 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-909baa81-adab-494a-9a6f-4b39488f56c3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:11.200252 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-909baa81-adab-494a-9a6f-4b39488f56c3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:11.200735 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-909baa81-adab-494a-9a6f-4b39488f56c3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:11.350596 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-909baa81-adab-494a-9a6f-4b39488f56c3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:11.359683 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-909baa81-adab-494a-9a6f-4b39488f56c3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1724 microversion: 2.1 time: 0.182146 Apr 05 11:54:11.360323 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 233/514] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:11 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:11.584963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9872dd1f-606c-4648-8313-030e805a773b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:11.585576 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9872dd1f-606c-4648-8313-030e805a773b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:11.592174 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9872dd1f-606c-4648-8313-030e805a773b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:11.592628 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9872dd1f-606c-4648-8313-030e805a773b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:11.593386 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9872dd1f-606c-4648-8313-030e805a773b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:11.593818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9872dd1f-606c-4648-8313-030e805a773b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:11.729622 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9872dd1f-606c-4648-8313-030e805a773b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:11.738009 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9872dd1f-606c-4648-8313-030e805a773b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1366 microversion: 2.1 time: 0.156871 Apr 05 11:54:11.738570 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 282/515] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:11 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:11.945436 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-369f0a26-cf07-430a-a487-e954a998803b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:11.946044 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-369f0a26-cf07-430a-a487-e954a998803b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:11.952381 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-369f0a26-cf07-430a-a487-e954a998803b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:11.952828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-369f0a26-cf07-430a-a487-e954a998803b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:11.953594 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-369f0a26-cf07-430a-a487-e954a998803b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:11.954020 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-369f0a26-cf07-430a-a487-e954a998803b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:12.088903 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-369f0a26-cf07-430a-a487-e954a998803b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:12.097024 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-369f0a26-cf07-430a-a487-e954a998803b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:12.098513 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-369f0a26-cf07-430a-a487-e954a998803b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:12.099657 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-369f0a26-cf07-430a-a487-e954a998803b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1738 microversion: 2.20 time: 0.158136 Apr 05 11:54:12.100489 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 234/516] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:11 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:12.381605 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a5f76181-f634-46b5-9881-0adb6822ea07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:12.382947 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a5f76181-f634-46b5-9881-0adb6822ea07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:12.391442 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5f76181-f634-46b5-9881-0adb6822ea07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:12.392345 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5f76181-f634-46b5-9881-0adb6822ea07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:12.393397 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5f76181-f634-46b5-9881-0adb6822ea07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:12.394057 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5f76181-f634-46b5-9881-0adb6822ea07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:12.479509 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-3b576d42-89c2-434a-931a-67d11712db0d req-624a3352-0f62-4434-b1d3-6504cc86851a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a3437c-94c0-4133-a629-9386b4639a2d", "name": "network-vif-plugged", "status": "completed", "tag": "4b172ae7-f382-4bd9-8d9f-48fd8694b406"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:54:12.491186 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-3b576d42-89c2-434a-931a-67d11712db0d req-624a3352-0f62-4434-b1d3-6504cc86851a service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:12.497868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-3b576d42-89c2-434a-931a-67d11712db0d req-624a3352-0f62-4434-b1d3-6504cc86851a service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:12.523980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-3b576d42-89c2-434a-931a-67d11712db0d req-624a3352-0f62-4434-b1d3-6504cc86851a service nova] Creating event network-vif-plugged:4b172ae7-f382-4bd9-8d9f-48fd8694b406 for instance 98a3437c-94c0-4133-a629-9386b4639a2d on hv-cinder-82956 Apr 05 11:54:12.536294 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-3b576d42-89c2-434a-931a-67d11712db0d req-624a3352-0f62-4434-b1d3-6504cc86851a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062344 Apr 05 11:54:12.536915 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 235/517] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:54:12.588499 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a5f76181-f634-46b5-9881-0adb6822ea07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:12.596721 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a5f76181-f634-46b5-9881-0adb6822ea07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1724 microversion: 2.1 time: 0.219361 Apr 05 11:54:12.607413 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 283/518] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:12 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:12.759778 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-afaf5ae4-e287-480b-94b5-16982a5d11a8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:12.759778 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-afaf5ae4-e287-480b-94b5-16982a5d11a8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:12.762850 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-afaf5ae4-e287-480b-94b5-16982a5d11a8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:12.763299 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-afaf5ae4-e287-480b-94b5-16982a5d11a8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:12.764094 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-afaf5ae4-e287-480b-94b5-16982a5d11a8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:12.764532 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-afaf5ae4-e287-480b-94b5-16982a5d11a8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:12.930397 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-afaf5ae4-e287-480b-94b5-16982a5d11a8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:12.938025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-afaf5ae4-e287-480b-94b5-16982a5d11a8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1366 microversion: 2.1 time: 0.186810 Apr 05 11:54:12.938613 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 236/519] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:12 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:13.119263 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1f61a93d-cad0-49eb-a8ea-f790be50a501 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:13.120817 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1f61a93d-cad0-49eb-a8ea-f790be50a501 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:13.127199 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1f61a93d-cad0-49eb-a8ea-f790be50a501 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:13.127649 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1f61a93d-cad0-49eb-a8ea-f790be50a501 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:13.128718 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1f61a93d-cad0-49eb-a8ea-f790be50a501 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:13.129368 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1f61a93d-cad0-49eb-a8ea-f790be50a501 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:13.274277 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1f61a93d-cad0-49eb-a8ea-f790be50a501 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:13.282416 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1f61a93d-cad0-49eb-a8ea-f790be50a501 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:13.284523 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1f61a93d-cad0-49eb-a8ea-f790be50a501 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:13.285883 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1f61a93d-cad0-49eb-a8ea-f790be50a501 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1738 microversion: 2.20 time: 0.171018 Apr 05 11:54:13.286492 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 284/520] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:13 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:13.613604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-dbe5335e-9297-4b12-9e82-1da2adce5b4d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:13.615041 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-dbe5335e-9297-4b12-9e82-1da2adce5b4d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:13.621796 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dbe5335e-9297-4b12-9e82-1da2adce5b4d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:13.622223 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dbe5335e-9297-4b12-9e82-1da2adce5b4d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:13.622979 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dbe5335e-9297-4b12-9e82-1da2adce5b4d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:13.623406 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dbe5335e-9297-4b12-9e82-1da2adce5b4d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:13.761679 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-dbe5335e-9297-4b12-9e82-1da2adce5b4d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:13.770035 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-dbe5335e-9297-4b12-9e82-1da2adce5b4d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1724 microversion: 2.1 time: 0.160314 Apr 05 11:54:13.770642 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 237/521] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:13 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:13.955504 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-407ea445-cb4c-4165-ade1-b77cdf064c73 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:13.956309 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-407ea445-cb4c-4165-ade1-b77cdf064c73 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:13.963375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-407ea445-cb4c-4165-ade1-b77cdf064c73 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:13.963827 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-407ea445-cb4c-4165-ade1-b77cdf064c73 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:13.964630 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-407ea445-cb4c-4165-ade1-b77cdf064c73 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:13.965059 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-407ea445-cb4c-4165-ade1-b77cdf064c73 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:14.114593 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-407ea445-cb4c-4165-ade1-b77cdf064c73 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:14.123918 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-407ea445-cb4c-4165-ade1-b77cdf064c73 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1366 microversion: 2.1 time: 0.172141 Apr 05 11:54:14.134867 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 285/522] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:13 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:14.305024 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-156fe0d3-9a08-4f81-9eab-497b07104ba4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:14.305639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-156fe0d3-9a08-4f81-9eab-497b07104ba4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:14.314078 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-156fe0d3-9a08-4f81-9eab-497b07104ba4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:14.314464 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-156fe0d3-9a08-4f81-9eab-497b07104ba4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:14.315220 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-156fe0d3-9a08-4f81-9eab-497b07104ba4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:14.315643 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-156fe0d3-9a08-4f81-9eab-497b07104ba4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:14.464874 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-156fe0d3-9a08-4f81-9eab-497b07104ba4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:14.474185 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-156fe0d3-9a08-4f81-9eab-497b07104ba4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:14.476340 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-156fe0d3-9a08-4f81-9eab-497b07104ba4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:14.477709 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-156fe0d3-9a08-4f81-9eab-497b07104ba4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1738 microversion: 2.20 time: 0.176900 Apr 05 11:54:14.478274 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 238/523] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:14 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:14.556581 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-2fe14515-4c7f-4a49-8c86-51bfe5b7a650 req-040b8646-b178-49d2-8a89-83871fa6da67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26584178-5dc8-4126-93eb-1126296c8e93", "name": "network-vif-plugged", "status": "completed", "tag": "e2222d8b-4df5-4df4-8bd2-7f837c08f6aa"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:54:14.565557 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-2fe14515-4c7f-4a49-8c86-51bfe5b7a650 req-040b8646-b178-49d2-8a89-83871fa6da67 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:14.566283 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-2fe14515-4c7f-4a49-8c86-51bfe5b7a650 req-040b8646-b178-49d2-8a89-83871fa6da67 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:14.577973 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-2fe14515-4c7f-4a49-8c86-51bfe5b7a650 req-040b8646-b178-49d2-8a89-83871fa6da67 service nova] Creating event network-vif-plugged:e2222d8b-4df5-4df4-8bd2-7f837c08f6aa for instance 26584178-5dc8-4126-93eb-1126296c8e93 on hv-cinder-82956 Apr 05 11:54:14.583540 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-2fe14515-4c7f-4a49-8c86-51bfe5b7a650 req-040b8646-b178-49d2-8a89-83871fa6da67 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030657 Apr 05 11:54:14.584426 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 286/524] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:54:14.786802 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b5c19d4e-34ba-4190-8b6d-df33c24be4fa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:14.787428 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b5c19d4e-34ba-4190-8b6d-df33c24be4fa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:14.794429 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b5c19d4e-34ba-4190-8b6d-df33c24be4fa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:14.794860 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b5c19d4e-34ba-4190-8b6d-df33c24be4fa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:14.795635 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b5c19d4e-34ba-4190-8b6d-df33c24be4fa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:14.796109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b5c19d4e-34ba-4190-8b6d-df33c24be4fa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:14.978333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b5c19d4e-34ba-4190-8b6d-df33c24be4fa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:14.988559 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b5c19d4e-34ba-4190-8b6d-df33c24be4fa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1724 microversion: 2.1 time: 0.204715 Apr 05 11:54:14.998150 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 239/525] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:14 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:15.142720 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a57a12ac-d543-4898-97bd-2dcd2ee1f6f0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:15.143517 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a57a12ac-d543-4898-97bd-2dcd2ee1f6f0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:15.151316 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a57a12ac-d543-4898-97bd-2dcd2ee1f6f0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:15.151766 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a57a12ac-d543-4898-97bd-2dcd2ee1f6f0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:15.152742 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a57a12ac-d543-4898-97bd-2dcd2ee1f6f0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:15.153184 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a57a12ac-d543-4898-97bd-2dcd2ee1f6f0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:15.302824 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a57a12ac-d543-4898-97bd-2dcd2ee1f6f0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:15.310217 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a57a12ac-d543-4898-97bd-2dcd2ee1f6f0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1366 microversion: 2.1 time: 0.172143 Apr 05 11:54:15.310786 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 287/526] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:15 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:15.496395 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b76843cb-33da-40ff-9a29-84fcd3c972ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:15.497020 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b76843cb-33da-40ff-9a29-84fcd3c972ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:15.510550 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b76843cb-33da-40ff-9a29-84fcd3c972ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:15.511000 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b76843cb-33da-40ff-9a29-84fcd3c972ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:15.511870 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b76843cb-33da-40ff-9a29-84fcd3c972ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:15.512324 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b76843cb-33da-40ff-9a29-84fcd3c972ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:15.655726 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b76843cb-33da-40ff-9a29-84fcd3c972ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:15.666533 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b76843cb-33da-40ff-9a29-84fcd3c972ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:15.668089 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b76843cb-33da-40ff-9a29-84fcd3c972ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:15.669260 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b76843cb-33da-40ff-9a29-84fcd3c972ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1738 microversion: 2.20 time: 0.176956 Apr 05 11:54:15.670474 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 240/527] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:15 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:16.005612 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bac4a154-2848-4dac-8029-810c9f755ded tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:16.006686 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bac4a154-2848-4dac-8029-810c9f755ded tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:16.013225 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bac4a154-2848-4dac-8029-810c9f755ded tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:16.013754 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bac4a154-2848-4dac-8029-810c9f755ded tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:16.014520 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bac4a154-2848-4dac-8029-810c9f755ded tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:16.014998 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bac4a154-2848-4dac-8029-810c9f755ded tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:16.169290 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bac4a154-2848-4dac-8029-810c9f755ded tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:16.180911 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bac4a154-2848-4dac-8029-810c9f755ded tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1724 microversion: 2.1 time: 0.178904 Apr 05 11:54:16.182419 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 288/528] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:16 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:16.330412 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-59572c29-81aa-4547-b7b9-dfe384d1671c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:16.342792 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-59572c29-81aa-4547-b7b9-dfe384d1671c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:16.347485 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6d8555e8-59ff-4f5c-99f3-e7aa97397c91 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "729a4584-d0c1-4727-9a6e-0e9f66907337", "device": "/dev/sdb"}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:54:16.349392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6d8555e8-59ff-4f5c-99f3-e7aa97397c91 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 1a6b36d8-6a9a-421b-bbda-e56342ccca79] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:16.353129 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-59572c29-81aa-4547-b7b9-dfe384d1671c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:16.354594 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-59572c29-81aa-4547-b7b9-dfe384d1671c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:16.356329 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-59572c29-81aa-4547-b7b9-dfe384d1671c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:16.357039 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-59572c29-81aa-4547-b7b9-dfe384d1671c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:16.357279 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6d8555e8-59ff-4f5c-99f3-e7aa97397c91 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:16.357791 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6d8555e8-59ff-4f5c-99f3-e7aa97397c91 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:16.358627 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6d8555e8-59ff-4f5c-99f3-e7aa97397c91 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:16.359122 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6d8555e8-59ff-4f5c-99f3-e7aa97397c91 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:16.516833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-59572c29-81aa-4547-b7b9-dfe384d1671c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:16.524802 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-59572c29-81aa-4547-b7b9-dfe384d1671c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1366 microversion: 2.1 time: 0.200630 Apr 05 11:54:16.525641 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 241/529] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:16 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:16.690583 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-653af307-77d3-497f-a4ef-2d0d13ede3d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:16.691262 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-653af307-77d3-497f-a4ef-2d0d13ede3d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:16.709030 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-653af307-77d3-497f-a4ef-2d0d13ede3d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:16.709593 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-653af307-77d3-497f-a4ef-2d0d13ede3d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:16.710458 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-653af307-77d3-497f-a4ef-2d0d13ede3d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:16.710954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-653af307-77d3-497f-a4ef-2d0d13ede3d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:16.874673 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6d8555e8-59ff-4f5c-99f3-e7aa97397c91 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "POST /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.531724 Apr 05 11:54:16.876134 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 289/530] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Apr 5 11:54:16 2022] POST /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79/os-volume_attachments => generated 194 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:54:16.892103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-653af307-77d3-497f-a4ef-2d0d13ede3d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:16.903013 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-653af307-77d3-497f-a4ef-2d0d13ede3d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:16.909941 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-653af307-77d3-497f-a4ef-2d0d13ede3d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:16.917754 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-653af307-77d3-497f-a4ef-2d0d13ede3d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1738 microversion: 2.20 time: 0.226648 Apr 05 11:54:16.928888 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 242/531] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:16 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:54:17.201766 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-884f89d5-afdb-468f-b1c8-48749c30de16 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:17.203138 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-884f89d5-afdb-468f-b1c8-48749c30de16 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:17.210734 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-884f89d5-afdb-468f-b1c8-48749c30de16 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:17.211104 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-884f89d5-afdb-468f-b1c8-48749c30de16 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:17.212083 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-884f89d5-afdb-468f-b1c8-48749c30de16 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:17.212544 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-884f89d5-afdb-468f-b1c8-48749c30de16 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:17.368434 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-884f89d5-afdb-468f-b1c8-48749c30de16 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:17.376872 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-884f89d5-afdb-468f-b1c8-48749c30de16 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1701 microversion: 2.1 time: 0.181383 Apr 05 11:54:17.377902 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 290/532] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:17 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1701 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:17.395132 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-24cdeb02-4c9a-4791-8e76-ef91c6114b0d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:54:17.405094 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-24cdeb02-4c9a-4791-8e76-ef91c6114b0d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:17.405537 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-24cdeb02-4c9a-4791-8e76-ef91c6114b0d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:17.474076 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-24cdeb02-4c9a-4791-8e76-ef91c6114b0d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Going to try to start instance {{(pid=123357) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 05 11:54:17.523162 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-24cdeb02-4c9a-4791-8e76-ef91c6114b0d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "POST /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/action" status: 202 len: 0 microversion: 2.1 time: 0.132585 Apr 05 11:54:17.523771 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 243/533] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Apr 5 11:54:17 2022] POST /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:54:17.531919 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c1333ad6-e7dd-4f3d-9014-371ce4557347 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:17.533068 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c1333ad6-e7dd-4f3d-9014-371ce4557347 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:17.541773 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c1333ad6-e7dd-4f3d-9014-371ce4557347 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:17.542230 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c1333ad6-e7dd-4f3d-9014-371ce4557347 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:17.543080 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c1333ad6-e7dd-4f3d-9014-371ce4557347 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:17.543525 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c1333ad6-e7dd-4f3d-9014-371ce4557347 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:17.545057 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cd0d0336-fff0-411a-9811-d8e5f235e8d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:17.546534 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cd0d0336-fff0-411a-9811-d8e5f235e8d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:17.557234 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd0d0336-fff0-411a-9811-d8e5f235e8d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:17.558419 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd0d0336-fff0-411a-9811-d8e5f235e8d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:17.559970 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd0d0336-fff0-411a-9811-d8e5f235e8d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:17.561164 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd0d0336-fff0-411a-9811-d8e5f235e8d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:17.727744 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-cd0d0336-fff0-411a-9811-d8e5f235e8d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:17.736221 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cd0d0336-fff0-411a-9811-d8e5f235e8d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1555 microversion: 2.1 time: 0.197760 Apr 05 11:54:17.737071 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 244/534] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:17 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1555 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:17.747586 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c1333ad6-e7dd-4f3d-9014-371ce4557347 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:17.756987 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c1333ad6-e7dd-4f3d-9014-371ce4557347 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1710 microversion: 2.1 time: 0.228743 Apr 05 11:54:17.757951 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 291/535] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:17 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1710 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:17.761458 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-df906b99-159f-4d1e-8106-5d3926e66cb1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:17.762181 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-df906b99-159f-4d1e-8106-5d3926e66cb1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:17.772571 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-df906b99-159f-4d1e-8106-5d3926e66cb1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:17.773016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-df906b99-159f-4d1e-8106-5d3926e66cb1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:17.773799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-df906b99-159f-4d1e-8106-5d3926e66cb1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:17.774228 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-df906b99-159f-4d1e-8106-5d3926e66cb1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:17.867416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-df906b99-159f-4d1e-8106-5d3926e66cb1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110265 Apr 05 11:54:17.874823 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 245/536] 10.222.0.61 () {58 vars in 1274 bytes} [Tue Apr 5 11:54:17 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:54:17.940782 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6799da22-a6b4-43cf-ad9e-114c99898bc0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:17.941383 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6799da22-a6b4-43cf-ad9e-114c99898bc0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:17.955012 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6799da22-a6b4-43cf-ad9e-114c99898bc0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:17.955531 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6799da22-a6b4-43cf-ad9e-114c99898bc0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:17.956330 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6799da22-a6b4-43cf-ad9e-114c99898bc0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:17.956732 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6799da22-a6b4-43cf-ad9e-114c99898bc0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:18.163165 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6799da22-a6b4-43cf-ad9e-114c99898bc0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:18.173115 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6799da22-a6b4-43cf-ad9e-114c99898bc0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:18.175017 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6799da22-a6b4-43cf-ad9e-114c99898bc0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:18.176229 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6799da22-a6b4-43cf-ad9e-114c99898bc0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1738 microversion: 2.20 time: 0.243715 Apr 05 11:54:18.188006 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 292/537] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:17 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1738 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:18.775600 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-06613fc4-68be-45b1-8fa6-885e607dc5ab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:18.776233 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-06613fc4-68be-45b1-8fa6-885e607dc5ab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:18.788055 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-06613fc4-68be-45b1-8fa6-885e607dc5ab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:18.788541 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-06613fc4-68be-45b1-8fa6-885e607dc5ab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:18.789318 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-06613fc4-68be-45b1-8fa6-885e607dc5ab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:18.789745 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-06613fc4-68be-45b1-8fa6-885e607dc5ab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:19.063931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-06613fc4-68be-45b1-8fa6-885e607dc5ab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:19.075462 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-06613fc4-68be-45b1-8fa6-885e607dc5ab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1710 microversion: 2.1 time: 0.304563 Apr 05 11:54:19.076390 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 246/538] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:18 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1710 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:19.196170 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c58f1243-b2f1-4340-83db-210e216b5d3b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:19.197384 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c58f1243-b2f1-4340-83db-210e216b5d3b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:19.205090 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c58f1243-b2f1-4340-83db-210e216b5d3b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:19.206252 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c58f1243-b2f1-4340-83db-210e216b5d3b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:19.207394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c58f1243-b2f1-4340-83db-210e216b5d3b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:19.208259 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c58f1243-b2f1-4340-83db-210e216b5d3b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:19.364112 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c58f1243-b2f1-4340-83db-210e216b5d3b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:19.372870 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c58f1243-b2f1-4340-83db-210e216b5d3b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:19.374366 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c58f1243-b2f1-4340-83db-210e216b5d3b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:19.375515 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c58f1243-b2f1-4340-83db-210e216b5d3b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1738 microversion: 2.20 time: 0.184198 Apr 05 11:54:19.395070 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 293/539] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:19 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:19.429877 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-e5e2fbff-e7f1-438d-a071-28d7fd5a0af9 req-36c11b74-33f8-412f-be35-08df538d5715 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26584178-5dc8-4126-93eb-1126296c8e93", "tag": "e2222d8b-4df5-4df4-8bd2-7f837c08f6aa"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:54:19.439995 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-e5e2fbff-e7f1-438d-a071-28d7fd5a0af9 req-36c11b74-33f8-412f-be35-08df538d5715 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:19.440616 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-e5e2fbff-e7f1-438d-a071-28d7fd5a0af9 req-36c11b74-33f8-412f-be35-08df538d5715 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:19.454561 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-e5e2fbff-e7f1-438d-a071-28d7fd5a0af9 req-36c11b74-33f8-412f-be35-08df538d5715 service nova] Creating event network-changed:e2222d8b-4df5-4df4-8bd2-7f837c08f6aa for instance 26584178-5dc8-4126-93eb-1126296c8e93 on hv-cinder-82956 Apr 05 11:54:19.460147 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-e5e2fbff-e7f1-438d-a071-28d7fd5a0af9 req-36c11b74-33f8-412f-be35-08df538d5715 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033838 Apr 05 11:54:19.461718 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 247/540] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:54:20.093023 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-79c14bcb-37e6-4d7b-8d41-2f26aa34f601 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:20.093610 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-79c14bcb-37e6-4d7b-8d41-2f26aa34f601 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:20.102411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79c14bcb-37e6-4d7b-8d41-2f26aa34f601 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:20.103056 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79c14bcb-37e6-4d7b-8d41-2f26aa34f601 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:20.104378 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79c14bcb-37e6-4d7b-8d41-2f26aa34f601 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:20.105107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79c14bcb-37e6-4d7b-8d41-2f26aa34f601 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:20.380747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-79c14bcb-37e6-4d7b-8d41-2f26aa34f601 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:20.391602 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-79c14bcb-37e6-4d7b-8d41-2f26aa34f601 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1710 microversion: 2.1 time: 0.302293 Apr 05 11:54:20.394168 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 294/541] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:20 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1710 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:20.397778 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1b42d932-9f3c-4931-ad8a-0b56e5b50dac tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:20.399036 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1b42d932-9f3c-4931-ad8a-0b56e5b50dac tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:20.408159 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1b42d932-9f3c-4931-ad8a-0b56e5b50dac tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:20.408793 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1b42d932-9f3c-4931-ad8a-0b56e5b50dac tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:20.410609 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1b42d932-9f3c-4931-ad8a-0b56e5b50dac tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:20.410981 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1b42d932-9f3c-4931-ad8a-0b56e5b50dac tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:20.586823 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1b42d932-9f3c-4931-ad8a-0b56e5b50dac tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:20.596103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1b42d932-9f3c-4931-ad8a-0b56e5b50dac tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:20.597610 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1b42d932-9f3c-4931-ad8a-0b56e5b50dac tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:20.598770 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1b42d932-9f3c-4931-ad8a-0b56e5b50dac tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1738 microversion: 2.20 time: 0.208636 Apr 05 11:54:20.599628 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 248/542] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:20 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:54:21.408700 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c5ae62b0-17d9-4d6c-a6e8-f24da9089fee tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:21.410150 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c5ae62b0-17d9-4d6c-a6e8-f24da9089fee tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:21.416495 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c5ae62b0-17d9-4d6c-a6e8-f24da9089fee tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:21.417179 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c5ae62b0-17d9-4d6c-a6e8-f24da9089fee tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:21.418023 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c5ae62b0-17d9-4d6c-a6e8-f24da9089fee tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:21.418457 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c5ae62b0-17d9-4d6c-a6e8-f24da9089fee tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:21.566570 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c5ae62b0-17d9-4d6c-a6e8-f24da9089fee tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:21.575794 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c5ae62b0-17d9-4d6c-a6e8-f24da9089fee tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1714 microversion: 2.1 time: 0.170897 Apr 05 11:54:21.586201 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 295/543] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:21 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1714 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:21.617551 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-68c27446-b3eb-41a5-8e40-0b44e6ca8168 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:21.618163 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-68c27446-b3eb-41a5-8e40-0b44e6ca8168 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:21.625162 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-68c27446-b3eb-41a5-8e40-0b44e6ca8168 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:21.625807 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-68c27446-b3eb-41a5-8e40-0b44e6ca8168 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:21.626564 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-68c27446-b3eb-41a5-8e40-0b44e6ca8168 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:21.627159 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-68c27446-b3eb-41a5-8e40-0b44e6ca8168 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:21.783983 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-68c27446-b3eb-41a5-8e40-0b44e6ca8168 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:21.791952 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-68c27446-b3eb-41a5-8e40-0b44e6ca8168 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:21.793515 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-68c27446-b3eb-41a5-8e40-0b44e6ca8168 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:21.795079 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-68c27446-b3eb-41a5-8e40-0b44e6ca8168 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1738 microversion: 2.20 time: 0.181463 Apr 05 11:54:21.795659 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 249/544] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:21 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:54:22.814549 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-95748fe0-7254-4b4c-ab0c-1c4960e6fc85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:22.815157 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-95748fe0-7254-4b4c-ab0c-1c4960e6fc85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:22.821762 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95748fe0-7254-4b4c-ab0c-1c4960e6fc85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:22.822216 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95748fe0-7254-4b4c-ab0c-1c4960e6fc85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:22.822982 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95748fe0-7254-4b4c-ab0c-1c4960e6fc85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:22.823416 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95748fe0-7254-4b4c-ab0c-1c4960e6fc85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:23.040151 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-95748fe0-7254-4b4c-ab0c-1c4960e6fc85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:23.050212 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-95748fe0-7254-4b4c-ab0c-1c4960e6fc85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:23.051770 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-95748fe0-7254-4b4c-ab0c-1c4960e6fc85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:23.052914 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-95748fe0-7254-4b4c-ab0c-1c4960e6fc85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1720 microversion: 2.20 time: 0.242524 Apr 05 11:54:23.053482 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 296/545] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:22 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1720 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:24.075476 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ef350894-57a3-4465-9986-06ff73dea0b8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:24.076473 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ef350894-57a3-4465-9986-06ff73dea0b8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:24.086803 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef350894-57a3-4465-9986-06ff73dea0b8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:24.087540 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef350894-57a3-4465-9986-06ff73dea0b8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:24.088910 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef350894-57a3-4465-9986-06ff73dea0b8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:24.089707 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef350894-57a3-4465-9986-06ff73dea0b8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:24.224595 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ef350894-57a3-4465-9986-06ff73dea0b8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:24.237681 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ef350894-57a3-4465-9986-06ff73dea0b8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:24.240065 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ef350894-57a3-4465-9986-06ff73dea0b8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:24.241809 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ef350894-57a3-4465-9986-06ff73dea0b8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1720 microversion: 2.20 time: 0.172769 Apr 05 11:54:24.242578 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 250/546] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:24 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:25.265145 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-41d99fe5-592e-415f-850a-9efcf89b4090 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:25.266128 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-41d99fe5-592e-415f-850a-9efcf89b4090 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:25.276793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-41d99fe5-592e-415f-850a-9efcf89b4090 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:25.277534 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-41d99fe5-592e-415f-850a-9efcf89b4090 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:25.278771 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-41d99fe5-592e-415f-850a-9efcf89b4090 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:25.279487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-41d99fe5-592e-415f-850a-9efcf89b4090 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:25.424360 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-41d99fe5-592e-415f-850a-9efcf89b4090 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:25.432475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-41d99fe5-592e-415f-850a-9efcf89b4090 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:25.433959 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-41d99fe5-592e-415f-850a-9efcf89b4090 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:25.435095 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-41d99fe5-592e-415f-850a-9efcf89b4090 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1720 microversion: 2.20 time: 0.176686 Apr 05 11:54:25.435658 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 297/547] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:25 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:26.413120 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-cc46c826-5d4d-4e67-856c-d0c36a7f3dfa req-c64bed43-aa50-4ddb-90f1-72401a4cac87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a3437c-94c0-4133-a629-9386b4639a2d", "name": "network-vif-unplugged", "status": "completed", "tag": "4b172ae7-f382-4bd9-8d9f-48fd8694b406"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:54:26.421395 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-cc46c826-5d4d-4e67-856c-d0c36a7f3dfa req-c64bed43-aa50-4ddb-90f1-72401a4cac87 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:26.421809 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-cc46c826-5d4d-4e67-856c-d0c36a7f3dfa req-c64bed43-aa50-4ddb-90f1-72401a4cac87 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:26.433020 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-cc46c826-5d4d-4e67-856c-d0c36a7f3dfa req-c64bed43-aa50-4ddb-90f1-72401a4cac87 service nova] Creating event network-vif-unplugged:4b172ae7-f382-4bd9-8d9f-48fd8694b406 for instance 98a3437c-94c0-4133-a629-9386b4639a2d on hv-cinder-82956 Apr 05 11:54:26.440606 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-cc46c826-5d4d-4e67-856c-d0c36a7f3dfa req-c64bed43-aa50-4ddb-90f1-72401a4cac87 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028863 Apr 05 11:54:26.440606 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 251/548] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:54:26.453869 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2837c9fc-8730-4f3e-bef3-bde232272373 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:26.454547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2837c9fc-8730-4f3e-bef3-bde232272373 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:26.461039 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2837c9fc-8730-4f3e-bef3-bde232272373 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:26.461563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2837c9fc-8730-4f3e-bef3-bde232272373 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:26.462395 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2837c9fc-8730-4f3e-bef3-bde232272373 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:26.462861 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2837c9fc-8730-4f3e-bef3-bde232272373 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:26.602850 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2837c9fc-8730-4f3e-bef3-bde232272373 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:26.610713 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2837c9fc-8730-4f3e-bef3-bde232272373 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:26.612230 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2837c9fc-8730-4f3e-bef3-bde232272373 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:26.613393 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2837c9fc-8730-4f3e-bef3-bde232272373 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1720 microversion: 2.20 time: 0.163587 Apr 05 11:54:26.613958 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 298/549] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:26 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:27.631918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f42d0f1f-4c83-4c9e-a227-1d6ee8310efa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:27.632707 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f42d0f1f-4c83-4c9e-a227-1d6ee8310efa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:27.640604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f42d0f1f-4c83-4c9e-a227-1d6ee8310efa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:27.641060 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f42d0f1f-4c83-4c9e-a227-1d6ee8310efa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:27.641821 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f42d0f1f-4c83-4c9e-a227-1d6ee8310efa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:27.642252 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f42d0f1f-4c83-4c9e-a227-1d6ee8310efa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:27.785800 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f42d0f1f-4c83-4c9e-a227-1d6ee8310efa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:27.797249 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f42d0f1f-4c83-4c9e-a227-1d6ee8310efa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:27.798775 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f42d0f1f-4c83-4c9e-a227-1d6ee8310efa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:27.799935 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f42d0f1f-4c83-4c9e-a227-1d6ee8310efa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1723 microversion: 2.20 time: 0.172845 Apr 05 11:54:27.800552 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 252/550] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:27 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:27.817815 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-62d962cf-58df-4d7a-8eb0-f99ce5e18134 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "461cf5e0-a664-4330-8d57-4b8c2a28a05a"}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:54:27.819063 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-62d962cf-58df-4d7a-8eb0-f99ce5e18134 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:27.825527 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-62d962cf-58df-4d7a-8eb0-f99ce5e18134 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:27.825971 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-62d962cf-58df-4d7a-8eb0-f99ce5e18134 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:27.826752 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-62d962cf-58df-4d7a-8eb0-f99ce5e18134 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:27.827205 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-62d962cf-58df-4d7a-8eb0-f99ce5e18134 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:28.108955 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-62d962cf-58df-4d7a-8eb0-f99ce5e18134 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "POST /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.295133 Apr 05 11:54:28.109571 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 299/551] 10.222.0.61 () {62 vars in 1363 bytes} [Tue Apr 5 11:54:27 2022] POST /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 188 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:54:28.237771 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bab2d781-2cb5-412c-a106-0af18882771a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:54:28.238441 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bab2d781-2cb5-412c-a106-0af18882771a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:28.245514 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bab2d781-2cb5-412c-a106-0af18882771a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:28.246275 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bab2d781-2cb5-412c-a106-0af18882771a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:28.247268 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bab2d781-2cb5-412c-a106-0af18882771a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:28.247699 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bab2d781-2cb5-412c-a106-0af18882771a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:28.339483 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bab2d781-2cb5-412c-a106-0af18882771a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "POST /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/action" status: 202 len: 0 microversion: 2.20 time: 0.105974 Apr 05 11:54:28.340007 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 253/552] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Apr 5 11:54:28 2022] POST /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:54:28.348509 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6daaea7e-ab3b-45ba-9c3b-30caf9c89f34 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:28.349134 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6daaea7e-ab3b-45ba-9c3b-30caf9c89f34 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:28.355806 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6daaea7e-ab3b-45ba-9c3b-30caf9c89f34 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:28.356284 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6daaea7e-ab3b-45ba-9c3b-30caf9c89f34 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:28.357208 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6daaea7e-ab3b-45ba-9c3b-30caf9c89f34 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:28.357715 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6daaea7e-ab3b-45ba-9c3b-30caf9c89f34 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:28.494109 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6daaea7e-ab3b-45ba-9c3b-30caf9c89f34 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:28.502375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6daaea7e-ab3b-45ba-9c3b-30caf9c89f34 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:28.504211 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6daaea7e-ab3b-45ba-9c3b-30caf9c89f34 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:28.505371 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6daaea7e-ab3b-45ba-9c3b-30caf9c89f34 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1749 microversion: 2.20 time: 0.161132 Apr 05 11:54:28.516089 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 300/553] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:28 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:29.524844 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d68daa27-0d9a-4b2c-b0b8-032ff3257582 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:29.525447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d68daa27-0d9a-4b2c-b0b8-032ff3257582 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:29.532632 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d68daa27-0d9a-4b2c-b0b8-032ff3257582 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:29.533094 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d68daa27-0d9a-4b2c-b0b8-032ff3257582 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:29.533845 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d68daa27-0d9a-4b2c-b0b8-032ff3257582 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:29.534295 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d68daa27-0d9a-4b2c-b0b8-032ff3257582 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:29.668809 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d68daa27-0d9a-4b2c-b0b8-032ff3257582 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:29.677655 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d68daa27-0d9a-4b2c-b0b8-032ff3257582 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:29.679136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d68daa27-0d9a-4b2c-b0b8-032ff3257582 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:29.680315 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d68daa27-0d9a-4b2c-b0b8-032ff3257582 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1749 microversion: 2.20 time: 0.159936 Apr 05 11:54:29.680873 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 254/554] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:29 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:30.703108 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d9751feb-9797-4705-af18-d67c3231ebc7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:30.704217 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d9751feb-9797-4705-af18-d67c3231ebc7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:30.715935 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d9751feb-9797-4705-af18-d67c3231ebc7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:30.716742 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d9751feb-9797-4705-af18-d67c3231ebc7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:30.718000 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d9751feb-9797-4705-af18-d67c3231ebc7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:30.718726 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d9751feb-9797-4705-af18-d67c3231ebc7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:30.871797 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d9751feb-9797-4705-af18-d67c3231ebc7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:30.882571 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d9751feb-9797-4705-af18-d67c3231ebc7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:30.885029 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d9751feb-9797-4705-af18-d67c3231ebc7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:30.886774 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d9751feb-9797-4705-af18-d67c3231ebc7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1749 microversion: 2.20 time: 0.190274 Apr 05 11:54:30.887593 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 301/555] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:30 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1749 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:31.916112 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6e8bb826-6d77-4b93-8ceb-59d7ecd4d92f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:31.917093 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6e8bb826-6d77-4b93-8ceb-59d7ecd4d92f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:31.923871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6e8bb826-6d77-4b93-8ceb-59d7ecd4d92f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:31.924323 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6e8bb826-6d77-4b93-8ceb-59d7ecd4d92f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:31.925107 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6e8bb826-6d77-4b93-8ceb-59d7ecd4d92f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:31.925524 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6e8bb826-6d77-4b93-8ceb-59d7ecd4d92f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:32.064181 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6e8bb826-6d77-4b93-8ceb-59d7ecd4d92f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:32.074688 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6e8bb826-6d77-4b93-8ceb-59d7ecd4d92f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:32.076209 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6e8bb826-6d77-4b93-8ceb-59d7ecd4d92f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:32.077385 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6e8bb826-6d77-4b93-8ceb-59d7ecd4d92f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1751 microversion: 2.20 time: 0.168379 Apr 05 11:54:32.077956 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 255/556] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:31 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:33.102859 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3f86d099-3ff1-44b9-9549-4e0405131048 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:33.103543 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3f86d099-3ff1-44b9-9549-4e0405131048 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:33.111199 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f86d099-3ff1-44b9-9549-4e0405131048 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:33.111720 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f86d099-3ff1-44b9-9549-4e0405131048 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:33.112624 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f86d099-3ff1-44b9-9549-4e0405131048 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:33.113034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f86d099-3ff1-44b9-9549-4e0405131048 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:33.367351 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3f86d099-3ff1-44b9-9549-4e0405131048 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:33.376672 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3f86d099-3ff1-44b9-9549-4e0405131048 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:33.378496 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3f86d099-3ff1-44b9-9549-4e0405131048 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:33.380127 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3f86d099-3ff1-44b9-9549-4e0405131048 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.283957 Apr 05 11:54:33.381317 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 302/557] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:33 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:34.399331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-29bc26bf-267d-4115-942e-3616b92553ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:34.400005 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-29bc26bf-267d-4115-942e-3616b92553ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:34.407089 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-29bc26bf-267d-4115-942e-3616b92553ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:34.407562 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-29bc26bf-267d-4115-942e-3616b92553ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:34.408410 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-29bc26bf-267d-4115-942e-3616b92553ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:34.408870 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-29bc26bf-267d-4115-942e-3616b92553ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:34.555167 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-29bc26bf-267d-4115-942e-3616b92553ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:34.563565 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-29bc26bf-267d-4115-942e-3616b92553ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:34.565058 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-29bc26bf-267d-4115-942e-3616b92553ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:34.566191 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-29bc26bf-267d-4115-942e-3616b92553ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.171113 Apr 05 11:54:34.566741 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 256/558] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:34 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:35.588592 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a30da08a-94c9-475f-91aa-56cb27f5bd4d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:35.589515 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a30da08a-94c9-475f-91aa-56cb27f5bd4d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:35.600686 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a30da08a-94c9-475f-91aa-56cb27f5bd4d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:35.601425 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a30da08a-94c9-475f-91aa-56cb27f5bd4d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:35.602672 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a30da08a-94c9-475f-91aa-56cb27f5bd4d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:35.603387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a30da08a-94c9-475f-91aa-56cb27f5bd4d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:35.740676 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a30da08a-94c9-475f-91aa-56cb27f5bd4d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:35.749666 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a30da08a-94c9-475f-91aa-56cb27f5bd4d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:35.751150 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a30da08a-94c9-475f-91aa-56cb27f5bd4d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:35.752347 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a30da08a-94c9-475f-91aa-56cb27f5bd4d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.170408 Apr 05 11:54:35.752912 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 303/559] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:35 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:36.774542 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-dd756b1a-7d92-4ff5-bf9d-d6303ce5ec5a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:36.775439 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-dd756b1a-7d92-4ff5-bf9d-d6303ce5ec5a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:36.782838 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd756b1a-7d92-4ff5-bf9d-d6303ce5ec5a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:36.783287 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd756b1a-7d92-4ff5-bf9d-d6303ce5ec5a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:36.784053 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd756b1a-7d92-4ff5-bf9d-d6303ce5ec5a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:36.784506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd756b1a-7d92-4ff5-bf9d-d6303ce5ec5a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:36.926982 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-dd756b1a-7d92-4ff5-bf9d-d6303ce5ec5a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:36.935357 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-dd756b1a-7d92-4ff5-bf9d-d6303ce5ec5a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:36.936923 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-dd756b1a-7d92-4ff5-bf9d-d6303ce5ec5a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:36.938076 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-dd756b1a-7d92-4ff5-bf9d-d6303ce5ec5a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.167580 Apr 05 11:54:36.938636 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 257/560] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:36 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:37.956878 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-94694f94-9203-4f3c-9c46-450855277748 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:37.957519 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-94694f94-9203-4f3c-9c46-450855277748 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:37.964327 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94694f94-9203-4f3c-9c46-450855277748 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:37.964768 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94694f94-9203-4f3c-9c46-450855277748 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:37.965507 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94694f94-9203-4f3c-9c46-450855277748 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:37.965964 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94694f94-9203-4f3c-9c46-450855277748 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:38.103852 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-94694f94-9203-4f3c-9c46-450855277748 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:38.112476 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-94694f94-9203-4f3c-9c46-450855277748 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:38.113942 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-94694f94-9203-4f3c-9c46-450855277748 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:38.115096 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-94694f94-9203-4f3c-9c46-450855277748 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.162244 Apr 05 11:54:38.115663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 304/561] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:37 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:39.133340 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-32f8ca78-7933-40d4-a324-5d2199419d78 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:39.133957 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-32f8ca78-7933-40d4-a324-5d2199419d78 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:39.141014 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-32f8ca78-7933-40d4-a324-5d2199419d78 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:39.141949 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-32f8ca78-7933-40d4-a324-5d2199419d78 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:39.142986 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-32f8ca78-7933-40d4-a324-5d2199419d78 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:39.143560 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-32f8ca78-7933-40d4-a324-5d2199419d78 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:39.280792 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-32f8ca78-7933-40d4-a324-5d2199419d78 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:39.289238 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-32f8ca78-7933-40d4-a324-5d2199419d78 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:39.290736 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-32f8ca78-7933-40d4-a324-5d2199419d78 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:39.291898 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-32f8ca78-7933-40d4-a324-5d2199419d78 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.162600 Apr 05 11:54:39.292495 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 258/562] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:39 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:40.313002 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-679eeb54-24be-4120-8ff8-0fe66041f24b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:40.313740 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-679eeb54-24be-4120-8ff8-0fe66041f24b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:40.321352 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-679eeb54-24be-4120-8ff8-0fe66041f24b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:40.321773 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-679eeb54-24be-4120-8ff8-0fe66041f24b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:40.322535 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-679eeb54-24be-4120-8ff8-0fe66041f24b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:40.322957 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-679eeb54-24be-4120-8ff8-0fe66041f24b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:40.458843 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-679eeb54-24be-4120-8ff8-0fe66041f24b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:40.467296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-679eeb54-24be-4120-8ff8-0fe66041f24b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:40.468844 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-679eeb54-24be-4120-8ff8-0fe66041f24b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:40.470128 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-679eeb54-24be-4120-8ff8-0fe66041f24b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.163542 Apr 05 11:54:40.470666 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 305/563] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:40 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:41.489784 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7caa042f-a7cd-4fe2-a089-ccfe587046f3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:41.490399 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7caa042f-a7cd-4fe2-a089-ccfe587046f3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:41.497578 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7caa042f-a7cd-4fe2-a089-ccfe587046f3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:41.498020 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7caa042f-a7cd-4fe2-a089-ccfe587046f3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:41.498808 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7caa042f-a7cd-4fe2-a089-ccfe587046f3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:41.499232 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7caa042f-a7cd-4fe2-a089-ccfe587046f3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:41.649944 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7caa042f-a7cd-4fe2-a089-ccfe587046f3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:41.659205 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7caa042f-a7cd-4fe2-a089-ccfe587046f3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:41.661613 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7caa042f-a7cd-4fe2-a089-ccfe587046f3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:41.663259 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7caa042f-a7cd-4fe2-a089-ccfe587046f3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.177700 Apr 05 11:54:41.664093 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 259/564] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:41 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:42.682999 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b6c28d42-2b9a-421b-957f-e4f36d7a7975 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:42.683765 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b6c28d42-2b9a-421b-957f-e4f36d7a7975 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:42.690704 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6c28d42-2b9a-421b-957f-e4f36d7a7975 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:42.691147 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6c28d42-2b9a-421b-957f-e4f36d7a7975 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:42.691910 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6c28d42-2b9a-421b-957f-e4f36d7a7975 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:42.692424 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6c28d42-2b9a-421b-957f-e4f36d7a7975 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:42.828959 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b6c28d42-2b9a-421b-957f-e4f36d7a7975 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:42.837773 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b6c28d42-2b9a-421b-957f-e4f36d7a7975 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:42.839301 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b6c28d42-2b9a-421b-957f-e4f36d7a7975 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:42.840789 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b6c28d42-2b9a-421b-957f-e4f36d7a7975 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.162192 Apr 05 11:54:42.841334 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 306/565] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:42 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:43.859836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-57d9ded7-ca8b-44c4-beff-f2ebc4ce63b2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:43.860612 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-57d9ded7-ca8b-44c4-beff-f2ebc4ce63b2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:43.867004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-57d9ded7-ca8b-44c4-beff-f2ebc4ce63b2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:43.867450 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-57d9ded7-ca8b-44c4-beff-f2ebc4ce63b2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:43.868244 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-57d9ded7-ca8b-44c4-beff-f2ebc4ce63b2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:43.868678 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-57d9ded7-ca8b-44c4-beff-f2ebc4ce63b2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:44.008275 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-57d9ded7-ca8b-44c4-beff-f2ebc4ce63b2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:44.017172 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-57d9ded7-ca8b-44c4-beff-f2ebc4ce63b2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:44.018664 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-57d9ded7-ca8b-44c4-beff-f2ebc4ce63b2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:44.019867 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-57d9ded7-ca8b-44c4-beff-f2ebc4ce63b2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.164557 Apr 05 11:54:44.020535 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 260/566] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:43 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:45.038780 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d33f21cf-720c-4e25-a777-419cbcbb4222 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:45.039480 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d33f21cf-720c-4e25-a777-419cbcbb4222 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:45.046485 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d33f21cf-720c-4e25-a777-419cbcbb4222 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:45.046931 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d33f21cf-720c-4e25-a777-419cbcbb4222 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:45.047953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d33f21cf-720c-4e25-a777-419cbcbb4222 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:45.048411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d33f21cf-720c-4e25-a777-419cbcbb4222 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:45.195373 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d33f21cf-720c-4e25-a777-419cbcbb4222 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:45.204237 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d33f21cf-720c-4e25-a777-419cbcbb4222 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:45.205728 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d33f21cf-720c-4e25-a777-419cbcbb4222 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:45.207480 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d33f21cf-720c-4e25-a777-419cbcbb4222 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.172701 Apr 05 11:54:45.211763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 307/567] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:45 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:45.997795 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-37822fef-1f01-4c52-ac6b-169063d9236b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:45.998934 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-37822fef-1f01-4c52-ac6b-169063d9236b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 1a6b36d8-6a9a-421b-bbda-e56342ccca79] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:46.006918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37822fef-1f01-4c52-ac6b-169063d9236b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:46.007714 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37822fef-1f01-4c52-ac6b-169063d9236b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:46.009046 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37822fef-1f01-4c52-ac6b-169063d9236b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:46.009708 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37822fef-1f01-4c52-ac6b-169063d9236b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:46.153239 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.objects.instance [None req-37822fef-1f01-4c52-ac6b-169063d9236b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lazy-loading 'services' on Instance uuid 1a6b36d8-6a9a-421b-bbda-e56342ccca79 {{(pid=123357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:54:46.225161 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2efa96cb-223e-4a91-be4a-30a24015b581 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:46.226477 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2efa96cb-223e-4a91-be4a-30a24015b581 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:46.234152 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2efa96cb-223e-4a91-be4a-30a24015b581 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:46.234912 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2efa96cb-223e-4a91-be4a-30a24015b581 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:46.236096 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2efa96cb-223e-4a91-be4a-30a24015b581 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:46.236710 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2efa96cb-223e-4a91-be4a-30a24015b581 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:46.273865 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-37822fef-1f01-4c52-ac6b-169063d9236b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79/os-volume_attachments/729a4584-d0c1-4727-9a6e-0e9f66907337" status: 202 len: 0 microversion: 2.1 time: 0.279712 Apr 05 11:54:46.274901 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 261/568] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Apr 5 11:54:45 2022] DELETE /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79/os-volume_attachments/729a4584-d0c1-4727-9a6e-0e9f66907337 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 11:54:46.386901 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2efa96cb-223e-4a91-be4a-30a24015b581 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:46.396610 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2efa96cb-223e-4a91-be4a-30a24015b581 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:46.398155 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2efa96cb-223e-4a91-be4a-30a24015b581 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:46.399327 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2efa96cb-223e-4a91-be4a-30a24015b581 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.178416 Apr 05 11:54:46.399894 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 308/569] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:46 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:54:47.418809 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5471dcff-49c1-46e3-9284-77f1f32e345d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:47.420064 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5471dcff-49c1-46e3-9284-77f1f32e345d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:47.426985 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5471dcff-49c1-46e3-9284-77f1f32e345d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:47.427437 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5471dcff-49c1-46e3-9284-77f1f32e345d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:47.428249 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5471dcff-49c1-46e3-9284-77f1f32e345d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:47.428687 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5471dcff-49c1-46e3-9284-77f1f32e345d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:47.569547 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5471dcff-49c1-46e3-9284-77f1f32e345d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:47.578428 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5471dcff-49c1-46e3-9284-77f1f32e345d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:47.580096 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5471dcff-49c1-46e3-9284-77f1f32e345d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:47.584936 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5471dcff-49c1-46e3-9284-77f1f32e345d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.171053 Apr 05 11:54:47.585527 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 262/570] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:47 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:48.604298 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d3583b4f-85e7-4907-8bfd-467dd7b54164 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:48.606075 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d3583b4f-85e7-4907-8bfd-467dd7b54164 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:48.614380 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d3583b4f-85e7-4907-8bfd-467dd7b54164 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:48.614930 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d3583b4f-85e7-4907-8bfd-467dd7b54164 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:48.615901 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d3583b4f-85e7-4907-8bfd-467dd7b54164 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:48.616543 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d3583b4f-85e7-4907-8bfd-467dd7b54164 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:48.771520 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d3583b4f-85e7-4907-8bfd-467dd7b54164 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:48.779874 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d3583b4f-85e7-4907-8bfd-467dd7b54164 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:48.781410 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d3583b4f-85e7-4907-8bfd-467dd7b54164 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:48.782570 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d3583b4f-85e7-4907-8bfd-467dd7b54164 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.183428 Apr 05 11:54:48.783139 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 309/571] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:48 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:49.803921 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-632b6193-43cf-4219-8abc-f14caf6d7369 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:49.804798 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-632b6193-43cf-4219-8abc-f14caf6d7369 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:49.812912 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-632b6193-43cf-4219-8abc-f14caf6d7369 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:49.813471 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-632b6193-43cf-4219-8abc-f14caf6d7369 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:49.814463 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-632b6193-43cf-4219-8abc-f14caf6d7369 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:49.814997 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-632b6193-43cf-4219-8abc-f14caf6d7369 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:49.953935 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-632b6193-43cf-4219-8abc-f14caf6d7369 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:49.962385 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-632b6193-43cf-4219-8abc-f14caf6d7369 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:49.963903 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-632b6193-43cf-4219-8abc-f14caf6d7369 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:49.965066 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-632b6193-43cf-4219-8abc-f14caf6d7369 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.167251 Apr 05 11:54:49.965677 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 263/572] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:49 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:50.987887 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-444ea770-1bd6-499c-9e6e-7180dfe1e575 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:50.988881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-444ea770-1bd6-499c-9e6e-7180dfe1e575 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:50.999543 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-444ea770-1bd6-499c-9e6e-7180dfe1e575 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:51.000340 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-444ea770-1bd6-499c-9e6e-7180dfe1e575 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:51.001588 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-444ea770-1bd6-499c-9e6e-7180dfe1e575 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:51.002315 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-444ea770-1bd6-499c-9e6e-7180dfe1e575 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:51.135609 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-444ea770-1bd6-499c-9e6e-7180dfe1e575 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:51.144578 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-444ea770-1bd6-499c-9e6e-7180dfe1e575 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:51.146070 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-444ea770-1bd6-499c-9e6e-7180dfe1e575 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:51.147298 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-444ea770-1bd6-499c-9e6e-7180dfe1e575 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.165978 Apr 05 11:54:51.147858 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 310/573] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:50 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:52.170132 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9b8d0e64-ac29-41b0-8622-aea81050051f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:52.170993 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9b8d0e64-ac29-41b0-8622-aea81050051f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:52.180288 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9b8d0e64-ac29-41b0-8622-aea81050051f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:52.180735 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9b8d0e64-ac29-41b0-8622-aea81050051f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:52.181483 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9b8d0e64-ac29-41b0-8622-aea81050051f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:52.181912 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9b8d0e64-ac29-41b0-8622-aea81050051f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:52.319201 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9b8d0e64-ac29-41b0-8622-aea81050051f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:52.327572 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9b8d0e64-ac29-41b0-8622-aea81050051f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:52.329084 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9b8d0e64-ac29-41b0-8622-aea81050051f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:52.330245 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9b8d0e64-ac29-41b0-8622-aea81050051f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.167150 Apr 05 11:54:52.330831 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 264/574] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:52 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:52.688036 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-aa5fe6b0-a9cf-4025-ab3b-1547596a558a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:52.688580 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-aa5fe6b0-a9cf-4025-ab3b-1547596a558a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 1a6b36d8-6a9a-421b-bbda-e56342ccca79] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:52.695191 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aa5fe6b0-a9cf-4025-ab3b-1547596a558a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:52.695636 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aa5fe6b0-a9cf-4025-ab3b-1547596a558a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:52.696431 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aa5fe6b0-a9cf-4025-ab3b-1547596a558a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:52.696861 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aa5fe6b0-a9cf-4025-ab3b-1547596a558a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:52.721323 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-aa5fe6b0-a9cf-4025-ab3b-1547596a558a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 1a6b36d8-6a9a-421b-bbda-e56342ccca79] Going to try to terminate instance {{(pid=123358) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:54:52.806888 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-aa5fe6b0-a9cf-4025-ab3b-1547596a558a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79" status: 204 len: 0 microversion: 2.1 time: 0.122531 Apr 05 11:54:52.807445 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 311/575] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 11:54:52 2022] DELETE /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:54:52.816660 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0bee117c-ea08-4ee7-b537-488f4f0bc2b5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:52.817276 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0bee117c-ea08-4ee7-b537-488f4f0bc2b5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 1a6b36d8-6a9a-421b-bbda-e56342ccca79] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:52.823622 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0bee117c-ea08-4ee7-b537-488f4f0bc2b5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:52.824086 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0bee117c-ea08-4ee7-b537-488f4f0bc2b5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:52.825067 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0bee117c-ea08-4ee7-b537-488f4f0bc2b5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:52.825830 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0bee117c-ea08-4ee7-b537-488f4f0bc2b5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:52.965358 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0bee117c-ea08-4ee7-b537-488f4f0bc2b5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:52.976623 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0bee117c-ea08-4ee7-b537-488f4f0bc2b5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79" status: 200 len: 1514 microversion: 2.1 time: 0.164210 Apr 05 11:54:52.977358 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 265/576] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:52 2022] GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:53.354272 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-74e8128b-daf5-4db9-8fec-c34198029a49 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:53.355263 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-74e8128b-daf5-4db9-8fec-c34198029a49 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:53.365398 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-74e8128b-daf5-4db9-8fec-c34198029a49 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:53.366130 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-74e8128b-daf5-4db9-8fec-c34198029a49 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:53.367366 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-74e8128b-daf5-4db9-8fec-c34198029a49 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:53.368120 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-74e8128b-daf5-4db9-8fec-c34198029a49 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:53.521619 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-74e8128b-daf5-4db9-8fec-c34198029a49 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:53.530727 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-74e8128b-daf5-4db9-8fec-c34198029a49 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:53.532252 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-74e8128b-daf5-4db9-8fec-c34198029a49 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:53.533408 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-74e8128b-daf5-4db9-8fec-c34198029a49 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.186960 Apr 05 11:54:53.533963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 312/577] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:53 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:53.999153 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-39cabd60-4776-4da8-9516-440eba608edc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:53.999789 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-39cabd60-4776-4da8-9516-440eba608edc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 1a6b36d8-6a9a-421b-bbda-e56342ccca79] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:54.006210 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-39cabd60-4776-4da8-9516-440eba608edc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:54.006656 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-39cabd60-4776-4da8-9516-440eba608edc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:54.007411 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-39cabd60-4776-4da8-9516-440eba608edc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:54.007840 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-39cabd60-4776-4da8-9516-440eba608edc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:54.156678 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-39cabd60-4776-4da8-9516-440eba608edc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:54.168059 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-39cabd60-4776-4da8-9516-440eba608edc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79" status: 200 len: 1514 microversion: 2.1 time: 0.172539 Apr 05 11:54:54.168931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 266/578] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:53 2022] GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:54.556022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-40b2b4b0-af3a-4a39-9667-b6092ea0b1dc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:54.557059 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-40b2b4b0-af3a-4a39-9667-b6092ea0b1dc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:54.567347 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-40b2b4b0-af3a-4a39-9667-b6092ea0b1dc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:54.568263 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-40b2b4b0-af3a-4a39-9667-b6092ea0b1dc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:54.569206 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-40b2b4b0-af3a-4a39-9667-b6092ea0b1dc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:54.569628 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-40b2b4b0-af3a-4a39-9667-b6092ea0b1dc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:54.721628 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-40b2b4b0-af3a-4a39-9667-b6092ea0b1dc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:54.731239 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-40b2b4b0-af3a-4a39-9667-b6092ea0b1dc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:54.732805 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-40b2b4b0-af3a-4a39-9667-b6092ea0b1dc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:54.733977 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-40b2b4b0-af3a-4a39-9667-b6092ea0b1dc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.184478 Apr 05 11:54:54.734516 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 313/579] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:54 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:55.193061 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8ec1e925-35e6-45e6-9a83-297906056be4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:55.193988 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8ec1e925-35e6-45e6-9a83-297906056be4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 1a6b36d8-6a9a-421b-bbda-e56342ccca79] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:55.204659 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8ec1e925-35e6-45e6-9a83-297906056be4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:55.205413 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8ec1e925-35e6-45e6-9a83-297906056be4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:55.206658 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8ec1e925-35e6-45e6-9a83-297906056be4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:55.207377 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8ec1e925-35e6-45e6-9a83-297906056be4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:55.345124 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8ec1e925-35e6-45e6-9a83-297906056be4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:55.353459 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8ec1e925-35e6-45e6-9a83-297906056be4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79" status: 200 len: 1514 microversion: 2.1 time: 0.166896 Apr 05 11:54:55.354037 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 267/580] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:55 2022] GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:55.752726 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2cac1190-134c-4c04-b5dd-971c15791c2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:55.753483 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2cac1190-134c-4c04-b5dd-971c15791c2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:55.756825 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-e6eaed31-3a7a-435d-973c-42a9bfc61304 req-5830c485-4712-434e-af94-0991fec5618f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6b36d8-6a9a-421b-bbda-e56342ccca79", "name": "network-vif-deleted", "tag": "57f5dfab-7c49-46c4-9032-7d2d1bc47160"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:54:55.760478 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2cac1190-134c-4c04-b5dd-971c15791c2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:55.760929 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2cac1190-134c-4c04-b5dd-971c15791c2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:55.761689 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2cac1190-134c-4c04-b5dd-971c15791c2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:55.762107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2cac1190-134c-4c04-b5dd-971c15791c2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:55.766311 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-e6eaed31-3a7a-435d-973c-42a9bfc61304 req-5830c485-4712-434e-af94-0991fec5618f service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:55.766745 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-e6eaed31-3a7a-435d-973c-42a9bfc61304 req-5830c485-4712-434e-af94-0991fec5618f service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:55.778568 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-e6eaed31-3a7a-435d-973c-42a9bfc61304 req-5830c485-4712-434e-af94-0991fec5618f service nova] Creating event network-vif-deleted:57f5dfab-7c49-46c4-9032-7d2d1bc47160 for instance 1a6b36d8-6a9a-421b-bbda-e56342ccca79 on hv-cinder-82956 Apr 05 11:54:55.784484 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-e6eaed31-3a7a-435d-973c-42a9bfc61304 req-5830c485-4712-434e-af94-0991fec5618f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031463 Apr 05 11:54:55.785630 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 268/581] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:54:55.901855 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2cac1190-134c-4c04-b5dd-971c15791c2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:55.912783 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2cac1190-134c-4c04-b5dd-971c15791c2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:55.914718 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2cac1190-134c-4c04-b5dd-971c15791c2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:55.915891 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2cac1190-134c-4c04-b5dd-971c15791c2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.167355 Apr 05 11:54:55.916485 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 314/582] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:55 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:56.371559 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f9201472-4212-496c-bd6c-32da24fa0eba tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:56.372288 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f9201472-4212-496c-bd6c-32da24fa0eba tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 1a6b36d8-6a9a-421b-bbda-e56342ccca79] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:56.378918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f9201472-4212-496c-bd6c-32da24fa0eba tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:56.379256 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f9201472-4212-496c-bd6c-32da24fa0eba tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:56.379948 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f9201472-4212-496c-bd6c-32da24fa0eba tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:56.380405 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f9201472-4212-496c-bd6c-32da24fa0eba tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:56.415089 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f9201472-4212-496c-bd6c-32da24fa0eba tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:56.415496 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f9201472-4212-496c-bd6c-32da24fa0eba tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:56.415932 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.objects.instance [None req-f9201472-4212-496c-bd6c-32da24fa0eba tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lazy-loading 'fault' on Instance uuid 1a6b36d8-6a9a-421b-bbda-e56342ccca79 {{(pid=123357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:54:56.466275 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f9201472-4212-496c-bd6c-32da24fa0eba tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:56.476648 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f9201472-4212-496c-bd6c-32da24fa0eba tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79" status: 200 len: 1309 microversion: 2.1 time: 0.110084 Apr 05 11:54:56.477225 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 269/583] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:56 2022] GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79 => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:56.938333 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2fddf99f-cb10-4d42-8aba-e19343ee59e1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:56.939305 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2fddf99f-cb10-4d42-8aba-e19343ee59e1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:56.947729 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2fddf99f-cb10-4d42-8aba-e19343ee59e1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:56.948203 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2fddf99f-cb10-4d42-8aba-e19343ee59e1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:56.948948 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2fddf99f-cb10-4d42-8aba-e19343ee59e1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:56.949371 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2fddf99f-cb10-4d42-8aba-e19343ee59e1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:57.090596 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2fddf99f-cb10-4d42-8aba-e19343ee59e1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:57.099656 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2fddf99f-cb10-4d42-8aba-e19343ee59e1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:57.101373 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2fddf99f-cb10-4d42-8aba-e19343ee59e1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:57.102577 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2fddf99f-cb10-4d42-8aba-e19343ee59e1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.170870 Apr 05 11:54:57.103148 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 315/584] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:56 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:57.496592 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4e8b2f50-7440-42e3-b925-7ac537be97b2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:57.497354 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4e8b2f50-7440-42e3-b925-7ac537be97b2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 1a6b36d8-6a9a-421b-bbda-e56342ccca79] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:57.505519 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4e8b2f50-7440-42e3-b925-7ac537be97b2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:57.506075 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4e8b2f50-7440-42e3-b925-7ac537be97b2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:57.506991 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4e8b2f50-7440-42e3-b925-7ac537be97b2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:57.507423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4e8b2f50-7440-42e3-b925-7ac537be97b2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:57.537331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4e8b2f50-7440-42e3-b925-7ac537be97b2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:57.537858 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4e8b2f50-7440-42e3-b925-7ac537be97b2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:57.538301 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.objects.instance [None req-4e8b2f50-7440-42e3-b925-7ac537be97b2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lazy-loading 'fault' on Instance uuid 1a6b36d8-6a9a-421b-bbda-e56342ccca79 {{(pid=123357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:54:57.581974 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4e8b2f50-7440-42e3-b925-7ac537be97b2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:57.589479 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4e8b2f50-7440-42e3-b925-7ac537be97b2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79" status: 200 len: 1309 microversion: 2.1 time: 0.097737 Apr 05 11:54:57.590034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 270/585] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:57 2022] GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:54:58.125338 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9e24b9e8-3379-410b-b7cf-9ec33b302eaf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:58.126264 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9e24b9e8-3379-410b-b7cf-9ec33b302eaf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:58.137320 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9e24b9e8-3379-410b-b7cf-9ec33b302eaf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:58.138068 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9e24b9e8-3379-410b-b7cf-9ec33b302eaf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:58.139323 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9e24b9e8-3379-410b-b7cf-9ec33b302eaf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:58.140043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9e24b9e8-3379-410b-b7cf-9ec33b302eaf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:58.284701 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9e24b9e8-3379-410b-b7cf-9ec33b302eaf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:58.293168 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9e24b9e8-3379-410b-b7cf-9ec33b302eaf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:58.294671 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9e24b9e8-3379-410b-b7cf-9ec33b302eaf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:58.295836 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9e24b9e8-3379-410b-b7cf-9ec33b302eaf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.177181 Apr 05 11:54:58.296445 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 316/586] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:58 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:54:58.610063 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b62932ac-acce-45cf-80a9-648d475a6b7c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:58.610650 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b62932ac-acce-45cf-80a9-648d475a6b7c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 1a6b36d8-6a9a-421b-bbda-e56342ccca79] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:58.619163 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b62932ac-acce-45cf-80a9-648d475a6b7c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:58.619625 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b62932ac-acce-45cf-80a9-648d475a6b7c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:58.620428 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b62932ac-acce-45cf-80a9-648d475a6b7c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:58.620864 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b62932ac-acce-45cf-80a9-648d475a6b7c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:58.634346 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-b62932ac-acce-45cf-80a9-648d475a6b7c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] HTTP exception thrown: Instance 1a6b36d8-6a9a-421b-bbda-e56342ccca79 could not be found. Apr 05 11:54:58.634871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b62932ac-acce-45cf-80a9-648d475a6b7c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Returning 404 to user: Instance 1a6b36d8-6a9a-421b-bbda-e56342ccca79 could not be found. {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:54:58.635695 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b62932ac-acce-45cf-80a9-648d475a6b7c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79" status: 404 len: 111 microversion: 2.1 time: 0.031795 Apr 05 11:54:58.636450 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 271/587] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:54:58 2022] GET /compute/v2.1/servers/1a6b36d8-6a9a-421b-bbda-e56342ccca79 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:54:59.318432 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2bab7953-4876-499b-a890-00fe948ae72f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:54:59.319368 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2bab7953-4876-499b-a890-00fe948ae72f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:54:59.326634 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2bab7953-4876-499b-a890-00fe948ae72f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:59.327101 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2bab7953-4876-499b-a890-00fe948ae72f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:59.327895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2bab7953-4876-499b-a890-00fe948ae72f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:54:59.328375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2bab7953-4876-499b-a890-00fe948ae72f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:54:59.475236 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2bab7953-4876-499b-a890-00fe948ae72f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:59.485819 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2bab7953-4876-499b-a890-00fe948ae72f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:59.487447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2bab7953-4876-499b-a890-00fe948ae72f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:54:59.488639 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2bab7953-4876-499b-a890-00fe948ae72f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.176824 Apr 05 11:54:59.489417 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 317/588] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:54:59 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:55:00.511793 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-dd27d5c2-48c4-4c3b-afec-c36208c898de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:00.512435 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-dd27d5c2-48c4-4c3b-afec-c36208c898de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:00.519136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd27d5c2-48c4-4c3b-afec-c36208c898de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:00.519587 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd27d5c2-48c4-4c3b-afec-c36208c898de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:00.520371 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd27d5c2-48c4-4c3b-afec-c36208c898de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:00.520827 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd27d5c2-48c4-4c3b-afec-c36208c898de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:00.657875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-dd27d5c2-48c4-4c3b-afec-c36208c898de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:00.667603 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-dd27d5c2-48c4-4c3b-afec-c36208c898de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:00.669103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-dd27d5c2-48c4-4c3b-afec-c36208c898de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:00.670251 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-dd27d5c2-48c4-4c3b-afec-c36208c898de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.162454 Apr 05 11:55:00.670875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 272/589] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:55:00 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:55:01.693395 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3787fdfb-cdbb-494e-bd01-0f6affa19fa0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:01.694437 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3787fdfb-cdbb-494e-bd01-0f6affa19fa0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:01.705316 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3787fdfb-cdbb-494e-bd01-0f6affa19fa0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:01.706072 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3787fdfb-cdbb-494e-bd01-0f6affa19fa0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:01.707390 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3787fdfb-cdbb-494e-bd01-0f6affa19fa0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:01.708157 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3787fdfb-cdbb-494e-bd01-0f6affa19fa0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:01.852359 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3787fdfb-cdbb-494e-bd01-0f6affa19fa0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:01.861218 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3787fdfb-cdbb-494e-bd01-0f6affa19fa0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:01.862711 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3787fdfb-cdbb-494e-bd01-0f6affa19fa0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:01.863891 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3787fdfb-cdbb-494e-bd01-0f6affa19fa0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.177145 Apr 05 11:55:01.864484 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 318/590] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:55:01 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:55:02.889288 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ab3566f6-32a3-4ddf-8c93-ada3db9caf2c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:02.890303 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ab3566f6-32a3-4ddf-8c93-ada3db9caf2c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:02.901242 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab3566f6-32a3-4ddf-8c93-ada3db9caf2c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:02.901978 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab3566f6-32a3-4ddf-8c93-ada3db9caf2c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:02.903227 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab3566f6-32a3-4ddf-8c93-ada3db9caf2c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:02.903962 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab3566f6-32a3-4ddf-8c93-ada3db9caf2c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:03.046348 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ab3566f6-32a3-4ddf-8c93-ada3db9caf2c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:03.055232 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ab3566f6-32a3-4ddf-8c93-ada3db9caf2c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:03.056792 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ab3566f6-32a3-4ddf-8c93-ada3db9caf2c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:03.058002 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ab3566f6-32a3-4ddf-8c93-ada3db9caf2c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.175296 Apr 05 11:55:03.058741 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 273/591] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:55:02 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:55:04.076630 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ddee078c-6e52-45d6-a689-fe5aca1d5c77 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:04.077921 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ddee078c-6e52-45d6-a689-fe5aca1d5c77 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:04.084833 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ddee078c-6e52-45d6-a689-fe5aca1d5c77 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:04.085327 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ddee078c-6e52-45d6-a689-fe5aca1d5c77 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:04.086091 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ddee078c-6e52-45d6-a689-fe5aca1d5c77 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:04.086517 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ddee078c-6e52-45d6-a689-fe5aca1d5c77 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:04.182950 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-bd1491b0-bba5-4309-ba7e-96d4763a8a13 req-cd0f9d98-fdd0-41db-bef9-76a08fdccbfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a3437c-94c0-4133-a629-9386b4639a2d", "name": "network-vif-plugged", "status": "completed", "tag": "4b172ae7-f382-4bd9-8d9f-48fd8694b406"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:55:04.205239 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-bd1491b0-bba5-4309-ba7e-96d4763a8a13 req-cd0f9d98-fdd0-41db-bef9-76a08fdccbfd service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:04.208875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-bd1491b0-bba5-4309-ba7e-96d4763a8a13 req-cd0f9d98-fdd0-41db-bef9-76a08fdccbfd service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:04.225566 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-bd1491b0-bba5-4309-ba7e-96d4763a8a13 req-cd0f9d98-fdd0-41db-bef9-76a08fdccbfd service nova] Creating event network-vif-plugged:4b172ae7-f382-4bd9-8d9f-48fd8694b406 for instance 98a3437c-94c0-4133-a629-9386b4639a2d on hv-cinder-82956 Apr 05 11:55:04.233119 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-bd1491b0-bba5-4309-ba7e-96d4763a8a13 req-cd0f9d98-fdd0-41db-bef9-76a08fdccbfd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056064 Apr 05 11:55:04.234165 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 274/592] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:55:04.269683 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ddee078c-6e52-45d6-a689-fe5aca1d5c77 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:04.279264 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ddee078c-6e52-45d6-a689-fe5aca1d5c77 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:04.282298 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ddee078c-6e52-45d6-a689-fe5aca1d5c77 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:04.283977 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ddee078c-6e52-45d6-a689-fe5aca1d5c77 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.211621 Apr 05 11:55:04.288531 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 319/593] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:55:04 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:55:05.307834 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-aee3015f-cae9-4744-8476-a8abe599dd2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:05.309024 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-aee3015f-cae9-4744-8476-a8abe599dd2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:05.319857 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aee3015f-cae9-4744-8476-a8abe599dd2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:05.320350 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aee3015f-cae9-4744-8476-a8abe599dd2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:05.321116 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aee3015f-cae9-4744-8476-a8abe599dd2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:05.321549 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aee3015f-cae9-4744-8476-a8abe599dd2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:05.456824 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-aee3015f-cae9-4744-8476-a8abe599dd2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:05.465478 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-aee3015f-cae9-4744-8476-a8abe599dd2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:05.466967 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-aee3015f-cae9-4744-8476-a8abe599dd2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:05.468165 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-aee3015f-cae9-4744-8476-a8abe599dd2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.167480 Apr 05 11:55:05.468715 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 275/594] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:55:05 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:55:06.491076 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-32a311c1-52c5-4cb8-a51d-a9fa4be98a89 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:06.492029 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-32a311c1-52c5-4cb8-a51d-a9fa4be98a89 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:06.502686 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-32a311c1-52c5-4cb8-a51d-a9fa4be98a89 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:06.503459 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-32a311c1-52c5-4cb8-a51d-a9fa4be98a89 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:06.504742 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-32a311c1-52c5-4cb8-a51d-a9fa4be98a89 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:06.505462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-32a311c1-52c5-4cb8-a51d-a9fa4be98a89 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:06.644400 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-32a311c1-52c5-4cb8-a51d-a9fa4be98a89 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:06.656879 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-32a311c1-52c5-4cb8-a51d-a9fa4be98a89 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:06.659183 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-32a311c1-52c5-4cb8-a51d-a9fa4be98a89 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:06.660955 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-32a311c1-52c5-4cb8-a51d-a9fa4be98a89 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.176471 Apr 05 11:55:06.661513 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 320/595] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:55:06 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:55:07.511448 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0f8624ca-9c00-45ce-8e6c-3e630afbddb6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-311219629", "imageRef": "2b657785-cb0b-43ba-956c-1564c27fd10a", "flavorRef": "452", "networks": [{"uuid": "a0b4e9ed-dad4-4277-921e-a25e81ebf3d5"}]}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:55:07.563621 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.network.neutron [None req-0f8624ca-9c00-45ce-8e6c-3e630afbddb6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] validate_networks() for [('a0b4e9ed-dad4-4277-921e-a25e81ebf3d5', None, None, None, None, None)] {{(pid=123357) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:55:07.679511 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-13465f31-6357-49f1-8a8d-47cc1fb8ac18 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:07.680147 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-13465f31-6357-49f1-8a8d-47cc1fb8ac18 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:07.686838 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-13465f31-6357-49f1-8a8d-47cc1fb8ac18 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:07.687279 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-13465f31-6357-49f1-8a8d-47cc1fb8ac18 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:07.688033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-13465f31-6357-49f1-8a8d-47cc1fb8ac18 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:07.688616 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-13465f31-6357-49f1-8a8d-47cc1fb8ac18 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:07.826924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-13465f31-6357-49f1-8a8d-47cc1fb8ac18 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:07.835674 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-13465f31-6357-49f1-8a8d-47cc1fb8ac18 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:07.837288 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-13465f31-6357-49f1-8a8d-47cc1fb8ac18 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:07.838674 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-13465f31-6357-49f1-8a8d-47cc1fb8ac18 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.163761 Apr 05 11:55:07.839234 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 321/596] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:55:07 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:55:07.907368 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-0f8624ca-9c00-45ce-8e6c-3e630afbddb6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Flavor limits 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:55:07.907784 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-0f8624ca-9c00-45ce-8e6c-3e630afbddb6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Image limits 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:55:07.908310 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-0f8624ca-9c00-45ce-8e6c-3e630afbddb6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Flavor pref 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:55:07.908732 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-0f8624ca-9c00-45ce-8e6c-3e630afbddb6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Image pref 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:55:07.909136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-0f8624ca-9c00-45ce-8e6c-3e630afbddb6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:55:07.918298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0f8624ca-9c00-45ce-8e6c-3e630afbddb6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:07.918739 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0f8624ca-9c00-45ce-8e6c-3e630afbddb6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:07.919517 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0f8624ca-9c00-45ce-8e6c-3e630afbddb6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:07.919933 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0f8624ca-9c00-45ce-8e6c-3e630afbddb6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:07.938243 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-0f8624ca-9c00-45ce-8e6c-3e630afbddb6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Getting quotas for project 400dd74b011a4bbabde6ed53ce0250d3. Resources: {'ram', 'instances', 'cores'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:55:07.942120 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-0f8624ca-9c00-45ce-8e6c-3e630afbddb6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Getting quotas for user 7a8653b849b6413283176a098faebb95 and project 400dd74b011a4bbabde6ed53ce0250d3. Resources: {'ram', 'instances', 'cores'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:55:07.953275 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0f8624ca-9c00-45ce-8e6c-3e630afbddb6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Going to run 1 instances... {{(pid=123357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:55:07.955563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0f8624ca-9c00-45ce-8e6c-3e630afbddb6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b657785-cb0b-43ba-956c-1564c27fd10a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:55:08.004618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0f8624ca-9c00-45ce-8e6c-3e630afbddb6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.496947 Apr 05 11:55:08.005262 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 276/597] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Apr 5 11:55:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:55:08.015450 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c825ac59-9a69-4103-9a57-09cc1570a16f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:08.016059 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c825ac59-9a69-4103-9a57-09cc1570a16f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:08.074569 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c825ac59-9a69-4103-9a57-09cc1570a16f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:08.081377 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c825ac59-9a69-4103-9a57-09cc1570a16f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1218 microversion: 2.1 time: 0.069944 Apr 05 11:55:08.081947 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 322/598] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:08 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:08.862227 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8ed30cb5-6852-44f8-819d-a196db35f1d7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:08.863158 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8ed30cb5-6852-44f8-819d-a196db35f1d7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:08.874514 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8ed30cb5-6852-44f8-819d-a196db35f1d7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:08.875257 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8ed30cb5-6852-44f8-819d-a196db35f1d7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:08.876555 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8ed30cb5-6852-44f8-819d-a196db35f1d7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:08.877269 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8ed30cb5-6852-44f8-819d-a196db35f1d7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:09.028050 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8ed30cb5-6852-44f8-819d-a196db35f1d7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:09.037324 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8ed30cb5-6852-44f8-819d-a196db35f1d7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:09.038822 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8ed30cb5-6852-44f8-819d-a196db35f1d7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:09.040056 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8ed30cb5-6852-44f8-819d-a196db35f1d7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1807 microversion: 2.20 time: 0.185143 Apr 05 11:55:09.040972 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 277/599] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:55:08 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:55:09.097547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-33736c38-491f-4b70-9e31-705b8d034da6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:09.098502 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-33736c38-491f-4b70-9e31-705b8d034da6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:09.104802 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-33736c38-491f-4b70-9e31-705b8d034da6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:09.105079 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-33736c38-491f-4b70-9e31-705b8d034da6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:09.105829 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-33736c38-491f-4b70-9e31-705b8d034da6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:09.106251 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-33736c38-491f-4b70-9e31-705b8d034da6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:09.166998 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-33736c38-491f-4b70-9e31-705b8d034da6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:09.174794 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-33736c38-491f-4b70-9e31-705b8d034da6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1278 microversion: 2.1 time: 0.080996 Apr 05 11:55:09.180112 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 323/600] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:09 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1278 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:10.057752 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6138f6d2-0be9-4b4b-9b40-27e096bce982 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:10.058406 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6138f6d2-0be9-4b4b-9b40-27e096bce982 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:10.064812 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6138f6d2-0be9-4b4b-9b40-27e096bce982 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:10.065260 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6138f6d2-0be9-4b4b-9b40-27e096bce982 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:10.066016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6138f6d2-0be9-4b4b-9b40-27e096bce982 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:10.066448 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6138f6d2-0be9-4b4b-9b40-27e096bce982 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:10.192383 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1a93d6e4-ee4e-415d-81ef-1402019f6f5b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:10.192966 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1a93d6e4-ee4e-415d-81ef-1402019f6f5b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:10.200457 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a93d6e4-ee4e-415d-81ef-1402019f6f5b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:10.200928 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6138f6d2-0be9-4b4b-9b40-27e096bce982 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:10.201051 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a93d6e4-ee4e-415d-81ef-1402019f6f5b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:10.201796 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a93d6e4-ee4e-415d-81ef-1402019f6f5b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:10.202270 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a93d6e4-ee4e-415d-81ef-1402019f6f5b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:10.210557 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6138f6d2-0be9-4b4b-9b40-27e096bce982 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:10.212051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6138f6d2-0be9-4b4b-9b40-27e096bce982 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:10.213230 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6138f6d2-0be9-4b4b-9b40-27e096bce982 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1794 microversion: 2.20 time: 0.159616 Apr 05 11:55:10.213852 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 278/601] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 11:55:10 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1794 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:55:10.456593 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1a93d6e4-ee4e-415d-81ef-1402019f6f5b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:10.464298 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1a93d6e4-ee4e-415d-81ef-1402019f6f5b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1318 microversion: 2.1 time: 0.275815 Apr 05 11:55:10.464846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 324/602] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:10 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:55:10.886895 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-3afc737e-15f8-485c-87e2-69d58cd6744f req-b97eb3a7-9bad-4159-b946-14ec0ebaff61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2874529b-88ea-4b6d-b42a-a242dc948ccf", "tag": "9c2e58f4-2c4a-4e00-a60b-5a27ceff33bb"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:55:10.895341 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-3afc737e-15f8-485c-87e2-69d58cd6744f req-b97eb3a7-9bad-4159-b946-14ec0ebaff61 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:10.895791 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-3afc737e-15f8-485c-87e2-69d58cd6744f req-b97eb3a7-9bad-4159-b946-14ec0ebaff61 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:10.909173 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-3afc737e-15f8-485c-87e2-69d58cd6744f req-b97eb3a7-9bad-4159-b946-14ec0ebaff61 service nova] Creating event network-changed:9c2e58f4-2c4a-4e00-a60b-5a27ceff33bb for instance 2874529b-88ea-4b6d-b42a-a242dc948ccf on hv-cinder-82956 Apr 05 11:55:10.914534 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-3afc737e-15f8-485c-87e2-69d58cd6744f req-b97eb3a7-9bad-4159-b946-14ec0ebaff61 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031376 Apr 05 11:55:10.915283 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 279/603] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:55:11.482775 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2bb1d9d4-5b88-4241-86fa-9d0d37e64583 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:11.483558 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2bb1d9d4-5b88-4241-86fa-9d0d37e64583 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:11.491723 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2bb1d9d4-5b88-4241-86fa-9d0d37e64583 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:11.492322 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2bb1d9d4-5b88-4241-86fa-9d0d37e64583 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:11.493280 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2bb1d9d4-5b88-4241-86fa-9d0d37e64583 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:11.493742 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2bb1d9d4-5b88-4241-86fa-9d0d37e64583 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:11.632352 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2bb1d9d4-5b88-4241-86fa-9d0d37e64583 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:11.643708 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2bb1d9d4-5b88-4241-86fa-9d0d37e64583 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1318 microversion: 2.1 time: 0.165659 Apr 05 11:55:11.644506 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 325/604] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:11 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:12.662793 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-eaf6f8a3-0589-4336-b8ce-c35fc64f68ac tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:12.663396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-eaf6f8a3-0589-4336-b8ce-c35fc64f68ac tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:12.670108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eaf6f8a3-0589-4336-b8ce-c35fc64f68ac tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:12.670683 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eaf6f8a3-0589-4336-b8ce-c35fc64f68ac tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:12.671441 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eaf6f8a3-0589-4336-b8ce-c35fc64f68ac tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:12.671866 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eaf6f8a3-0589-4336-b8ce-c35fc64f68ac tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:12.803727 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-eaf6f8a3-0589-4336-b8ce-c35fc64f68ac tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:12.811377 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-eaf6f8a3-0589-4336-b8ce-c35fc64f68ac tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1318 microversion: 2.1 time: 0.153723 Apr 05 11:55:12.812449 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 280/605] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:12 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:13.829118 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-50286136-b6f0-4bcc-95b6-74222c65e830 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:13.829653 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-50286136-b6f0-4bcc-95b6-74222c65e830 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:13.836391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-50286136-b6f0-4bcc-95b6-74222c65e830 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:13.836835 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-50286136-b6f0-4bcc-95b6-74222c65e830 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:13.837597 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-50286136-b6f0-4bcc-95b6-74222c65e830 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:13.838045 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-50286136-b6f0-4bcc-95b6-74222c65e830 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:13.984259 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-50286136-b6f0-4bcc-95b6-74222c65e830 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:13.991999 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-50286136-b6f0-4bcc-95b6-74222c65e830 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1318 microversion: 2.1 time: 0.166904 Apr 05 11:55:13.992611 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 326/606] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:13 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:15.014458 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-de7e055d-55d2-42a1-8c6d-70d2277f2a31 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:15.015456 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-de7e055d-55d2-42a1-8c6d-70d2277f2a31 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:15.025965 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-de7e055d-55d2-42a1-8c6d-70d2277f2a31 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:15.026411 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-de7e055d-55d2-42a1-8c6d-70d2277f2a31 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:15.027173 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-de7e055d-55d2-42a1-8c6d-70d2277f2a31 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:15.027607 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-de7e055d-55d2-42a1-8c6d-70d2277f2a31 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:15.182312 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-de7e055d-55d2-42a1-8c6d-70d2277f2a31 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:15.190080 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-de7e055d-55d2-42a1-8c6d-70d2277f2a31 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1318 microversion: 2.1 time: 0.183349 Apr 05 11:55:15.190659 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 281/607] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:15 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:15.276512 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fcfe1a4f-8511-4f0a-bd95-b593e9d09ef2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf75b0b8-0993-4b63-83c7-baf577a39884"}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:55:15.277529 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fcfe1a4f-8511-4f0a-bd95-b593e9d09ef2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:15.284112 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fcfe1a4f-8511-4f0a-bd95-b593e9d09ef2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:15.284577 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fcfe1a4f-8511-4f0a-bd95-b593e9d09ef2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:15.285327 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fcfe1a4f-8511-4f0a-bd95-b593e9d09ef2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:15.285749 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fcfe1a4f-8511-4f0a-bd95-b593e9d09ef2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:15.544156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fcfe1a4f-8511-4f0a-bd95-b593e9d09ef2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "POST /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274202 Apr 05 11:55:15.544712 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 327/608] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Apr 5 11:55:15 2022] POST /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:55:16.207753 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-60c38885-8dc6-4cdb-8fc3-af17b26c4aec tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:16.208551 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-60c38885-8dc6-4cdb-8fc3-af17b26c4aec tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:16.214806 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-60c38885-8dc6-4cdb-8fc3-af17b26c4aec tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:16.215316 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-60c38885-8dc6-4cdb-8fc3-af17b26c4aec tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:16.216245 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-60c38885-8dc6-4cdb-8fc3-af17b26c4aec tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:16.217047 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-60c38885-8dc6-4cdb-8fc3-af17b26c4aec tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:16.257447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-6352aa66-09ff-4256-98b0-b3072b4670a5 req-173004ad-b569-4a00-88d7-e31acdf527b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2874529b-88ea-4b6d-b42a-a242dc948ccf", "name": "network-vif-plugged", "status": "completed", "tag": "9c2e58f4-2c4a-4e00-a60b-5a27ceff33bb"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:55:16.267515 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-6352aa66-09ff-4256-98b0-b3072b4670a5 req-173004ad-b569-4a00-88d7-e31acdf527b0 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:16.268020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-6352aa66-09ff-4256-98b0-b3072b4670a5 req-173004ad-b569-4a00-88d7-e31acdf527b0 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:16.281134 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-6352aa66-09ff-4256-98b0-b3072b4670a5 req-173004ad-b569-4a00-88d7-e31acdf527b0 service nova] Creating event network-vif-plugged:9c2e58f4-2c4a-4e00-a60b-5a27ceff33bb for instance 2874529b-88ea-4b6d-b42a-a242dc948ccf on hv-cinder-82956 Apr 05 11:55:16.286357 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-6352aa66-09ff-4256-98b0-b3072b4670a5 req-173004ad-b569-4a00-88d7-e31acdf527b0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033497 Apr 05 11:55:16.287443 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 328/609] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:55:16.350744 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-60c38885-8dc6-4cdb-8fc3-af17b26c4aec tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:16.358191 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-60c38885-8dc6-4cdb-8fc3-af17b26c4aec tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1318 microversion: 2.1 time: 0.154876 Apr 05 11:55:16.358769 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 282/610] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:16 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:17.380615 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8ec5c774-7d11-4e7b-b12b-db809ae5ea84 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:17.381763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8ec5c774-7d11-4e7b-b12b-db809ae5ea84 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:17.392740 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8ec5c774-7d11-4e7b-b12b-db809ae5ea84 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:17.393471 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8ec5c774-7d11-4e7b-b12b-db809ae5ea84 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:17.394706 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8ec5c774-7d11-4e7b-b12b-db809ae5ea84 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:17.395412 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8ec5c774-7d11-4e7b-b12b-db809ae5ea84 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:17.542035 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8ec5c774-7d11-4e7b-b12b-db809ae5ea84 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:17.553412 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8ec5c774-7d11-4e7b-b12b-db809ae5ea84 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1318 microversion: 2.1 time: 0.179651 Apr 05 11:55:17.554153 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 329/611] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:17 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:18.575167 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d8189c9c-4016-4fff-bebf-baa32674bd16 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:18.576216 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d8189c9c-4016-4fff-bebf-baa32674bd16 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:18.586801 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d8189c9c-4016-4fff-bebf-baa32674bd16 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:18.587537 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d8189c9c-4016-4fff-bebf-baa32674bd16 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:18.588873 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d8189c9c-4016-4fff-bebf-baa32674bd16 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:18.589630 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d8189c9c-4016-4fff-bebf-baa32674bd16 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:18.734546 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d8189c9c-4016-4fff-bebf-baa32674bd16 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:18.742089 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d8189c9c-4016-4fff-bebf-baa32674bd16 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1318 microversion: 2.1 time: 0.173634 Apr 05 11:55:18.742656 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 283/612] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:18 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:19.763617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9cdbea17-d536-43dd-8b13-b1030a2aa263 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:19.764640 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9cdbea17-d536-43dd-8b13-b1030a2aa263 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:19.775440 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9cdbea17-d536-43dd-8b13-b1030a2aa263 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:19.775891 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9cdbea17-d536-43dd-8b13-b1030a2aa263 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:19.776695 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9cdbea17-d536-43dd-8b13-b1030a2aa263 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:19.777129 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9cdbea17-d536-43dd-8b13-b1030a2aa263 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:19.913983 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9cdbea17-d536-43dd-8b13-b1030a2aa263 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:19.922393 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9cdbea17-d536-43dd-8b13-b1030a2aa263 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1508 microversion: 2.1 time: 0.165505 Apr 05 11:55:19.922967 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 330/613] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:19 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:19.945438 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bbc000b1-555a-4432-8b6c-f3f61bccbe7e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e620b30-befa-41cb-9d6d-541dc1914771", "device": "/dev/sdb"}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:55:19.947067 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bbc000b1-555a-4432-8b6c-f3f61bccbe7e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:19.953848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bbc000b1-555a-4432-8b6c-f3f61bccbe7e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:19.954304 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bbc000b1-555a-4432-8b6c-f3f61bccbe7e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:19.955054 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bbc000b1-555a-4432-8b6c-f3f61bccbe7e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:19.955477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bbc000b1-555a-4432-8b6c-f3f61bccbe7e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:20.217680 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bbc000b1-555a-4432-8b6c-f3f61bccbe7e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "POST /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276165 Apr 05 11:55:20.218282 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 284/614] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Apr 5 11:55:19 2022] POST /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:55:23.055876 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8a2f9812-9eef-4462-b2e9-e42781932fed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:55:23.056916 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8a2f9812-9eef-4462-b2e9-e42781932fed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:23.063536 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8a2f9812-9eef-4462-b2e9-e42781932fed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:23.063990 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8a2f9812-9eef-4462-b2e9-e42781932fed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:23.064790 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8a2f9812-9eef-4462-b2e9-e42781932fed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:23.065221 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8a2f9812-9eef-4462-b2e9-e42781932fed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:23.087280 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.objects.instance [None req-8a2f9812-9eef-4462-b2e9-e42781932fed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lazy-loading 'flavor' on Instance uuid 99328563-d12a-4ef5-952b-c6c86929a22d {{(pid=123358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:55:23.229747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8a2f9812-9eef-4462-b2e9-e42781932fed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "POST /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/action" status: 200 len: 32 microversion: 2.1 time: 0.177731 Apr 05 11:55:23.230374 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 331/615] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Apr 5 11:55:23 2022] POST /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/action => generated 32 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 11:55:23.240840 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c0803df2-c08c-4858-bc51-a5dfefd72d2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:23.241529 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c0803df2-c08c-4858-bc51-a5dfefd72d2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:23.247825 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0803df2-c08c-4858-bc51-a5dfefd72d2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:23.248268 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0803df2-c08c-4858-bc51-a5dfefd72d2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:23.249038 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0803df2-c08c-4858-bc51-a5dfefd72d2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:23.249485 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0803df2-c08c-4858-bc51-a5dfefd72d2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:23.395760 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c0803df2-c08c-4858-bc51-a5dfefd72d2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:23.406644 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c0803df2-c08c-4858-bc51-a5dfefd72d2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.170211 Apr 05 11:55:23.407320 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 285/616] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:23 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:24.426943 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3eab599c-ccb9-45c4-afc4-bad55975a5d0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:24.427647 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3eab599c-ccb9-45c4-afc4-bad55975a5d0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:24.434308 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3eab599c-ccb9-45c4-afc4-bad55975a5d0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:24.434758 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3eab599c-ccb9-45c4-afc4-bad55975a5d0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:24.435517 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3eab599c-ccb9-45c4-afc4-bad55975a5d0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:24.435988 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3eab599c-ccb9-45c4-afc4-bad55975a5d0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:24.572437 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3eab599c-ccb9-45c4-afc4-bad55975a5d0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:24.580484 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3eab599c-ccb9-45c4-afc4-bad55975a5d0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.158325 Apr 05 11:55:24.581058 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 332/617] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:24 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:24.830985 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-23ee79ea-8416-4904-986f-f2fa8c1efad1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:24.831878 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-23ee79ea-8416-4904-986f-f2fa8c1efad1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:24.841032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-23ee79ea-8416-4904-986f-f2fa8c1efad1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:24.841481 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-23ee79ea-8416-4904-986f-f2fa8c1efad1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:24.842245 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-23ee79ea-8416-4904-986f-f2fa8c1efad1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:24.842677 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-23ee79ea-8416-4904-986f-f2fa8c1efad1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:24.922153 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.objects.instance [None req-23ee79ea-8416-4904-986f-f2fa8c1efad1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lazy-loading 'services' on Instance uuid c48b77eb-b654-43e4-9551-735bac89d0de {{(pid=123357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:55:24.997240 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-23ee79ea-8416-4904-986f-f2fa8c1efad1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments/aea50f3b-2e24-4934-88dd-e8f274d213d4" status: 202 len: 0 microversion: 2.1 time: 0.172761 Apr 05 11:55:24.997826 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 286/618] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Apr 5 11:55:24 2022] DELETE /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments/aea50f3b-2e24-4934-88dd-e8f274d213d4 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:55:25.600625 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6618c1a6-6328-4b79-a6ba-f49b5e4a2e75 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:25.601475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6618c1a6-6328-4b79-a6ba-f49b5e4a2e75 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:25.610606 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6618c1a6-6328-4b79-a6ba-f49b5e4a2e75 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:25.611251 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6618c1a6-6328-4b79-a6ba-f49b5e4a2e75 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:25.612377 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6618c1a6-6328-4b79-a6ba-f49b5e4a2e75 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:25.612990 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6618c1a6-6328-4b79-a6ba-f49b5e4a2e75 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:25.751409 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6618c1a6-6328-4b79-a6ba-f49b5e4a2e75 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:25.762758 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6618c1a6-6328-4b79-a6ba-f49b5e4a2e75 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.167794 Apr 05 11:55:25.763443 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 333/619] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:25 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:26.786756 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-dbebfba0-b442-4440-b9d3-ab76f0431e51 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:26.787898 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-dbebfba0-b442-4440-b9d3-ab76f0431e51 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:26.796252 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dbebfba0-b442-4440-b9d3-ab76f0431e51 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:26.796700 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dbebfba0-b442-4440-b9d3-ab76f0431e51 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:26.797469 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dbebfba0-b442-4440-b9d3-ab76f0431e51 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:26.797907 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dbebfba0-b442-4440-b9d3-ab76f0431e51 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:26.945139 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-dbebfba0-b442-4440-b9d3-ab76f0431e51 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:26.953283 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-dbebfba0-b442-4440-b9d3-ab76f0431e51 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.174469 Apr 05 11:55:26.953868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 287/620] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:26 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:27.974618 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-83ae4097-a465-450c-8833-1ff8af849923 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:27.975617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-83ae4097-a465-450c-8833-1ff8af849923 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:27.986193 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-83ae4097-a465-450c-8833-1ff8af849923 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:27.986939 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-83ae4097-a465-450c-8833-1ff8af849923 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:27.988236 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-83ae4097-a465-450c-8833-1ff8af849923 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:27.988963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-83ae4097-a465-450c-8833-1ff8af849923 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:28.128366 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-83ae4097-a465-450c-8833-1ff8af849923 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:28.136673 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-83ae4097-a465-450c-8833-1ff8af849923 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.168998 Apr 05 11:55:28.137254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 334/621] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:27 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:28.424904 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a7d58017-6338-4ef5-9fb6-7873e38f6fb4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:28.425417 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a7d58017-6338-4ef5-9fb6-7873e38f6fb4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:28.436082 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a7d58017-6338-4ef5-9fb6-7873e38f6fb4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:28.436557 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a7d58017-6338-4ef5-9fb6-7873e38f6fb4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:28.437300 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a7d58017-6338-4ef5-9fb6-7873e38f6fb4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:28.437744 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a7d58017-6338-4ef5-9fb6-7873e38f6fb4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:28.462331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a7d58017-6338-4ef5-9fb6-7873e38f6fb4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93/ips" status: 200 len: 149 microversion: 2.1 time: 0.043274 Apr 05 11:55:28.462910 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 288/622] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Apr 5 11:55:28 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:55:28.473951 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bc55703d-2c93-4f02-a1c0-c58e2cf40a0e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b56dc4a2-608f-4b3e-8481-37d73cee6b2f"}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:55:28.475117 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bc55703d-2c93-4f02-a1c0-c58e2cf40a0e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:28.481617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bc55703d-2c93-4f02-a1c0-c58e2cf40a0e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:28.482067 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bc55703d-2c93-4f02-a1c0-c58e2cf40a0e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:28.482829 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bc55703d-2c93-4f02-a1c0-c58e2cf40a0e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:28.483257 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bc55703d-2c93-4f02-a1c0-c58e2cf40a0e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:28.564760 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.wsgi [None req-bc55703d-2c93-4f02-a1c0-c58e2cf40a0e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] HTTP exception thrown: Invalid volume: volume b56dc4a2-608f-4b3e-8481-37d73cee6b2f is already attached to instances: f8d507e3-5f14-419a-a3cd-31f36496b2d8 Apr 05 11:55:28.565357 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bc55703d-2c93-4f02-a1c0-c58e2cf40a0e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Returning 400 to user: Invalid volume: volume b56dc4a2-608f-4b3e-8481-37d73cee6b2f is already attached to instances: f8d507e3-5f14-419a-a3cd-31f36496b2d8 {{(pid=123358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:55:28.566193 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bc55703d-2c93-4f02-a1c0-c58e2cf40a0e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "POST /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096656 Apr 05 11:55:28.566742 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 335/623] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Apr 5 11:55:28 2022] POST /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 05 11:55:28.578119 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9abfbebb-dace-4c52-bb44-2580f163c8fa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:28.578813 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9abfbebb-dace-4c52-bb44-2580f163c8fa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:28.587692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9abfbebb-dace-4c52-bb44-2580f163c8fa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:28.588292 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9abfbebb-dace-4c52-bb44-2580f163c8fa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:28.589180 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9abfbebb-dace-4c52-bb44-2580f163c8fa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:28.589602 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9abfbebb-dace-4c52-bb44-2580f163c8fa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:28.614483 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9abfbebb-dace-4c52-bb44-2580f163c8fa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Going to try to terminate instance {{(pid=123357) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:55:28.707015 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9abfbebb-dace-4c52-bb44-2580f163c8fa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "DELETE /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 204 len: 0 microversion: 2.1 time: 0.134845 Apr 05 11:55:28.707700 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 289/624] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 11:55:28 2022] DELETE /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:55:28.717540 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3ffb78f9-780e-458e-a709-b7a002a53378 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:28.718157 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3ffb78f9-780e-458e-a709-b7a002a53378 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:28.725286 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3ffb78f9-780e-458e-a709-b7a002a53378 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:28.725733 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3ffb78f9-780e-458e-a709-b7a002a53378 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:28.726495 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3ffb78f9-780e-458e-a709-b7a002a53378 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:28.726923 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3ffb78f9-780e-458e-a709-b7a002a53378 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:28.868772 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3ffb78f9-780e-458e-a709-b7a002a53378 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:28.876664 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3ffb78f9-780e-458e-a709-b7a002a53378 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.164622 Apr 05 11:55:28.877232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 336/625] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:28 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:29.159494 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a912da40-214b-4b89-bb08-158900b42a61 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:29.160658 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a912da40-214b-4b89-bb08-158900b42a61 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:29.169308 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a912da40-214b-4b89-bb08-158900b42a61 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:29.169748 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a912da40-214b-4b89-bb08-158900b42a61 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:29.170500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a912da40-214b-4b89-bb08-158900b42a61 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:29.172025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a912da40-214b-4b89-bb08-158900b42a61 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:29.306877 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a912da40-214b-4b89-bb08-158900b42a61 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:29.315288 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a912da40-214b-4b89-bb08-158900b42a61 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.162910 Apr 05 11:55:29.315858 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 290/626] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:29 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:29.898469 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-422fd49c-88d4-43f9-8b49-b7fc3ac52787 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:29.899481 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-422fd49c-88d4-43f9-8b49-b7fc3ac52787 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:29.910278 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-422fd49c-88d4-43f9-8b49-b7fc3ac52787 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:29.911042 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-422fd49c-88d4-43f9-8b49-b7fc3ac52787 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:29.912375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-422fd49c-88d4-43f9-8b49-b7fc3ac52787 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:29.913084 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-422fd49c-88d4-43f9-8b49-b7fc3ac52787 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:30.055096 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-422fd49c-88d4-43f9-8b49-b7fc3ac52787 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:30.063021 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-422fd49c-88d4-43f9-8b49-b7fc3ac52787 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.171117 Apr 05 11:55:30.063587 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 337/627] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:29 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:30.332767 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f73f62f7-27f7-488b-a14b-95ad3d555438 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:30.333483 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f73f62f7-27f7-488b-a14b-95ad3d555438 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:30.340284 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f73f62f7-27f7-488b-a14b-95ad3d555438 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:30.340739 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f73f62f7-27f7-488b-a14b-95ad3d555438 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:30.341534 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f73f62f7-27f7-488b-a14b-95ad3d555438 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:30.341969 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f73f62f7-27f7-488b-a14b-95ad3d555438 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:30.482762 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f73f62f7-27f7-488b-a14b-95ad3d555438 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:30.492454 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f73f62f7-27f7-488b-a14b-95ad3d555438 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.163531 Apr 05 11:55:30.493750 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 291/628] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:30 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:31.081376 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4451814b-9525-4282-b516-417b89c183f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:31.081960 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4451814b-9525-4282-b516-417b89c183f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:31.088816 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4451814b-9525-4282-b516-417b89c183f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:31.089265 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4451814b-9525-4282-b516-417b89c183f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:31.090026 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4451814b-9525-4282-b516-417b89c183f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:31.090438 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4451814b-9525-4282-b516-417b89c183f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:31.227725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4451814b-9525-4282-b516-417b89c183f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:31.235474 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4451814b-9525-4282-b516-417b89c183f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.157974 Apr 05 11:55:31.236041 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 338/629] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:31 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:31.523005 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bf86111f-2a2f-4a8c-b9f3-cbb879534624 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:31.523643 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bf86111f-2a2f-4a8c-b9f3-cbb879534624 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:31.530957 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bf86111f-2a2f-4a8c-b9f3-cbb879534624 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:31.531401 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bf86111f-2a2f-4a8c-b9f3-cbb879534624 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:31.532176 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bf86111f-2a2f-4a8c-b9f3-cbb879534624 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:31.532893 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bf86111f-2a2f-4a8c-b9f3-cbb879534624 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:31.680168 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-bf86111f-2a2f-4a8c-b9f3-cbb879534624 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:31.688462 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bf86111f-2a2f-4a8c-b9f3-cbb879534624 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.175223 Apr 05 11:55:31.689041 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 292/630] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:31 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:32.257249 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-73a21d4b-3a1a-4cd8-8733-c687fe4fc6c4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:32.258186 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-73a21d4b-3a1a-4cd8-8733-c687fe4fc6c4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:32.269077 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-73a21d4b-3a1a-4cd8-8733-c687fe4fc6c4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:32.269724 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-73a21d4b-3a1a-4cd8-8733-c687fe4fc6c4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:32.270973 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-73a21d4b-3a1a-4cd8-8733-c687fe4fc6c4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:32.271691 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-73a21d4b-3a1a-4cd8-8733-c687fe4fc6c4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:32.412232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-73a21d4b-3a1a-4cd8-8733-c687fe4fc6c4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:32.420028 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-73a21d4b-3a1a-4cd8-8733-c687fe4fc6c4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.169327 Apr 05 11:55:32.420629 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 339/631] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:32 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:32.709407 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-79e78f8b-aa61-4244-9e41-8ce1f6d19e2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:32.710412 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-79e78f8b-aa61-4244-9e41-8ce1f6d19e2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:32.721074 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79e78f8b-aa61-4244-9e41-8ce1f6d19e2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:32.722214 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79e78f8b-aa61-4244-9e41-8ce1f6d19e2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:32.723490 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79e78f8b-aa61-4244-9e41-8ce1f6d19e2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:32.724289 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79e78f8b-aa61-4244-9e41-8ce1f6d19e2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:32.858377 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-79e78f8b-aa61-4244-9e41-8ce1f6d19e2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:32.866247 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-79e78f8b-aa61-4244-9e41-8ce1f6d19e2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.163480 Apr 05 11:55:32.866784 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 293/632] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:32 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:33.442096 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2370d573-56f4-4ca6-8280-87ddc9612abc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:33.442943 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2370d573-56f4-4ca6-8280-87ddc9612abc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:33.451483 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2370d573-56f4-4ca6-8280-87ddc9612abc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:33.451909 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2370d573-56f4-4ca6-8280-87ddc9612abc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:33.452705 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2370d573-56f4-4ca6-8280-87ddc9612abc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:33.453136 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2370d573-56f4-4ca6-8280-87ddc9612abc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:33.612141 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2370d573-56f4-4ca6-8280-87ddc9612abc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:33.623270 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2370d573-56f4-4ca6-8280-87ddc9612abc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.187403 Apr 05 11:55:33.624030 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 340/633] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:33 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:33.887762 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-377c05be-3d76-42c4-8303-7d8df42b6637 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:33.888435 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-377c05be-3d76-42c4-8303-7d8df42b6637 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:33.897760 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-377c05be-3d76-42c4-8303-7d8df42b6637 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:33.898216 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-377c05be-3d76-42c4-8303-7d8df42b6637 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:33.899351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-377c05be-3d76-42c4-8303-7d8df42b6637 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:33.900153 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-377c05be-3d76-42c4-8303-7d8df42b6637 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:34.045062 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-377c05be-3d76-42c4-8303-7d8df42b6637 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:34.056165 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-377c05be-3d76-42c4-8303-7d8df42b6637 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.174511 Apr 05 11:55:34.057048 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 294/634] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:33 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:34.644812 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b78a475d-3565-4996-97e8-527788907212 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:34.645405 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b78a475d-3565-4996-97e8-527788907212 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:34.651911 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b78a475d-3565-4996-97e8-527788907212 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:34.652389 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b78a475d-3565-4996-97e8-527788907212 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:34.653144 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b78a475d-3565-4996-97e8-527788907212 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:34.653572 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b78a475d-3565-4996-97e8-527788907212 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:34.795419 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b78a475d-3565-4996-97e8-527788907212 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:34.803278 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b78a475d-3565-4996-97e8-527788907212 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.162430 Apr 05 11:55:34.803846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 341/635] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:34 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:35.075268 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-17ba3f15-62a2-4127-b57a-15167f36f59b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:35.075978 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-17ba3f15-62a2-4127-b57a-15167f36f59b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:35.083695 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-17ba3f15-62a2-4127-b57a-15167f36f59b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:35.084274 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-17ba3f15-62a2-4127-b57a-15167f36f59b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:35.085184 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-17ba3f15-62a2-4127-b57a-15167f36f59b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:35.085714 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-17ba3f15-62a2-4127-b57a-15167f36f59b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:35.228028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-17ba3f15-62a2-4127-b57a-15167f36f59b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:35.236558 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-17ba3f15-62a2-4127-b57a-15167f36f59b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.165943 Apr 05 11:55:35.237139 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 295/636] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:35 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:35.825062 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-113c694f-acbc-4ebe-ac18-3785b5d0553e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:35.825763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-113c694f-acbc-4ebe-ac18-3785b5d0553e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:35.834327 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-113c694f-acbc-4ebe-ac18-3785b5d0553e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:35.835570 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-113c694f-acbc-4ebe-ac18-3785b5d0553e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:35.836635 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-113c694f-acbc-4ebe-ac18-3785b5d0553e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:35.837185 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-113c694f-acbc-4ebe-ac18-3785b5d0553e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:35.992371 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-113c694f-acbc-4ebe-ac18-3785b5d0553e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:35.999745 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-113c694f-acbc-4ebe-ac18-3785b5d0553e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.181689 Apr 05 11:55:36.000349 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 342/637] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:35 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:36.255133 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a2df870c-3105-498b-bc54-7c61b30a5498 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:36.255705 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a2df870c-3105-498b-bc54-7c61b30a5498 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:36.263744 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a2df870c-3105-498b-bc54-7c61b30a5498 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:36.264229 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a2df870c-3105-498b-bc54-7c61b30a5498 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:36.265018 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a2df870c-3105-498b-bc54-7c61b30a5498 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:36.265445 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a2df870c-3105-498b-bc54-7c61b30a5498 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:36.397855 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a2df870c-3105-498b-bc54-7c61b30a5498 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:36.406246 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a2df870c-3105-498b-bc54-7c61b30a5498 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.155041 Apr 05 11:55:36.406723 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 296/638] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:36 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:37.021446 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-49d39439-c99e-4581-9110-cb8866f6cedf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:37.022376 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-49d39439-c99e-4581-9110-cb8866f6cedf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:37.030859 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-49d39439-c99e-4581-9110-cb8866f6cedf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:37.031308 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-49d39439-c99e-4581-9110-cb8866f6cedf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:37.032054 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-49d39439-c99e-4581-9110-cb8866f6cedf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:37.032515 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-49d39439-c99e-4581-9110-cb8866f6cedf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:37.166266 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-49d39439-c99e-4581-9110-cb8866f6cedf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:37.174303 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-49d39439-c99e-4581-9110-cb8866f6cedf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.159472 Apr 05 11:55:37.174906 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 343/639] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:37 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:37.427903 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2c08b6ae-2858-4893-808b-23a891c96f2b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:37.428956 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2c08b6ae-2858-4893-808b-23a891c96f2b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:37.439555 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2c08b6ae-2858-4893-808b-23a891c96f2b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:37.440363 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2c08b6ae-2858-4893-808b-23a891c96f2b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:37.441695 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2c08b6ae-2858-4893-808b-23a891c96f2b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:37.442414 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2c08b6ae-2858-4893-808b-23a891c96f2b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:37.580641 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2c08b6ae-2858-4893-808b-23a891c96f2b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:37.588462 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2c08b6ae-2858-4893-808b-23a891c96f2b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.167047 Apr 05 11:55:37.589026 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 297/640] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:37 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:38.194873 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d82a26c4-3680-4e5f-85a9-2b242e4493fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:38.195792 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d82a26c4-3680-4e5f-85a9-2b242e4493fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:38.203943 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d82a26c4-3680-4e5f-85a9-2b242e4493fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:38.204415 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d82a26c4-3680-4e5f-85a9-2b242e4493fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:38.205166 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d82a26c4-3680-4e5f-85a9-2b242e4493fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:38.205591 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d82a26c4-3680-4e5f-85a9-2b242e4493fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:38.352629 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d82a26c4-3680-4e5f-85a9-2b242e4493fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:38.360057 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d82a26c4-3680-4e5f-85a9-2b242e4493fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.171628 Apr 05 11:55:38.360653 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 344/641] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:38 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:38.608506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a556c2cc-9ab0-4be1-a14b-06c8614aa274 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:38.609134 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a556c2cc-9ab0-4be1-a14b-06c8614aa274 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:38.615870 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a556c2cc-9ab0-4be1-a14b-06c8614aa274 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:38.616353 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a556c2cc-9ab0-4be1-a14b-06c8614aa274 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:38.617119 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a556c2cc-9ab0-4be1-a14b-06c8614aa274 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:38.617555 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a556c2cc-9ab0-4be1-a14b-06c8614aa274 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:38.756502 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a556c2cc-9ab0-4be1-a14b-06c8614aa274 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:38.764787 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a556c2cc-9ab0-4be1-a14b-06c8614aa274 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.160907 Apr 05 11:55:38.765418 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 298/642] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:38 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:39.381906 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1028197b-731a-487f-b396-62ad029b7d66 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:39.382895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1028197b-731a-487f-b396-62ad029b7d66 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:39.390916 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1028197b-731a-487f-b396-62ad029b7d66 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:39.391360 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1028197b-731a-487f-b396-62ad029b7d66 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:39.392121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1028197b-731a-487f-b396-62ad029b7d66 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:39.392614 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1028197b-731a-487f-b396-62ad029b7d66 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:39.533216 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1028197b-731a-487f-b396-62ad029b7d66 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:39.541112 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1028197b-731a-487f-b396-62ad029b7d66 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.165709 Apr 05 11:55:39.541684 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 345/643] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:39 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:39.786004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9c076945-0a21-4ab2-a7ca-1f43b486035d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:39.786878 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9c076945-0a21-4ab2-a7ca-1f43b486035d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:39.797775 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9c076945-0a21-4ab2-a7ca-1f43b486035d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:39.798715 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9c076945-0a21-4ab2-a7ca-1f43b486035d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:39.800437 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9c076945-0a21-4ab2-a7ca-1f43b486035d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:39.800886 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9c076945-0a21-4ab2-a7ca-1f43b486035d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:39.943193 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9c076945-0a21-4ab2-a7ca-1f43b486035d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:39.954626 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9c076945-0a21-4ab2-a7ca-1f43b486035d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.175126 Apr 05 11:55:39.955416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 299/644] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:39 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:40.563332 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4ea796f9-0dac-4a64-b587-297a892b8299 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:40.564281 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4ea796f9-0dac-4a64-b587-297a892b8299 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:40.575055 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4ea796f9-0dac-4a64-b587-297a892b8299 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:40.575800 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4ea796f9-0dac-4a64-b587-297a892b8299 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:40.577138 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4ea796f9-0dac-4a64-b587-297a892b8299 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:40.577864 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4ea796f9-0dac-4a64-b587-297a892b8299 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:40.719984 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4ea796f9-0dac-4a64-b587-297a892b8299 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:40.727751 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4ea796f9-0dac-4a64-b587-297a892b8299 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.171351 Apr 05 11:55:40.728368 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 346/645] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:40 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:40.979287 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9b9f2807-7be5-4805-8386-f1716ac54a49 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:40.980322 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9b9f2807-7be5-4805-8386-f1716ac54a49 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:40.987931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9b9f2807-7be5-4805-8386-f1716ac54a49 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:40.988501 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9b9f2807-7be5-4805-8386-f1716ac54a49 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:40.989381 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9b9f2807-7be5-4805-8386-f1716ac54a49 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:40.989882 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9b9f2807-7be5-4805-8386-f1716ac54a49 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:41.126328 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9b9f2807-7be5-4805-8386-f1716ac54a49 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:41.134535 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9b9f2807-7be5-4805-8386-f1716ac54a49 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.161642 Apr 05 11:55:41.135079 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 300/646] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:40 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:41.749762 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b42c671a-d8c3-43d9-ac46-7cc22efce959 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:41.750608 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b42c671a-d8c3-43d9-ac46-7cc22efce959 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:41.761376 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b42c671a-d8c3-43d9-ac46-7cc22efce959 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:41.761821 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b42c671a-d8c3-43d9-ac46-7cc22efce959 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:41.762582 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b42c671a-d8c3-43d9-ac46-7cc22efce959 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:41.763013 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b42c671a-d8c3-43d9-ac46-7cc22efce959 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:41.903362 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b42c671a-d8c3-43d9-ac46-7cc22efce959 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:41.914934 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b42c671a-d8c3-43d9-ac46-7cc22efce959 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.171675 Apr 05 11:55:41.915653 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 347/647] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:41 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:42.156502 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-44f6d59f-d1c4-4e28-813d-5f3d564d19ab tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:42.157494 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-44f6d59f-d1c4-4e28-813d-5f3d564d19ab tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:42.167893 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-44f6d59f-d1c4-4e28-813d-5f3d564d19ab tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:42.168386 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-44f6d59f-d1c4-4e28-813d-5f3d564d19ab tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:42.169143 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-44f6d59f-d1c4-4e28-813d-5f3d564d19ab tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:42.169569 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-44f6d59f-d1c4-4e28-813d-5f3d564d19ab tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:42.315684 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-44f6d59f-d1c4-4e28-813d-5f3d564d19ab tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:42.324261 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-44f6d59f-d1c4-4e28-813d-5f3d564d19ab tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.174215 Apr 05 11:55:42.324831 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 301/648] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:42 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:42.937207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-794cd35c-c9fb-4fb6-ac2d-4e24569859bc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:42.938461 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-794cd35c-c9fb-4fb6-ac2d-4e24569859bc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:42.952030 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-794cd35c-c9fb-4fb6-ac2d-4e24569859bc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:42.955143 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-794cd35c-c9fb-4fb6-ac2d-4e24569859bc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:42.955951 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-794cd35c-c9fb-4fb6-ac2d-4e24569859bc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:42.956414 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-794cd35c-c9fb-4fb6-ac2d-4e24569859bc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:43.105180 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-794cd35c-c9fb-4fb6-ac2d-4e24569859bc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:43.112858 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-794cd35c-c9fb-4fb6-ac2d-4e24569859bc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.182343 Apr 05 11:55:43.113435 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 348/649] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:42 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:43.343218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cb82e858-8811-4331-b001-97b428ba7c79 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:43.343836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cb82e858-8811-4331-b001-97b428ba7c79 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:43.350866 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cb82e858-8811-4331-b001-97b428ba7c79 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:43.351316 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cb82e858-8811-4331-b001-97b428ba7c79 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:43.352103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cb82e858-8811-4331-b001-97b428ba7c79 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:43.352541 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cb82e858-8811-4331-b001-97b428ba7c79 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:43.490939 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-cb82e858-8811-4331-b001-97b428ba7c79 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:43.501783 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cb82e858-8811-4331-b001-97b428ba7c79 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.162606 Apr 05 11:55:43.502476 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 302/650] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:43 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:44.134227 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8ae16207-c5ff-4afe-a11d-7c4dc3a85c80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:44.135288 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8ae16207-c5ff-4afe-a11d-7c4dc3a85c80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:44.145585 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8ae16207-c5ff-4afe-a11d-7c4dc3a85c80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:44.146328 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8ae16207-c5ff-4afe-a11d-7c4dc3a85c80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:44.147589 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8ae16207-c5ff-4afe-a11d-7c4dc3a85c80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:44.148408 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8ae16207-c5ff-4afe-a11d-7c4dc3a85c80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:44.289775 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8ae16207-c5ff-4afe-a11d-7c4dc3a85c80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:44.297916 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8ae16207-c5ff-4afe-a11d-7c4dc3a85c80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.170174 Apr 05 11:55:44.298488 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 349/651] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:44 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:44.519445 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-670261a1-666c-4368-b802-861ec460de61 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:44.520093 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-670261a1-666c-4368-b802-861ec460de61 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:44.526873 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-670261a1-666c-4368-b802-861ec460de61 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:44.527297 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-670261a1-666c-4368-b802-861ec460de61 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:44.528095 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-670261a1-666c-4368-b802-861ec460de61 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:44.528544 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-670261a1-666c-4368-b802-861ec460de61 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:44.675337 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-670261a1-666c-4368-b802-861ec460de61 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:44.683371 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-670261a1-666c-4368-b802-861ec460de61 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.167808 Apr 05 11:55:44.683939 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 303/652] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:44 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:45.326766 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-09f01355-4b81-4292-8120-e841c338ed3d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:45.328261 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-09f01355-4b81-4292-8120-e841c338ed3d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:45.338141 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-09f01355-4b81-4292-8120-e841c338ed3d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:45.339073 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-09f01355-4b81-4292-8120-e841c338ed3d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:45.339846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-09f01355-4b81-4292-8120-e841c338ed3d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:45.340311 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-09f01355-4b81-4292-8120-e841c338ed3d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:45.487403 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-09f01355-4b81-4292-8120-e841c338ed3d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:45.496181 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-09f01355-4b81-4292-8120-e841c338ed3d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.184287 Apr 05 11:55:45.497016 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 350/653] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:45 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:45.705798 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-38d7d5ed-7f1c-4b51-9a9e-a412b85d42b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:45.706406 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-38d7d5ed-7f1c-4b51-9a9e-a412b85d42b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:45.716788 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-38d7d5ed-7f1c-4b51-9a9e-a412b85d42b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:45.717535 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-38d7d5ed-7f1c-4b51-9a9e-a412b85d42b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:45.718799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-38d7d5ed-7f1c-4b51-9a9e-a412b85d42b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:45.719531 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-38d7d5ed-7f1c-4b51-9a9e-a412b85d42b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:45.870381 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-38d7d5ed-7f1c-4b51-9a9e-a412b85d42b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:45.878654 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-38d7d5ed-7f1c-4b51-9a9e-a412b85d42b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.180082 Apr 05 11:55:45.879233 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 304/654] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:45 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:46.514977 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cce87bd0-e7f2-4570-b2ab-00580c6ac378 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:46.515549 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cce87bd0-e7f2-4570-b2ab-00580c6ac378 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:46.522276 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cce87bd0-e7f2-4570-b2ab-00580c6ac378 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:46.522718 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cce87bd0-e7f2-4570-b2ab-00580c6ac378 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:46.523470 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cce87bd0-e7f2-4570-b2ab-00580c6ac378 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:46.523928 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cce87bd0-e7f2-4570-b2ab-00580c6ac378 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:46.660043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cce87bd0-e7f2-4570-b2ab-00580c6ac378 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:46.667502 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cce87bd0-e7f2-4570-b2ab-00580c6ac378 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.156449 Apr 05 11:55:46.668109 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 351/655] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:46 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:46.900401 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-eeb174c3-5afc-459c-bc31-748a91e29f97 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:46.901467 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-eeb174c3-5afc-459c-bc31-748a91e29f97 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:46.912140 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eeb174c3-5afc-459c-bc31-748a91e29f97 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:46.912939 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eeb174c3-5afc-459c-bc31-748a91e29f97 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:46.914203 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eeb174c3-5afc-459c-bc31-748a91e29f97 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:46.914930 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eeb174c3-5afc-459c-bc31-748a91e29f97 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:47.049317 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-eeb174c3-5afc-459c-bc31-748a91e29f97 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:47.057207 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-eeb174c3-5afc-459c-bc31-748a91e29f97 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.163484 Apr 05 11:55:47.057778 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 305/656] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:46 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:47.689126 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4bedece2-7d4f-4a9d-b72f-442edf6e139e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:47.690139 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4bedece2-7d4f-4a9d-b72f-442edf6e139e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:47.700236 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4bedece2-7d4f-4a9d-b72f-442edf6e139e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:47.700682 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4bedece2-7d4f-4a9d-b72f-442edf6e139e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:47.701441 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4bedece2-7d4f-4a9d-b72f-442edf6e139e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:47.701942 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4bedece2-7d4f-4a9d-b72f-442edf6e139e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:48.074020 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-975e1230-c5fa-49bc-8d2e-354c211dc15f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:48.074731 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-975e1230-c5fa-49bc-8d2e-354c211dc15f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:48.081190 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-975e1230-c5fa-49bc-8d2e-354c211dc15f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:48.081639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-975e1230-c5fa-49bc-8d2e-354c211dc15f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:48.082402 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-975e1230-c5fa-49bc-8d2e-354c211dc15f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:48.082848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-975e1230-c5fa-49bc-8d2e-354c211dc15f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:48.085965 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4bedece2-7d4f-4a9d-b72f-442edf6e139e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:48.093560 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4bedece2-7d4f-4a9d-b72f-442edf6e139e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.410851 Apr 05 11:55:48.094230 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 352/657] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:47 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:48.235413 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-975e1230-c5fa-49bc-8d2e-354c211dc15f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:48.243613 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-975e1230-c5fa-49bc-8d2e-354c211dc15f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.173602 Apr 05 11:55:48.244257 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 306/658] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:48 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:49.115485 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-dba9d01b-ac79-4629-98d1-504598ae3551 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:49.116522 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-dba9d01b-ac79-4629-98d1-504598ae3551 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:49.127079 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dba9d01b-ac79-4629-98d1-504598ae3551 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:49.127825 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dba9d01b-ac79-4629-98d1-504598ae3551 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:49.129130 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dba9d01b-ac79-4629-98d1-504598ae3551 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:49.129833 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dba9d01b-ac79-4629-98d1-504598ae3551 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:49.261312 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7a1be24b-8d37-4876-874b-b3c4e0aa95a4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:49.261875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7a1be24b-8d37-4876-874b-b3c4e0aa95a4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:49.268860 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7a1be24b-8d37-4876-874b-b3c4e0aa95a4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:49.268987 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7a1be24b-8d37-4876-874b-b3c4e0aa95a4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:49.269720 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7a1be24b-8d37-4876-874b-b3c4e0aa95a4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:49.270122 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7a1be24b-8d37-4876-874b-b3c4e0aa95a4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:49.318500 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-dba9d01b-ac79-4629-98d1-504598ae3551 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:49.326134 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-dba9d01b-ac79-4629-98d1-504598ae3551 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.217642 Apr 05 11:55:49.326711 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 353/659] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:49 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:49.403476 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7a1be24b-8d37-4876-874b-b3c4e0aa95a4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:49.411292 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7a1be24b-8d37-4876-874b-b3c4e0aa95a4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.153869 Apr 05 11:55:49.411855 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 307/660] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:49 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:50.347477 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9bc09e01-bfcd-4198-a6fa-d3b3c06b88da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:50.348728 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9bc09e01-bfcd-4198-a6fa-d3b3c06b88da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:50.359417 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9bc09e01-bfcd-4198-a6fa-d3b3c06b88da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:50.360219 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9bc09e01-bfcd-4198-a6fa-d3b3c06b88da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:50.361464 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9bc09e01-bfcd-4198-a6fa-d3b3c06b88da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:50.362185 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9bc09e01-bfcd-4198-a6fa-d3b3c06b88da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:50.428651 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a5b0bcc0-9d95-44d6-8488-2ff1907ce640 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:50.429269 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a5b0bcc0-9d95-44d6-8488-2ff1907ce640 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:50.437703 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a5b0bcc0-9d95-44d6-8488-2ff1907ce640 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:50.438758 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a5b0bcc0-9d95-44d6-8488-2ff1907ce640 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:50.439801 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a5b0bcc0-9d95-44d6-8488-2ff1907ce640 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:50.440494 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a5b0bcc0-9d95-44d6-8488-2ff1907ce640 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:50.501647 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9bc09e01-bfcd-4198-a6fa-d3b3c06b88da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:50.509119 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9bc09e01-bfcd-4198-a6fa-d3b3c06b88da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.168632 Apr 05 11:55:50.509706 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 354/661] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:50 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:50.621981 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a5b0bcc0-9d95-44d6-8488-2ff1907ce640 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:50.629886 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a5b0bcc0-9d95-44d6-8488-2ff1907ce640 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.205157 Apr 05 11:55:50.630450 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 308/662] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:50 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:55:51.528123 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-aa481a64-23bc-462b-bf70-ee836231d59f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:51.529782 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-aa481a64-23bc-462b-bf70-ee836231d59f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:51.538563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aa481a64-23bc-462b-bf70-ee836231d59f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:51.539187 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aa481a64-23bc-462b-bf70-ee836231d59f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:51.540374 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aa481a64-23bc-462b-bf70-ee836231d59f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:51.540996 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aa481a64-23bc-462b-bf70-ee836231d59f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:51.646653 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-33b028d6-799c-42b1-8477-df78532f2113 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:51.647254 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-33b028d6-799c-42b1-8477-df78532f2113 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:51.653738 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-33b028d6-799c-42b1-8477-df78532f2113 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:51.654187 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-33b028d6-799c-42b1-8477-df78532f2113 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:51.654942 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-33b028d6-799c-42b1-8477-df78532f2113 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:51.655377 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-33b028d6-799c-42b1-8477-df78532f2113 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:51.680812 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-aa481a64-23bc-462b-bf70-ee836231d59f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:51.688369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-aa481a64-23bc-462b-bf70-ee836231d59f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.164922 Apr 05 11:55:51.688964 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 355/663] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:51 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:51.791311 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-33b028d6-799c-42b1-8477-df78532f2113 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:51.799428 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-33b028d6-799c-42b1-8477-df78532f2113 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.156561 Apr 05 11:55:51.799998 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 309/664] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:51 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:52.056109 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-430573e1-b5c5-49ba-9074-067cc6706c2b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:52.056784 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-430573e1-b5c5-49ba-9074-067cc6706c2b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:52.065582 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-430573e1-b5c5-49ba-9074-067cc6706c2b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:52.066171 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-430573e1-b5c5-49ba-9074-067cc6706c2b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:52.067295 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-430573e1-b5c5-49ba-9074-067cc6706c2b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:52.067872 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-430573e1-b5c5-49ba-9074-067cc6706c2b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:52.105213 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-430573e1-b5c5-49ba-9074-067cc6706c2b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments/461cf5e0-a664-4330-8d57-4b8c2a28a05a" status: 200 len: 194 microversion: 2.20 time: 0.055985 Apr 05 11:55:52.105795 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 356/665] 10.222.0.61 () {60 vars in 1453 bytes} [Tue Apr 5 11:55:52 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments/461cf5e0-a664-4330-8d57-4b8c2a28a05a => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:55:52.167848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1df499e8-1a6c-4a08-8314-547c1e9093ab tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:52.168384 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1df499e8-1a6c-4a08-8314-547c1e9093ab tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:52.174771 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1df499e8-1a6c-4a08-8314-547c1e9093ab tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:52.175220 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1df499e8-1a6c-4a08-8314-547c1e9093ab tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:52.175989 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1df499e8-1a6c-4a08-8314-547c1e9093ab tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:52.176632 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1df499e8-1a6c-4a08-8314-547c1e9093ab tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:52.257051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.objects.instance [None req-1df499e8-1a6c-4a08-8314-547c1e9093ab tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lazy-loading 'services' on Instance uuid 98a3437c-94c0-4133-a629-9386b4639a2d {{(pid=123357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:55:52.337731 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1df499e8-1a6c-4a08-8314-547c1e9093ab tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "DELETE /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments/461cf5e0-a664-4330-8d57-4b8c2a28a05a" status: 202 len: 0 microversion: 2.20 time: 0.173841 Apr 05 11:55:52.338349 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 310/666] 10.222.0.61 () {60 vars in 1456 bytes} [Tue Apr 5 11:55:52 2022] DELETE /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments/461cf5e0-a664-4330-8d57-4b8c2a28a05a => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:55:52.347077 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0de656d9-e8fb-4726-a75d-d7a71cc92d45 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:52.348054 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0de656d9-e8fb-4726-a75d-d7a71cc92d45 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:52.354172 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0de656d9-e8fb-4726-a75d-d7a71cc92d45 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:52.354612 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0de656d9-e8fb-4726-a75d-d7a71cc92d45 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:52.355367 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0de656d9-e8fb-4726-a75d-d7a71cc92d45 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:52.355798 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0de656d9-e8fb-4726-a75d-d7a71cc92d45 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:52.384024 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0de656d9-e8fb-4726-a75d-d7a71cc92d45 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041269 Apr 05 11:55:52.384605 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 357/667] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:55:52 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 11:55:52.706569 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-18b41b3c-3585-46a1-81b7-76d156cf3726 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:52.707271 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-18b41b3c-3585-46a1-81b7-76d156cf3726 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:52.713978 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-18b41b3c-3585-46a1-81b7-76d156cf3726 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:52.714416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-18b41b3c-3585-46a1-81b7-76d156cf3726 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:52.715190 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-18b41b3c-3585-46a1-81b7-76d156cf3726 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:52.715624 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-18b41b3c-3585-46a1-81b7-76d156cf3726 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:52.817106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f2907288-442a-485d-afab-d516e2955eb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:52.817714 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f2907288-442a-485d-afab-d516e2955eb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:52.824190 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f2907288-442a-485d-afab-d516e2955eb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:52.824635 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f2907288-442a-485d-afab-d516e2955eb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:52.825418 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f2907288-442a-485d-afab-d516e2955eb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:52.825850 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f2907288-442a-485d-afab-d516e2955eb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:52.859328 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-18b41b3c-3585-46a1-81b7-76d156cf3726 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:52.867269 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-18b41b3c-3585-46a1-81b7-76d156cf3726 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.165202 Apr 05 11:55:52.867738 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 311/668] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:52 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:52.982156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f2907288-442a-485d-afab-d516e2955eb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:52.990418 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f2907288-442a-485d-afab-d516e2955eb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.177295 Apr 05 11:55:52.991000 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 358/669] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:52 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:55:53.401423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ce973e4c-6afa-4c8e-a095-e45205985943 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:53.402507 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ce973e4c-6afa-4c8e-a095-e45205985943 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:53.409616 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ce973e4c-6afa-4c8e-a095-e45205985943 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:53.410116 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ce973e4c-6afa-4c8e-a095-e45205985943 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:53.410969 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ce973e4c-6afa-4c8e-a095-e45205985943 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:53.411457 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ce973e4c-6afa-4c8e-a095-e45205985943 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:53.442012 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ce973e4c-6afa-4c8e-a095-e45205985943 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047472 Apr 05 11:55:53.442582 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 312/670] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:55:53 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:55:53.887728 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-eea53dcf-9ca3-4266-b7f0-d5ebfc2097df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:53.888394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-eea53dcf-9ca3-4266-b7f0-d5ebfc2097df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:53.895349 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eea53dcf-9ca3-4266-b7f0-d5ebfc2097df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:53.895815 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eea53dcf-9ca3-4266-b7f0-d5ebfc2097df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:53.896694 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eea53dcf-9ca3-4266-b7f0-d5ebfc2097df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:53.897141 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eea53dcf-9ca3-4266-b7f0-d5ebfc2097df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:54.007998 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fe8b2303-06ed-46b8-9ba1-67b516131bc1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:54.008626 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fe8b2303-06ed-46b8-9ba1-67b516131bc1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:54.015124 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe8b2303-06ed-46b8-9ba1-67b516131bc1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:54.015567 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe8b2303-06ed-46b8-9ba1-67b516131bc1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:54.016359 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe8b2303-06ed-46b8-9ba1-67b516131bc1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:54.016788 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe8b2303-06ed-46b8-9ba1-67b516131bc1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:54.037749 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-eea53dcf-9ca3-4266-b7f0-d5ebfc2097df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:54.045688 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-eea53dcf-9ca3-4266-b7f0-d5ebfc2097df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.163425 Apr 05 11:55:54.046259 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 359/671] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:53 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:54.153057 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fe8b2303-06ed-46b8-9ba1-67b516131bc1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:54.161201 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fe8b2303-06ed-46b8-9ba1-67b516131bc1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.157048 Apr 05 11:55:54.161782 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 313/672] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:54 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:54.455162 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1ae203a3-90e5-4fa8-a06c-04764ed45b17 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:54.456109 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1ae203a3-90e5-4fa8-a06c-04764ed45b17 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:54.462530 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1ae203a3-90e5-4fa8-a06c-04764ed45b17 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:54.462974 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1ae203a3-90e5-4fa8-a06c-04764ed45b17 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:54.463724 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1ae203a3-90e5-4fa8-a06c-04764ed45b17 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:54.464185 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1ae203a3-90e5-4fa8-a06c-04764ed45b17 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:54.494423 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1ae203a3-90e5-4fa8-a06c-04764ed45b17 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043332 Apr 05 11:55:54.495020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 360/673] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:55:54 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:55:55.067164 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-38001438-729f-43b9-8c85-22fe2faa5da0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:55.068190 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-38001438-729f-43b9-8c85-22fe2faa5da0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:55.078967 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-38001438-729f-43b9-8c85-22fe2faa5da0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:55.079708 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-38001438-729f-43b9-8c85-22fe2faa5da0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:55.080981 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-38001438-729f-43b9-8c85-22fe2faa5da0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:55.081741 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-38001438-729f-43b9-8c85-22fe2faa5da0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:55.178777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-39add341-06bb-456d-bd3f-2b54811ff3b4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:55.179563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-39add341-06bb-456d-bd3f-2b54811ff3b4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:55.186421 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-39add341-06bb-456d-bd3f-2b54811ff3b4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:55.186869 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-39add341-06bb-456d-bd3f-2b54811ff3b4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:55.187648 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-39add341-06bb-456d-bd3f-2b54811ff3b4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:55.188108 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-39add341-06bb-456d-bd3f-2b54811ff3b4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:55.220391 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-38001438-729f-43b9-8c85-22fe2faa5da0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:55.228818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-38001438-729f-43b9-8c85-22fe2faa5da0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.168159 Apr 05 11:55:55.229529 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 314/674] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:55 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:55.321614 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-39add341-06bb-456d-bd3f-2b54811ff3b4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:55.330660 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-39add341-06bb-456d-bd3f-2b54811ff3b4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.155784 Apr 05 11:55:55.331246 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 361/675] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:55 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:55.511057 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e5e9548a-476c-4059-a414-d0b1372aa968 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:55.512043 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e5e9548a-476c-4059-a414-d0b1372aa968 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:55.518447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e5e9548a-476c-4059-a414-d0b1372aa968 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:55.518893 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e5e9548a-476c-4059-a414-d0b1372aa968 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:55.519666 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e5e9548a-476c-4059-a414-d0b1372aa968 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:55.520116 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e5e9548a-476c-4059-a414-d0b1372aa968 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:55.548647 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e5e9548a-476c-4059-a414-d0b1372aa968 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044436 Apr 05 11:55:55.549191 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 315/676] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:55:55 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:55:56.249194 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-55013d7f-4821-4424-ae96-6f4ab3cf292a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:56.249957 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-55013d7f-4821-4424-ae96-6f4ab3cf292a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:56.257254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-55013d7f-4821-4424-ae96-6f4ab3cf292a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:56.257703 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-55013d7f-4821-4424-ae96-6f4ab3cf292a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:56.258461 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-55013d7f-4821-4424-ae96-6f4ab3cf292a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:56.258890 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-55013d7f-4821-4424-ae96-6f4ab3cf292a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:56.348424 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-815aa2b7-40a0-4d47-bdc9-5c037f6d68f2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:56.349032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-815aa2b7-40a0-4d47-bdc9-5c037f6d68f2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:56.355705 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-815aa2b7-40a0-4d47-bdc9-5c037f6d68f2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:56.356182 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-815aa2b7-40a0-4d47-bdc9-5c037f6d68f2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:56.356999 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-815aa2b7-40a0-4d47-bdc9-5c037f6d68f2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:56.357431 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-815aa2b7-40a0-4d47-bdc9-5c037f6d68f2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:56.393059 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-55013d7f-4821-4424-ae96-6f4ab3cf292a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:56.400702 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-55013d7f-4821-4424-ae96-6f4ab3cf292a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.156473 Apr 05 11:55:56.401286 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 362/677] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:56 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:56.493262 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-815aa2b7-40a0-4d47-bdc9-5c037f6d68f2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:56.501944 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-815aa2b7-40a0-4d47-bdc9-5c037f6d68f2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.157716 Apr 05 11:55:56.502420 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 316/678] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:56 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:56.560798 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c6c31e47-d3bf-4911-9db2-85d4dea7c4e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:56.561719 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c6c31e47-d3bf-4911-9db2-85d4dea7c4e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:56.568166 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c6c31e47-d3bf-4911-9db2-85d4dea7c4e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:56.568617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c6c31e47-d3bf-4911-9db2-85d4dea7c4e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:56.569388 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c6c31e47-d3bf-4911-9db2-85d4dea7c4e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:56.569827 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c6c31e47-d3bf-4911-9db2-85d4dea7c4e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:56.601674 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c6c31e47-d3bf-4911-9db2-85d4dea7c4e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044625 Apr 05 11:55:56.602366 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 363/679] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:55:56 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:55:57.421787 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ca159048-199d-492e-837a-90a89f4ab4a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:57.422538 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ca159048-199d-492e-837a-90a89f4ab4a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:57.430777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ca159048-199d-492e-837a-90a89f4ab4a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:57.431337 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ca159048-199d-492e-837a-90a89f4ab4a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:57.432333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ca159048-199d-492e-837a-90a89f4ab4a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:57.432875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ca159048-199d-492e-837a-90a89f4ab4a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:57.518898 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-818e9c89-a9d4-40a4-8523-077f1eb27236 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:57.519508 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-818e9c89-a9d4-40a4-8523-077f1eb27236 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:57.526131 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-818e9c89-a9d4-40a4-8523-077f1eb27236 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:57.526578 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-818e9c89-a9d4-40a4-8523-077f1eb27236 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:57.527332 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-818e9c89-a9d4-40a4-8523-077f1eb27236 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:57.527759 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-818e9c89-a9d4-40a4-8523-077f1eb27236 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:57.569299 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ca159048-199d-492e-837a-90a89f4ab4a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:57.576923 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ca159048-199d-492e-837a-90a89f4ab4a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.161079 Apr 05 11:55:57.577494 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 317/680] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:57 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:57.613564 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1a7e03ce-7dff-4344-b264-79619af9e747 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:57.614535 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1a7e03ce-7dff-4344-b264-79619af9e747 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:57.620699 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1a7e03ce-7dff-4344-b264-79619af9e747 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:57.621143 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1a7e03ce-7dff-4344-b264-79619af9e747 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:57.621920 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1a7e03ce-7dff-4344-b264-79619af9e747 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:57.622357 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1a7e03ce-7dff-4344-b264-79619af9e747 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:57.650829 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1a7e03ce-7dff-4344-b264-79619af9e747 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041162 Apr 05 11:55:57.651375 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 318/681] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:55:57 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 11:55:57.659359 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-818e9c89-a9d4-40a4-8523-077f1eb27236 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:57.670619 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-818e9c89-a9d4-40a4-8523-077f1eb27236 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.155498 Apr 05 11:55:57.671237 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 364/682] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:57 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:58.599926 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f5bf1057-2437-4cb8-a29c-d4e8e6210d5b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:58.601100 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f5bf1057-2437-4cb8-a29c-d4e8e6210d5b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:58.611869 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f5bf1057-2437-4cb8-a29c-d4e8e6210d5b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:58.612673 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f5bf1057-2437-4cb8-a29c-d4e8e6210d5b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:58.613939 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f5bf1057-2437-4cb8-a29c-d4e8e6210d5b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:58.614655 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f5bf1057-2437-4cb8-a29c-d4e8e6210d5b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:58.662762 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3bc16e01-af68-4f6c-9be6-b8f0f842c036 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:58.663592 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3bc16e01-af68-4f6c-9be6-b8f0f842c036 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:58.670326 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3bc16e01-af68-4f6c-9be6-b8f0f842c036 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:58.670880 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3bc16e01-af68-4f6c-9be6-b8f0f842c036 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:58.671616 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3bc16e01-af68-4f6c-9be6-b8f0f842c036 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:58.672103 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3bc16e01-af68-4f6c-9be6-b8f0f842c036 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:58.701440 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3bc16e01-af68-4f6c-9be6-b8f0f842c036 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042700 Apr 05 11:55:58.702289 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 365/683] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:55:58 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 11:55:58.706740 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0ab39051-bef9-4e43-963f-b8159c3d67c0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:58.707336 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0ab39051-bef9-4e43-963f-b8159c3d67c0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:58.713093 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0ab39051-bef9-4e43-963f-b8159c3d67c0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:58.713528 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0ab39051-bef9-4e43-963f-b8159c3d67c0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:58.714310 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0ab39051-bef9-4e43-963f-b8159c3d67c0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:58.714737 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0ab39051-bef9-4e43-963f-b8159c3d67c0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:58.750491 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f5bf1057-2437-4cb8-a29c-d4e8e6210d5b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:58.758098 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f5bf1057-2437-4cb8-a29c-d4e8e6210d5b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.166054 Apr 05 11:55:58.758768 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 319/684] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:58 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:58.854409 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0ab39051-bef9-4e43-963f-b8159c3d67c0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:58.862823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0ab39051-bef9-4e43-963f-b8159c3d67c0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.159556 Apr 05 11:55:58.863523 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 366/685] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:58 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:55:59.714204 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8685f123-10d0-42eb-b66b-b4909d18de97 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:59.715207 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8685f123-10d0-42eb-b66b-b4909d18de97 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:59.722909 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8685f123-10d0-42eb-b66b-b4909d18de97 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:59.723402 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8685f123-10d0-42eb-b66b-b4909d18de97 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:59.724336 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8685f123-10d0-42eb-b66b-b4909d18de97 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:59.724817 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8685f123-10d0-42eb-b66b-b4909d18de97 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:59.754655 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8685f123-10d0-42eb-b66b-b4909d18de97 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044849 Apr 05 11:55:59.755170 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 320/686] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:55:59 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:55:59.774782 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-448ec54e-32cf-40cc-99d3-eaf634e3a0e1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:59.775367 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-448ec54e-32cf-40cc-99d3-eaf634e3a0e1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:59.782090 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-448ec54e-32cf-40cc-99d3-eaf634e3a0e1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:59.782538 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-448ec54e-32cf-40cc-99d3-eaf634e3a0e1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:59.783288 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-448ec54e-32cf-40cc-99d3-eaf634e3a0e1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:59.783715 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-448ec54e-32cf-40cc-99d3-eaf634e3a0e1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:59.879212 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7a3e221a-18ab-4ca2-b4bd-af9c676ec7dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:55:59.879818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7a3e221a-18ab-4ca2-b4bd-af9c676ec7dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:55:59.886090 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7a3e221a-18ab-4ca2-b4bd-af9c676ec7dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:59.886506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7a3e221a-18ab-4ca2-b4bd-af9c676ec7dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:59.887299 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7a3e221a-18ab-4ca2-b4bd-af9c676ec7dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:55:59.887721 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7a3e221a-18ab-4ca2-b4bd-af9c676ec7dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:55:59.918644 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-448ec54e-32cf-40cc-99d3-eaf634e3a0e1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:55:59.926466 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-448ec54e-32cf-40cc-99d3-eaf634e3a0e1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.155491 Apr 05 11:55:59.927293 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 367/687] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:59 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:00.024099 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7a3e221a-18ab-4ca2-b4bd-af9c676ec7dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:00.032468 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7a3e221a-18ab-4ca2-b4bd-af9c676ec7dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.157031 Apr 05 11:56:00.033046 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 321/688] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:55:59 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:00.770944 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d5c28709-0821-42c3-b7a9-95adc14415d6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:00.772522 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d5c28709-0821-42c3-b7a9-95adc14415d6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:00.781616 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d5c28709-0821-42c3-b7a9-95adc14415d6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:00.783907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d5c28709-0821-42c3-b7a9-95adc14415d6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:00.784765 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d5c28709-0821-42c3-b7a9-95adc14415d6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:00.785200 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d5c28709-0821-42c3-b7a9-95adc14415d6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:00.813688 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d5c28709-0821-42c3-b7a9-95adc14415d6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049550 Apr 05 11:56:00.814237 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 368/689] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:00 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:00.943896 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4e1d4938-0064-4086-92a9-9781a5b2c6eb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:00.944525 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4e1d4938-0064-4086-92a9-9781a5b2c6eb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:00.952694 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4e1d4938-0064-4086-92a9-9781a5b2c6eb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:00.953352 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4e1d4938-0064-4086-92a9-9781a5b2c6eb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:00.954478 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4e1d4938-0064-4086-92a9-9781a5b2c6eb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:00.955037 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4e1d4938-0064-4086-92a9-9781a5b2c6eb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:01.050164 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f79108aa-ddbd-4971-93b6-e2bcc0a42fb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:01.050775 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f79108aa-ddbd-4971-93b6-e2bcc0a42fb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:01.056847 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f79108aa-ddbd-4971-93b6-e2bcc0a42fb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:01.057301 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f79108aa-ddbd-4971-93b6-e2bcc0a42fb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:01.058071 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f79108aa-ddbd-4971-93b6-e2bcc0a42fb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:01.058496 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f79108aa-ddbd-4971-93b6-e2bcc0a42fb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:01.098235 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4e1d4938-0064-4086-92a9-9781a5b2c6eb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:01.105749 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4e1d4938-0064-4086-92a9-9781a5b2c6eb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.165748 Apr 05 11:56:01.106334 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 322/690] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:00 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:01.194187 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f79108aa-ddbd-4971-93b6-e2bcc0a42fb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:01.203023 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f79108aa-ddbd-4971-93b6-e2bcc0a42fb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.156992 Apr 05 11:56:01.203590 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 369/691] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:01 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:01.830202 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6d49d7c4-af55-4ff2-b0a8-5fd3a0a559f1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:01.831650 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6d49d7c4-af55-4ff2-b0a8-5fd3a0a559f1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:01.841723 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6d49d7c4-af55-4ff2-b0a8-5fd3a0a559f1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:01.842167 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6d49d7c4-af55-4ff2-b0a8-5fd3a0a559f1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:01.842926 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6d49d7c4-af55-4ff2-b0a8-5fd3a0a559f1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:01.843349 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6d49d7c4-af55-4ff2-b0a8-5fd3a0a559f1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:01.872758 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6d49d7c4-af55-4ff2-b0a8-5fd3a0a559f1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049538 Apr 05 11:56:01.873362 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 323/692] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:01 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:02.122935 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d64c0cb5-9a01-4c73-ad54-21d5f9155bbd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:02.123463 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d64c0cb5-9a01-4c73-ad54-21d5f9155bbd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:02.130238 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d64c0cb5-9a01-4c73-ad54-21d5f9155bbd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:02.130691 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d64c0cb5-9a01-4c73-ad54-21d5f9155bbd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:02.131458 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d64c0cb5-9a01-4c73-ad54-21d5f9155bbd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:02.131890 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d64c0cb5-9a01-4c73-ad54-21d5f9155bbd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:02.221180 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f197fe08-02cc-4960-869f-b5179aaba05b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:02.221784 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f197fe08-02cc-4960-869f-b5179aaba05b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:02.228444 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f197fe08-02cc-4960-869f-b5179aaba05b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:02.228894 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f197fe08-02cc-4960-869f-b5179aaba05b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:02.229654 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f197fe08-02cc-4960-869f-b5179aaba05b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:02.230080 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f197fe08-02cc-4960-869f-b5179aaba05b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:02.267792 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d64c0cb5-9a01-4c73-ad54-21d5f9155bbd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:02.275704 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d64c0cb5-9a01-4c73-ad54-21d5f9155bbd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.156673 Apr 05 11:56:02.276295 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 370/693] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:02 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:02.368053 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f197fe08-02cc-4960-869f-b5179aaba05b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:02.376648 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f197fe08-02cc-4960-869f-b5179aaba05b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.159677 Apr 05 11:56:02.377126 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 324/694] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:02 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:02.889898 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fd53f32f-35b3-43a5-aa82-85bf4cee36f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:02.890916 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fd53f32f-35b3-43a5-aa82-85bf4cee36f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:02.898375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fd53f32f-35b3-43a5-aa82-85bf4cee36f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:02.898874 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fd53f32f-35b3-43a5-aa82-85bf4cee36f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:02.899718 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fd53f32f-35b3-43a5-aa82-85bf4cee36f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:02.900247 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fd53f32f-35b3-43a5-aa82-85bf4cee36f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:02.931793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fd53f32f-35b3-43a5-aa82-85bf4cee36f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048078 Apr 05 11:56:02.932383 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 371/695] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:02 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:03.297231 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1504fcb9-91d4-45dd-8035-2fbd4f6c5079 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:03.298214 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1504fcb9-91d4-45dd-8035-2fbd4f6c5079 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:03.308783 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1504fcb9-91d4-45dd-8035-2fbd4f6c5079 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:03.309501 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1504fcb9-91d4-45dd-8035-2fbd4f6c5079 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:03.310549 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1504fcb9-91d4-45dd-8035-2fbd4f6c5079 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:03.310974 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1504fcb9-91d4-45dd-8035-2fbd4f6c5079 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:03.394281 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bebcf87d-658d-4ab4-9103-973a8b412e70 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:03.395167 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bebcf87d-658d-4ab4-9103-973a8b412e70 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:03.402166 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bebcf87d-658d-4ab4-9103-973a8b412e70 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:03.402541 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bebcf87d-658d-4ab4-9103-973a8b412e70 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:03.403303 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bebcf87d-658d-4ab4-9103-973a8b412e70 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:03.403743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bebcf87d-658d-4ab4-9103-973a8b412e70 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:03.461328 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1504fcb9-91d4-45dd-8035-2fbd4f6c5079 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:03.469133 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1504fcb9-91d4-45dd-8035-2fbd4f6c5079 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.178339 Apr 05 11:56:03.469786 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 325/696] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:03 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:03.537196 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bebcf87d-658d-4ab4-9103-973a8b412e70 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:03.545083 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bebcf87d-658d-4ab4-9103-973a8b412e70 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.154981 Apr 05 11:56:03.545666 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 372/697] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:03 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:03.948248 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-de14246f-7e29-4b6e-9bed-3b51e0bffd7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:03.949739 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-de14246f-7e29-4b6e-9bed-3b51e0bffd7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:03.959817 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-de14246f-7e29-4b6e-9bed-3b51e0bffd7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:03.960622 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-de14246f-7e29-4b6e-9bed-3b51e0bffd7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:03.961881 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-de14246f-7e29-4b6e-9bed-3b51e0bffd7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:03.962600 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-de14246f-7e29-4b6e-9bed-3b51e0bffd7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:03.993577 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-de14246f-7e29-4b6e-9bed-3b51e0bffd7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052130 Apr 05 11:56:03.997771 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 326/698] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:03 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:04.491633 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8690aee6-e656-4963-9cea-059975ff6bda tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:04.492682 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8690aee6-e656-4963-9cea-059975ff6bda tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:04.501218 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8690aee6-e656-4963-9cea-059975ff6bda tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:04.501666 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8690aee6-e656-4963-9cea-059975ff6bda tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:04.502419 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8690aee6-e656-4963-9cea-059975ff6bda tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:04.502847 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8690aee6-e656-4963-9cea-059975ff6bda tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:04.562312 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3b53b3c9-e553-4c24-b92a-f055c1a19232 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:04.562956 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3b53b3c9-e553-4c24-b92a-f055c1a19232 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:04.565960 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:56:04.567097 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Tue Apr 5 11:56:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d (ip 10.222.0.61) !!! Apr 05 11:56:04.570762 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b53b3c9-e553-4c24-b92a-f055c1a19232 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:04.571210 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b53b3c9-e553-4c24-b92a-f055c1a19232 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:04.572809 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b53b3c9-e553-4c24-b92a-f055c1a19232 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:04.572809 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b53b3c9-e553-4c24-b92a-f055c1a19232 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:04.648035 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8690aee6-e656-4963-9cea-059975ff6bda tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:04.655489 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8690aee6-e656-4963-9cea-059975ff6bda tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.170398 Apr 05 11:56:04.656093 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 373/699] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:04 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:04.706916 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3b53b3c9-e553-4c24-b92a-f055c1a19232 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:04.715018 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3b53b3c9-e553-4c24-b92a-f055c1a19232 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.156654 Apr 05 11:56:04.715560 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 327/700] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:04 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:56:05.120953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1b4714ba-e06c-49ee-87d4-d8206f709747 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:05.122482 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1b4714ba-e06c-49ee-87d4-d8206f709747 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:05.130296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1b4714ba-e06c-49ee-87d4-d8206f709747 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:05.130918 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1b4714ba-e06c-49ee-87d4-d8206f709747 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:05.131868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1b4714ba-e06c-49ee-87d4-d8206f709747 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:05.132499 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1b4714ba-e06c-49ee-87d4-d8206f709747 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:05.167840 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1b4714ba-e06c-49ee-87d4-d8206f709747 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.165151 Apr 05 11:56:05.168410 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 374/701] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:05 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:05.678480 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-657314e5-2c2e-4dd7-bd10-b466273fc9d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:05.679346 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-657314e5-2c2e-4dd7-bd10-b466273fc9d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:05.687917 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-657314e5-2c2e-4dd7-bd10-b466273fc9d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:05.688396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-657314e5-2c2e-4dd7-bd10-b466273fc9d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:05.689163 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-657314e5-2c2e-4dd7-bd10-b466273fc9d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:05.689591 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-657314e5-2c2e-4dd7-bd10-b466273fc9d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:05.732243 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a209ac78-fbfc-4778-9a7e-8c311ddd8810 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:05.732813 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a209ac78-fbfc-4778-9a7e-8c311ddd8810 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:05.739664 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a209ac78-fbfc-4778-9a7e-8c311ddd8810 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:05.740121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a209ac78-fbfc-4778-9a7e-8c311ddd8810 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:05.740915 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a209ac78-fbfc-4778-9a7e-8c311ddd8810 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:05.741346 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a209ac78-fbfc-4778-9a7e-8c311ddd8810 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:05.826039 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-657314e5-2c2e-4dd7-bd10-b466273fc9d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:05.833757 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-657314e5-2c2e-4dd7-bd10-b466273fc9d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.163297 Apr 05 11:56:05.834334 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 328/702] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:05 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:05.873485 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a209ac78-fbfc-4778-9a7e-8c311ddd8810 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:05.881938 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a209ac78-fbfc-4778-9a7e-8c311ddd8810 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.153624 Apr 05 11:56:05.882515 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 375/703] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:05 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:06.183834 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fd8890a8-6df4-49e3-812c-a03a763d5c94 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:06.185358 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fd8890a8-6df4-49e3-812c-a03a763d5c94 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:06.195415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd8890a8-6df4-49e3-812c-a03a763d5c94 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:06.196170 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd8890a8-6df4-49e3-812c-a03a763d5c94 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:06.197453 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd8890a8-6df4-49e3-812c-a03a763d5c94 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:06.198158 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd8890a8-6df4-49e3-812c-a03a763d5c94 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:06.229268 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fd8890a8-6df4-49e3-812c-a03a763d5c94 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052109 Apr 05 11:56:06.230054 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 329/704] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:06 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:06.851493 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a21f0427-f1af-4a49-a1a7-0308a38be2df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:06.852104 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a21f0427-f1af-4a49-a1a7-0308a38be2df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:06.858856 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a21f0427-f1af-4a49-a1a7-0308a38be2df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:06.859306 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a21f0427-f1af-4a49-a1a7-0308a38be2df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:06.860063 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a21f0427-f1af-4a49-a1a7-0308a38be2df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:06.860545 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a21f0427-f1af-4a49-a1a7-0308a38be2df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:06.954061 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-02297c24-3fbe-4d36-b189-0e1b459cd867 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:06.954678 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-02297c24-3fbe-4d36-b189-0e1b459cd867 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:06.961449 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02297c24-3fbe-4d36-b189-0e1b459cd867 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:06.961897 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02297c24-3fbe-4d36-b189-0e1b459cd867 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:06.962665 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02297c24-3fbe-4d36-b189-0e1b459cd867 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:06.963101 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02297c24-3fbe-4d36-b189-0e1b459cd867 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:06.998630 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a21f0427-f1af-4a49-a1a7-0308a38be2df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:07.006139 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a21f0427-f1af-4a49-a1a7-0308a38be2df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.158581 Apr 05 11:56:07.006721 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 376/705] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:06 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:07.103982 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-02297c24-3fbe-4d36-b189-0e1b459cd867 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:07.114926 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-02297c24-3fbe-4d36-b189-0e1b459cd867 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.219876 Apr 05 11:56:07.115503 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 330/706] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:06 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:07.243374 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-73fa6105-9952-4454-9b87-2c3cb56edc7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:07.244628 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-73fa6105-9952-4454-9b87-2c3cb56edc7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:07.252518 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-73fa6105-9952-4454-9b87-2c3cb56edc7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:07.253080 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-73fa6105-9952-4454-9b87-2c3cb56edc7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:07.254028 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-73fa6105-9952-4454-9b87-2c3cb56edc7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:07.254626 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-73fa6105-9952-4454-9b87-2c3cb56edc7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:07.285069 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-73fa6105-9952-4454-9b87-2c3cb56edc7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046805 Apr 05 11:56:07.285642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 377/707] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:07 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:08.023076 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3f607942-df2d-4ede-81af-74e03472c485 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:08.023658 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3f607942-df2d-4ede-81af-74e03472c485 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:08.030251 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f607942-df2d-4ede-81af-74e03472c485 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:08.030695 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f607942-df2d-4ede-81af-74e03472c485 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:08.031445 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f607942-df2d-4ede-81af-74e03472c485 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:08.031875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f607942-df2d-4ede-81af-74e03472c485 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:08.132521 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e6dfd97a-1374-4b0a-a66b-8d30851693b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:08.133114 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e6dfd97a-1374-4b0a-a66b-8d30851693b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:08.140015 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6dfd97a-1374-4b0a-a66b-8d30851693b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:08.140512 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6dfd97a-1374-4b0a-a66b-8d30851693b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:08.141283 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6dfd97a-1374-4b0a-a66b-8d30851693b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:08.141714 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6dfd97a-1374-4b0a-a66b-8d30851693b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:08.281272 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e6dfd97a-1374-4b0a-a66b-8d30851693b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:08.289726 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e6dfd97a-1374-4b0a-a66b-8d30851693b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.160919 Apr 05 11:56:08.290323 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 378/708] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:08 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:08.296862 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e0a88640-83ad-4ce2-bda0-342854a8db73 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:08.297795 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e0a88640-83ad-4ce2-bda0-342854a8db73 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:08.304110 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0a88640-83ad-4ce2-bda0-342854a8db73 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:08.304538 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0a88640-83ad-4ce2-bda0-342854a8db73 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:08.305312 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0a88640-83ad-4ce2-bda0-342854a8db73 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:08.305773 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0a88640-83ad-4ce2-bda0-342854a8db73 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:08.335799 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e0a88640-83ad-4ce2-bda0-342854a8db73 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042867 Apr 05 11:56:08.336627 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 379/709] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:08 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 11:56:08.411397 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3f607942-df2d-4ede-81af-74e03472c485 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:08.419082 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3f607942-df2d-4ede-81af-74e03472c485 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.399914 Apr 05 11:56:08.419603 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 331/710] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:08 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:09.311645 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-283073f7-b78f-4aba-985b-b6415895ff6d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:09.312701 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-283073f7-b78f-4aba-985b-b6415895ff6d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:09.322823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-283073f7-b78f-4aba-985b-b6415895ff6d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:09.323573 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-283073f7-b78f-4aba-985b-b6415895ff6d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:09.324907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-283073f7-b78f-4aba-985b-b6415895ff6d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:09.325627 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-283073f7-b78f-4aba-985b-b6415895ff6d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:09.347803 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-03f1b010-5381-44c4-8469-ec2b61f7b0d7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:09.348829 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-03f1b010-5381-44c4-8469-ec2b61f7b0d7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:09.355523 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03f1b010-5381-44c4-8469-ec2b61f7b0d7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:09.355969 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03f1b010-5381-44c4-8469-ec2b61f7b0d7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:09.356766 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03f1b010-5381-44c4-8469-ec2b61f7b0d7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:09.357214 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03f1b010-5381-44c4-8469-ec2b61f7b0d7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:09.387198 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-03f1b010-5381-44c4-8469-ec2b61f7b0d7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043588 Apr 05 11:56:09.387681 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 332/711] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:09 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:09.435707 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6e3b4926-a159-4e8a-aa13-e85080d73807 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:09.436328 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6e3b4926-a159-4e8a-aa13-e85080d73807 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:09.444580 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6e3b4926-a159-4e8a-aa13-e85080d73807 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:09.445059 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6e3b4926-a159-4e8a-aa13-e85080d73807 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:09.445839 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6e3b4926-a159-4e8a-aa13-e85080d73807 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:09.446274 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6e3b4926-a159-4e8a-aa13-e85080d73807 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:09.485223 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-283073f7-b78f-4aba-985b-b6415895ff6d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:09.493296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-283073f7-b78f-4aba-985b-b6415895ff6d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.188390 Apr 05 11:56:09.493877 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 380/712] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:09 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:09.586533 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6e3b4926-a159-4e8a-aa13-e85080d73807 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:09.594144 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6e3b4926-a159-4e8a-aa13-e85080d73807 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.162470 Apr 05 11:56:09.594684 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 333/713] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:09 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:10.403277 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fbac9e38-ba35-48af-a009-a0bedca1d726 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:10.404834 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fbac9e38-ba35-48af-a009-a0bedca1d726 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:10.415410 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fbac9e38-ba35-48af-a009-a0bedca1d726 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:10.416262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fbac9e38-ba35-48af-a009-a0bedca1d726 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:10.417518 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fbac9e38-ba35-48af-a009-a0bedca1d726 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:10.418337 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fbac9e38-ba35-48af-a009-a0bedca1d726 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:10.447855 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fbac9e38-ba35-48af-a009-a0bedca1d726 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051286 Apr 05 11:56:10.448460 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 381/714] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:10 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:10.510929 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ff22cdd9-17b2-4ffe-b2e9-4e0ce7af944a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:10.511620 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ff22cdd9-17b2-4ffe-b2e9-4e0ce7af944a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:10.518573 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff22cdd9-17b2-4ffe-b2e9-4e0ce7af944a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:10.519099 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff22cdd9-17b2-4ffe-b2e9-4e0ce7af944a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:10.519875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff22cdd9-17b2-4ffe-b2e9-4e0ce7af944a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:10.520349 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff22cdd9-17b2-4ffe-b2e9-4e0ce7af944a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:10.611299 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7f65f811-5ff5-438c-ad2b-9c83a8540fa4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:10.612037 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7f65f811-5ff5-438c-ad2b-9c83a8540fa4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:10.620700 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7f65f811-5ff5-438c-ad2b-9c83a8540fa4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:10.621286 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7f65f811-5ff5-438c-ad2b-9c83a8540fa4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:10.622394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7f65f811-5ff5-438c-ad2b-9c83a8540fa4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:10.622830 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7f65f811-5ff5-438c-ad2b-9c83a8540fa4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:10.664912 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ff22cdd9-17b2-4ffe-b2e9-4e0ce7af944a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:10.673209 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ff22cdd9-17b2-4ffe-b2e9-4e0ce7af944a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.166246 Apr 05 11:56:10.673703 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 334/715] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:10 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:10.759410 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7f65f811-5ff5-438c-ad2b-9c83a8540fa4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:10.770863 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7f65f811-5ff5-438c-ad2b-9c83a8540fa4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.163338 Apr 05 11:56:10.771698 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 382/716] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:10 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:11.463987 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-aa7f3011-cada-4fb1-9dd2-b49a1a1906e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:11.465490 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-aa7f3011-cada-4fb1-9dd2-b49a1a1906e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:11.472551 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aa7f3011-cada-4fb1-9dd2-b49a1a1906e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:11.473129 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aa7f3011-cada-4fb1-9dd2-b49a1a1906e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:11.473888 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aa7f3011-cada-4fb1-9dd2-b49a1a1906e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:11.474313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aa7f3011-cada-4fb1-9dd2-b49a1a1906e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:11.502943 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-aa7f3011-cada-4fb1-9dd2-b49a1a1906e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045979 Apr 05 11:56:11.503496 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 335/717] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:11 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:11.694846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ca993be4-a640-4b79-8e78-9ed89a687e11 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:11.695883 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ca993be4-a640-4b79-8e78-9ed89a687e11 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:11.704662 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ca993be4-a640-4b79-8e78-9ed89a687e11 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:11.705106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ca993be4-a640-4b79-8e78-9ed89a687e11 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:11.705872 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ca993be4-a640-4b79-8e78-9ed89a687e11 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:11.706301 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ca993be4-a640-4b79-8e78-9ed89a687e11 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:11.789016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1deee8c9-fe43-4920-a8c5-7a71444c4127 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:11.789569 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1deee8c9-fe43-4920-a8c5-7a71444c4127 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:11.796368 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1deee8c9-fe43-4920-a8c5-7a71444c4127 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:11.796820 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1deee8c9-fe43-4920-a8c5-7a71444c4127 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:11.797616 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1deee8c9-fe43-4920-a8c5-7a71444c4127 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:11.798041 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1deee8c9-fe43-4920-a8c5-7a71444c4127 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:11.844422 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ca993be4-a640-4b79-8e78-9ed89a687e11 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:11.852874 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ca993be4-a640-4b79-8e78-9ed89a687e11 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.164704 Apr 05 11:56:11.853467 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 383/718] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:11 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:11.930172 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1deee8c9-fe43-4920-a8c5-7a71444c4127 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:11.941749 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1deee8c9-fe43-4920-a8c5-7a71444c4127 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.156465 Apr 05 11:56:11.942578 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 336/719] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:11 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:12.516873 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b9ffa9d0-a272-440d-aa78-ca16b07522b0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:12.517767 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b9ffa9d0-a272-440d-aa78-ca16b07522b0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:12.524485 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9ffa9d0-a272-440d-aa78-ca16b07522b0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:12.524948 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9ffa9d0-a272-440d-aa78-ca16b07522b0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:12.525743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9ffa9d0-a272-440d-aa78-ca16b07522b0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:12.526188 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9ffa9d0-a272-440d-aa78-ca16b07522b0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:12.555323 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b9ffa9d0-a272-440d-aa78-ca16b07522b0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043226 Apr 05 11:56:12.555858 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 384/720] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:12 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:12.874132 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e16f47e9-5fc6-4e96-8c94-c3f6a46f44c5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:12.874968 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e16f47e9-5fc6-4e96-8c94-c3f6a46f44c5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:12.885894 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e16f47e9-5fc6-4e96-8c94-c3f6a46f44c5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:12.886639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e16f47e9-5fc6-4e96-8c94-c3f6a46f44c5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:12.887915 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e16f47e9-5fc6-4e96-8c94-c3f6a46f44c5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:12.888670 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e16f47e9-5fc6-4e96-8c94-c3f6a46f44c5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:12.962265 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b79af170-2e9f-4e0d-a50b-3011921a2e68 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:12.962879 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b79af170-2e9f-4e0d-a50b-3011921a2e68 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:12.969494 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b79af170-2e9f-4e0d-a50b-3011921a2e68 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:12.970303 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b79af170-2e9f-4e0d-a50b-3011921a2e68 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:12.971075 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b79af170-2e9f-4e0d-a50b-3011921a2e68 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:12.971501 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b79af170-2e9f-4e0d-a50b-3011921a2e68 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:13.027647 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e16f47e9-5fc6-4e96-8c94-c3f6a46f44c5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:13.035742 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e16f47e9-5fc6-4e96-8c94-c3f6a46f44c5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.168351 Apr 05 11:56:13.036364 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 337/721] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:12 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:13.106976 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b79af170-2e9f-4e0d-a50b-3011921a2e68 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:13.115077 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b79af170-2e9f-4e0d-a50b-3011921a2e68 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.156786 Apr 05 11:56:13.115657 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 385/722] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:12 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:56:13.573237 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9e2a3351-10ae-48a7-86d8-15c32076b85c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:13.574632 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9e2a3351-10ae-48a7-86d8-15c32076b85c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:13.584976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9e2a3351-10ae-48a7-86d8-15c32076b85c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:13.585761 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9e2a3351-10ae-48a7-86d8-15c32076b85c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:13.587026 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9e2a3351-10ae-48a7-86d8-15c32076b85c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:13.587749 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9e2a3351-10ae-48a7-86d8-15c32076b85c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:13.619188 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9e2a3351-10ae-48a7-86d8-15c32076b85c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052855 Apr 05 11:56:13.619748 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 338/723] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:13 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:14.057296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3c96ff8c-dac9-4cc3-9474-26f413acdb5f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:14.058269 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3c96ff8c-dac9-4cc3-9474-26f413acdb5f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:14.069077 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3c96ff8c-dac9-4cc3-9474-26f413acdb5f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:14.069820 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3c96ff8c-dac9-4cc3-9474-26f413acdb5f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:14.071068 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3c96ff8c-dac9-4cc3-9474-26f413acdb5f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:14.071786 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3c96ff8c-dac9-4cc3-9474-26f413acdb5f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:14.132554 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-79012d63-f0b8-4927-a003-edc2c837759e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:14.133250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-79012d63-f0b8-4927-a003-edc2c837759e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:14.140946 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79012d63-f0b8-4927-a003-edc2c837759e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:14.141398 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79012d63-f0b8-4927-a003-edc2c837759e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:14.142169 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79012d63-f0b8-4927-a003-edc2c837759e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:14.142605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79012d63-f0b8-4927-a003-edc2c837759e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:14.211468 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3c96ff8c-dac9-4cc3-9474-26f413acdb5f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:14.220134 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3c96ff8c-dac9-4cc3-9474-26f413acdb5f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.168905 Apr 05 11:56:14.220728 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 386/724] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:14 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:14.282366 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-79012d63-f0b8-4927-a003-edc2c837759e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:14.290065 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-79012d63-f0b8-4927-a003-edc2c837759e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.161628 Apr 05 11:56:14.290977 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 339/725] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:14 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:14.636480 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c5e60f02-47dc-4b3e-a5dc-49aba97b5464 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:14.637846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c5e60f02-47dc-4b3e-a5dc-49aba97b5464 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:14.644542 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c5e60f02-47dc-4b3e-a5dc-49aba97b5464 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:14.644993 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c5e60f02-47dc-4b3e-a5dc-49aba97b5464 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:14.645752 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c5e60f02-47dc-4b3e-a5dc-49aba97b5464 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:14.646189 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c5e60f02-47dc-4b3e-a5dc-49aba97b5464 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:14.675124 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c5e60f02-47dc-4b3e-a5dc-49aba97b5464 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045585 Apr 05 11:56:14.675666 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 387/726] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:14 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:15.241114 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-85f70267-c349-4728-9d25-519baee9e9a2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:15.242066 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-85f70267-c349-4728-9d25-519baee9e9a2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:15.251285 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85f70267-c349-4728-9d25-519baee9e9a2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:15.251739 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85f70267-c349-4728-9d25-519baee9e9a2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:15.252545 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85f70267-c349-4728-9d25-519baee9e9a2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:15.252975 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85f70267-c349-4728-9d25-519baee9e9a2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:15.306893 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-34d803ec-49d4-4055-950e-d9daa39511c4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:15.307513 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-34d803ec-49d4-4055-950e-d9daa39511c4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:15.314014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34d803ec-49d4-4055-950e-d9daa39511c4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:15.314465 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34d803ec-49d4-4055-950e-d9daa39511c4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:15.315200 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34d803ec-49d4-4055-950e-d9daa39511c4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:15.315627 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34d803ec-49d4-4055-950e-d9daa39511c4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:15.388246 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-85f70267-c349-4728-9d25-519baee9e9a2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:15.396330 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-85f70267-c349-4728-9d25-519baee9e9a2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.161834 Apr 05 11:56:15.396916 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 340/727] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:15 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:15.451711 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-34d803ec-49d4-4055-950e-d9daa39511c4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:15.459351 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-34d803ec-49d4-4055-950e-d9daa39511c4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.156410 Apr 05 11:56:15.459929 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 388/728] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:15 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:56:15.690711 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4c066e25-737d-4556-aa4a-276abdfb776a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:15.692228 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4c066e25-737d-4556-aa4a-276abdfb776a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:15.702157 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c066e25-737d-4556-aa4a-276abdfb776a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:15.702596 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c066e25-737d-4556-aa4a-276abdfb776a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:15.703352 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c066e25-737d-4556-aa4a-276abdfb776a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:15.703781 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c066e25-737d-4556-aa4a-276abdfb776a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:15.732805 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4c066e25-737d-4556-aa4a-276abdfb776a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049035 Apr 05 11:56:15.733358 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 341/729] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:15 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:16.414537 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-22a3eb97-b6dd-461c-82d9-966b6852cbc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:16.415150 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-22a3eb97-b6dd-461c-82d9-966b6852cbc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:16.422625 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-22a3eb97-b6dd-461c-82d9-966b6852cbc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:16.423075 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-22a3eb97-b6dd-461c-82d9-966b6852cbc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:16.423846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-22a3eb97-b6dd-461c-82d9-966b6852cbc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:16.424383 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-22a3eb97-b6dd-461c-82d9-966b6852cbc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:16.534208 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a44c1af7-a55d-43cb-99e3-c3bf70e59b03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:16.534821 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a44c1af7-a55d-43cb-99e3-c3bf70e59b03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:16.540673 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a44c1af7-a55d-43cb-99e3-c3bf70e59b03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:16.541119 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a44c1af7-a55d-43cb-99e3-c3bf70e59b03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:16.541882 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a44c1af7-a55d-43cb-99e3-c3bf70e59b03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:16.542317 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a44c1af7-a55d-43cb-99e3-c3bf70e59b03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:16.564307 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-22a3eb97-b6dd-461c-82d9-966b6852cbc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:16.572002 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-22a3eb97-b6dd-461c-82d9-966b6852cbc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.161360 Apr 05 11:56:16.572597 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 389/730] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:16 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:16.679329 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a44c1af7-a55d-43cb-99e3-c3bf70e59b03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:16.687244 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a44c1af7-a55d-43cb-99e3-c3bf70e59b03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.214300 Apr 05 11:56:16.687792 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 342/731] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:16 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:56:16.745170 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-208b743f-5089-42ec-8e93-69d31bf875a5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:16.746189 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-208b743f-5089-42ec-8e93-69d31bf875a5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:16.752656 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-208b743f-5089-42ec-8e93-69d31bf875a5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:16.753093 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-208b743f-5089-42ec-8e93-69d31bf875a5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:16.753875 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-208b743f-5089-42ec-8e93-69d31bf875a5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:16.754296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-208b743f-5089-42ec-8e93-69d31bf875a5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:16.782862 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-208b743f-5089-42ec-8e93-69d31bf875a5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041790 Apr 05 11:56:16.783412 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 390/732] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:16 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:17.055227 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:56:17.055527 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Tue Apr 5 11:56:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:56:17.591740 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-df009dda-72a7-4059-816c-a2aef063b788 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:17.592369 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-df009dda-72a7-4059-816c-a2aef063b788 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:17.601422 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-df009dda-72a7-4059-816c-a2aef063b788 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:17.602060 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-df009dda-72a7-4059-816c-a2aef063b788 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:17.602988 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-df009dda-72a7-4059-816c-a2aef063b788 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:17.603416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-df009dda-72a7-4059-816c-a2aef063b788 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:17.704918 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-822222db-15ed-4692-b5ed-1ede67b8b3ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:17.705476 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-822222db-15ed-4692-b5ed-1ede67b8b3ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:17.712781 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-822222db-15ed-4692-b5ed-1ede67b8b3ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:17.713232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-822222db-15ed-4692-b5ed-1ede67b8b3ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:17.714031 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-822222db-15ed-4692-b5ed-1ede67b8b3ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:17.714462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-822222db-15ed-4692-b5ed-1ede67b8b3ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:17.739015 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-df009dda-72a7-4059-816c-a2aef063b788 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:17.747008 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-df009dda-72a7-4059-816c-a2aef063b788 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.161645 Apr 05 11:56:17.747577 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 343/733] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:17 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:17.796520 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-677495ec-fb09-4cdd-9cea-70d9e6ed72bc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:17.796984 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-677495ec-fb09-4cdd-9cea-70d9e6ed72bc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:17.803406 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-677495ec-fb09-4cdd-9cea-70d9e6ed72bc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:17.803848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-677495ec-fb09-4cdd-9cea-70d9e6ed72bc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:17.804645 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-677495ec-fb09-4cdd-9cea-70d9e6ed72bc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:17.805070 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-677495ec-fb09-4cdd-9cea-70d9e6ed72bc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:17.833953 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-677495ec-fb09-4cdd-9cea-70d9e6ed72bc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042019 Apr 05 11:56:17.834529 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 344/734] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:17 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:17.847384 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-822222db-15ed-4692-b5ed-1ede67b8b3ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:17.857919 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-822222db-15ed-4692-b5ed-1ede67b8b3ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.156757 Apr 05 11:56:17.858479 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 391/735] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:17 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:18.767871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-08798d1a-2ec8-4c65-8852-e61a664f1ba4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:18.768971 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-08798d1a-2ec8-4c65-8852-e61a664f1ba4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:18.779481 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-08798d1a-2ec8-4c65-8852-e61a664f1ba4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:18.780175 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-08798d1a-2ec8-4c65-8852-e61a664f1ba4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:18.780952 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-08798d1a-2ec8-4c65-8852-e61a664f1ba4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:18.781409 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-08798d1a-2ec8-4c65-8852-e61a664f1ba4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:18.846579 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ad7397c5-0895-4d81-86f6-46d6397a28fc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:18.847501 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ad7397c5-0895-4d81-86f6-46d6397a28fc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:18.854170 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ad7397c5-0895-4d81-86f6-46d6397a28fc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:18.854623 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ad7397c5-0895-4d81-86f6-46d6397a28fc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:18.855398 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ad7397c5-0895-4d81-86f6-46d6397a28fc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:18.855836 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ad7397c5-0895-4d81-86f6-46d6397a28fc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:18.885836 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ad7397c5-0895-4d81-86f6-46d6397a28fc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043664 Apr 05 11:56:18.886416 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 392/736] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:18 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:18.890823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e6fe8f9b-ce9f-41bf-ab3f-9618a9cc5f12 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:18.891422 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e6fe8f9b-ce9f-41bf-ab3f-9618a9cc5f12 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:18.897392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6fe8f9b-ce9f-41bf-ab3f-9618a9cc5f12 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:18.897849 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6fe8f9b-ce9f-41bf-ab3f-9618a9cc5f12 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:18.898618 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6fe8f9b-ce9f-41bf-ab3f-9618a9cc5f12 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:18.899052 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6fe8f9b-ce9f-41bf-ab3f-9618a9cc5f12 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:18.919852 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-08798d1a-2ec8-4c65-8852-e61a664f1ba4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:18.930010 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-08798d1a-2ec8-4c65-8852-e61a664f1ba4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.168480 Apr 05 11:56:18.931054 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 345/737] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:18 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:19.045192 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e6fe8f9b-ce9f-41bf-ab3f-9618a9cc5f12 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:19.052578 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e6fe8f9b-ce9f-41bf-ab3f-9618a9cc5f12 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1680 microversion: 2.1 time: 0.165249 Apr 05 11:56:19.053142 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 393/738] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:18 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:19.900411 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a7ac1de6-207d-41a2-aa1d-744f429038af tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:19.901380 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a7ac1de6-207d-41a2-aa1d-744f429038af tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:19.907736 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a7ac1de6-207d-41a2-aa1d-744f429038af tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:19.908232 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a7ac1de6-207d-41a2-aa1d-744f429038af tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:19.909336 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a7ac1de6-207d-41a2-aa1d-744f429038af tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:19.909774 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a7ac1de6-207d-41a2-aa1d-744f429038af tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:19.941308 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a7ac1de6-207d-41a2-aa1d-744f429038af tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047400 Apr 05 11:56:19.942918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 346/739] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:19 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:19.947575 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-acd0b790-b111-4af4-8caf-b36fe125b52d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:19.947933 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-acd0b790-b111-4af4-8caf-b36fe125b52d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:19.956248 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-acd0b790-b111-4af4-8caf-b36fe125b52d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:19.956807 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-acd0b790-b111-4af4-8caf-b36fe125b52d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:19.957652 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-acd0b790-b111-4af4-8caf-b36fe125b52d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:19.958162 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-acd0b790-b111-4af4-8caf-b36fe125b52d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:20.070115 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d66d3c5f-0a6f-4c34-a5ad-cca567ab1eaa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:20.071515 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d66d3c5f-0a6f-4c34-a5ad-cca567ab1eaa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:20.077977 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d66d3c5f-0a6f-4c34-a5ad-cca567ab1eaa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:20.078529 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d66d3c5f-0a6f-4c34-a5ad-cca567ab1eaa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:20.079516 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d66d3c5f-0a6f-4c34-a5ad-cca567ab1eaa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:20.080216 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d66d3c5f-0a6f-4c34-a5ad-cca567ab1eaa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:20.146107 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d66d3c5f-0a6f-4c34-a5ad-cca567ab1eaa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:20.155813 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d66d3c5f-0a6f-4c34-a5ad-cca567ab1eaa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1613 microversion: 2.1 time: 0.089633 Apr 05 11:56:20.156981 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 347/740] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:20 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:20.217249 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-acd0b790-b111-4af4-8caf-b36fe125b52d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:20.226134 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-acd0b790-b111-4af4-8caf-b36fe125b52d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.282770 Apr 05 11:56:20.227030 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 394/741] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:19 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:20.352213 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-e9050520-b69f-4790-9fb5-b548b29459cf req-41c5b60c-86e8-4ed4-b403-f4e852a8492f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26584178-5dc8-4126-93eb-1126296c8e93", "name": "network-vif-deleted", "tag": "e2222d8b-4df5-4df4-8bd2-7f837c08f6aa"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:56:20.360104 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-e9050520-b69f-4790-9fb5-b548b29459cf req-41c5b60c-86e8-4ed4-b403-f4e852a8492f service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:20.360566 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-e9050520-b69f-4790-9fb5-b548b29459cf req-41c5b60c-86e8-4ed4-b403-f4e852a8492f service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:20.371393 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-e9050520-b69f-4790-9fb5-b548b29459cf req-41c5b60c-86e8-4ed4-b403-f4e852a8492f service nova] Creating event network-vif-deleted:e2222d8b-4df5-4df4-8bd2-7f837c08f6aa for instance 26584178-5dc8-4126-93eb-1126296c8e93 on hv-cinder-82956 Apr 05 11:56:20.376624 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-e9050520-b69f-4790-9fb5-b548b29459cf req-41c5b60c-86e8-4ed4-b403-f4e852a8492f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086632 Apr 05 11:56:20.377231 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 348/742] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:20.954135 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-07b1ac4b-2107-4b98-acc6-43aa695bbab5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:20.955076 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-07b1ac4b-2107-4b98-acc6-43aa695bbab5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:20.961577 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-07b1ac4b-2107-4b98-acc6-43aa695bbab5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:20.962030 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-07b1ac4b-2107-4b98-acc6-43aa695bbab5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:20.962775 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-07b1ac4b-2107-4b98-acc6-43aa695bbab5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:20.963411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-07b1ac4b-2107-4b98-acc6-43aa695bbab5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:20.994776 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-07b1ac4b-2107-4b98-acc6-43aa695bbab5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044726 Apr 05 11:56:20.995332 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 395/743] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:20 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:21.181912 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-efc245d0-8fe5-43a5-b874-badedeb780ab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:21.183250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-efc245d0-8fe5-43a5-b874-badedeb780ab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:21.193750 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-efc245d0-8fe5-43a5-b874-badedeb780ab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:21.194196 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-efc245d0-8fe5-43a5-b874-badedeb780ab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:21.195537 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-efc245d0-8fe5-43a5-b874-badedeb780ab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:21.196560 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-efc245d0-8fe5-43a5-b874-badedeb780ab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:21.235462 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-efc245d0-8fe5-43a5-b874-badedeb780ab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:21.236235 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-efc245d0-8fe5-43a5-b874-badedeb780ab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:21.238032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.objects.instance [None req-efc245d0-8fe5-43a5-b874-badedeb780ab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lazy-loading 'fault' on Instance uuid 26584178-5dc8-4126-93eb-1126296c8e93 {{(pid=123357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:56:21.244115 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f0d70fdd-a2d7-4b20-b595-9d6fb2fae785 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:21.244804 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f0d70fdd-a2d7-4b20-b595-9d6fb2fae785 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:21.256919 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f0d70fdd-a2d7-4b20-b595-9d6fb2fae785 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:21.258393 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f0d70fdd-a2d7-4b20-b595-9d6fb2fae785 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:21.259267 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f0d70fdd-a2d7-4b20-b595-9d6fb2fae785 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:21.261030 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f0d70fdd-a2d7-4b20-b595-9d6fb2fae785 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:21.297757 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-efc245d0-8fe5-43a5-b874-badedeb780ab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:21.310014 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-efc245d0-8fe5-43a5-b874-badedeb780ab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 200 len: 1331 microversion: 2.1 time: 0.139944 Apr 05 11:56:21.311590 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 349/744] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:21 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 1331 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:21.452614 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f0d70fdd-a2d7-4b20-b595-9d6fb2fae785 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:21.460726 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f0d70fdd-a2d7-4b20-b595-9d6fb2fae785 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.221700 Apr 05 11:56:21.461309 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 396/745] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:21 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:56:22.006948 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-37b95235-da33-49e3-b23f-ba716594e280 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:22.008017 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-37b95235-da33-49e3-b23f-ba716594e280 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:22.014357 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37b95235-da33-49e3-b23f-ba716594e280 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:22.014833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37b95235-da33-49e3-b23f-ba716594e280 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:22.015592 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37b95235-da33-49e3-b23f-ba716594e280 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:22.016012 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37b95235-da33-49e3-b23f-ba716594e280 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:22.045506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-37b95235-da33-49e3-b23f-ba716594e280 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042623 Apr 05 11:56:22.046058 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 350/746] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:22 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:22.327990 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a64b01c9-2a38-4607-b3fa-d261628c41db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:22.328640 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a64b01c9-2a38-4607-b3fa-d261628c41db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:22.335353 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a64b01c9-2a38-4607-b3fa-d261628c41db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:22.335894 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a64b01c9-2a38-4607-b3fa-d261628c41db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:22.336776 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a64b01c9-2a38-4607-b3fa-d261628c41db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:22.337453 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a64b01c9-2a38-4607-b3fa-d261628c41db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:22.352226 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.wsgi [None req-a64b01c9-2a38-4607-b3fa-d261628c41db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] HTTP exception thrown: Instance 26584178-5dc8-4126-93eb-1126296c8e93 could not be found. Apr 05 11:56:22.352882 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a64b01c9-2a38-4607-b3fa-d261628c41db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Returning 404 to user: Instance 26584178-5dc8-4126-93eb-1126296c8e93 could not be found. {{(pid=123358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:56:22.353691 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a64b01c9-2a38-4607-b3fa-d261628c41db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 404 len: 111 microversion: 2.1 time: 0.029848 Apr 05 11:56:22.354249 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 397/747] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:22 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:56:22.362975 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b9e108bc-2998-411a-ab61-39967f989afa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '.version_select at 0x7f1620216310>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:22.386641 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b9e108bc-2998-411a-ab61-39967f989afa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320201504" status: 202 len: 0 microversion: 2.1 time: 0.027443 Apr 05 11:56:22.387324 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 351/748] 10.222.0.61 () {58 vars in 1220 bytes} [Tue Apr 5 11:56:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320201504 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:56:22.478626 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-842321d3-35f1-4f3b-bd8c-6cc2ff97ee9f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:22.479242 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-842321d3-35f1-4f3b-bd8c-6cc2ff97ee9f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:22.485480 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-842321d3-35f1-4f3b-bd8c-6cc2ff97ee9f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:22.485922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-842321d3-35f1-4f3b-bd8c-6cc2ff97ee9f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:22.486707 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-842321d3-35f1-4f3b-bd8c-6cc2ff97ee9f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:22.487125 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-842321d3-35f1-4f3b-bd8c-6cc2ff97ee9f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:22.706985 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-842321d3-35f1-4f3b-bd8c-6cc2ff97ee9f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:22.717418 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-842321d3-35f1-4f3b-bd8c-6cc2ff97ee9f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.242387 Apr 05 11:56:22.717997 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 398/749] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:22 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:23.057776 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6d9ac2f1-4b58-40a5-ae9d-626d5b1eabf0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:23.058627 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6d9ac2f1-4b58-40a5-ae9d-626d5b1eabf0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:23.065472 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6d9ac2f1-4b58-40a5-ae9d-626d5b1eabf0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:23.065921 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6d9ac2f1-4b58-40a5-ae9d-626d5b1eabf0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:23.066726 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6d9ac2f1-4b58-40a5-ae9d-626d5b1eabf0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:23.067150 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6d9ac2f1-4b58-40a5-ae9d-626d5b1eabf0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:23.097014 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6d9ac2f1-4b58-40a5-ae9d-626d5b1eabf0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043344 Apr 05 11:56:23.097588 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 352/750] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:23 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:23.139905 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-813e1b24-3165-48b2-9d84-bac6bbea2da0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:23.140425 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-813e1b24-3165-48b2-9d84-bac6bbea2da0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:23.146489 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-813e1b24-3165-48b2-9d84-bac6bbea2da0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:23.146932 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-813e1b24-3165-48b2-9d84-bac6bbea2da0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:23.147656 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-813e1b24-3165-48b2-9d84-bac6bbea2da0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:23.148098 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-813e1b24-3165-48b2-9d84-bac6bbea2da0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:23.273743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.objects.instance [None req-813e1b24-3165-48b2-9d84-bac6bbea2da0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lazy-loading 'services' on Instance uuid f8d507e3-5f14-419a-a3cd-31f36496b2d8 {{(pid=123358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:56:23.389243 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-813e1b24-3165-48b2-9d84-bac6bbea2da0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments/b56dc4a2-608f-4b3e-8481-37d73cee6b2f" status: 202 len: 0 microversion: 2.1 time: 0.253291 Apr 05 11:56:23.390169 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 399/751] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Apr 5 11:56:23 2022] DELETE /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments/b56dc4a2-608f-4b3e-8481-37d73cee6b2f => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:56:23.399809 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b0223efc-9a43-418b-b373-fbd01ea7ced2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:23.401423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b0223efc-9a43-418b-b373-fbd01ea7ced2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:23.409800 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b0223efc-9a43-418b-b373-fbd01ea7ced2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:23.410576 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b0223efc-9a43-418b-b373-fbd01ea7ced2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:23.411543 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b0223efc-9a43-418b-b373-fbd01ea7ced2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:23.412448 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b0223efc-9a43-418b-b373-fbd01ea7ced2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:23.449223 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b0223efc-9a43-418b-b373-fbd01ea7ced2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054393 Apr 05 11:56:23.449815 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 353/752] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:23 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:56:23.735599 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f4869978-4897-473e-90b6-eaf20d7a9f0a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:23.736332 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f4869978-4897-473e-90b6-eaf20d7a9f0a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:23.743133 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f4869978-4897-473e-90b6-eaf20d7a9f0a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:23.743585 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f4869978-4897-473e-90b6-eaf20d7a9f0a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:23.744395 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f4869978-4897-473e-90b6-eaf20d7a9f0a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:23.744832 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f4869978-4897-473e-90b6-eaf20d7a9f0a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:23.884471 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f4869978-4897-473e-90b6-eaf20d7a9f0a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:23.892504 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f4869978-4897-473e-90b6-eaf20d7a9f0a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1715 microversion: 2.1 time: 0.161224 Apr 05 11:56:23.893062 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 400/753] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:23 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1715 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:23.947496 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-65f4f577-752d-4514-8f37-3e0adf63da04 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:23.947994 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-65f4f577-752d-4514-8f37-3e0adf63da04 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:23.954198 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-65f4f577-752d-4514-8f37-3e0adf63da04 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:23.954639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-65f4f577-752d-4514-8f37-3e0adf63da04 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:23.955389 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-65f4f577-752d-4514-8f37-3e0adf63da04 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:23.955810 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-65f4f577-752d-4514-8f37-3e0adf63da04 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:24.039558 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-65f4f577-752d-4514-8f37-3e0adf63da04 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] HTTP exception thrown: Cannot 'detach_volume' instance 99328563-d12a-4ef5-952b-c6c86929a22d while it is in vm_state rescued Apr 05 11:56:24.040198 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-65f4f577-752d-4514-8f37-3e0adf63da04 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Returning 409 to user: Cannot 'detach_volume' instance 99328563-d12a-4ef5-952b-c6c86929a22d while it is in vm_state rescued {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:56:24.041034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-65f4f577-752d-4514-8f37-3e0adf63da04 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "DELETE /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments/bf75b0b8-0993-4b63-83c7-baf577a39884" status: 409 len: 152 microversion: 2.1 time: 0.097579 Apr 05 11:56:24.041588 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 354/754] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Apr 5 11:56:23 2022] DELETE /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments/bf75b0b8-0993-4b63-83c7-baf577a39884 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 05 11:56:24.050244 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7a44cd9e-3f69-4920-b1dd-4d8226c3aa4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:56:24.050775 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7a44cd9e-3f69-4920-b1dd-4d8226c3aa4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:24.056944 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a44cd9e-3f69-4920-b1dd-4d8226c3aa4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:24.057390 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a44cd9e-3f69-4920-b1dd-4d8226c3aa4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:24.058444 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a44cd9e-3f69-4920-b1dd-4d8226c3aa4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:24.058884 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a44cd9e-3f69-4920-b1dd-4d8226c3aa4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:24.109432 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3811cb1b-dd0e-4e81-9850-1a9f28c35c96 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:24.110372 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3811cb1b-dd0e-4e81-9850-1a9f28c35c96 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:24.123943 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3811cb1b-dd0e-4e81-9850-1a9f28c35c96 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:24.123943 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3811cb1b-dd0e-4e81-9850-1a9f28c35c96 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:24.123943 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3811cb1b-dd0e-4e81-9850-1a9f28c35c96 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:24.123943 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3811cb1b-dd0e-4e81-9850-1a9f28c35c96 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:24.152971 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3811cb1b-dd0e-4e81-9850-1a9f28c35c96 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047570 Apr 05 11:56:24.153559 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 355/755] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:24 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:24.224768 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:56:24.230129 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Tue Apr 5 11:56:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/action (ip 10.222.0.61) !!! Apr 05 11:56:24.294388 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7a44cd9e-3f69-4920-b1dd-4d8226c3aa4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "POST /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/action" status: 202 len: 0 microversion: 2.1 time: 0.247913 Apr 05 11:56:24.295176 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 401/756] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Apr 5 11:56:24 2022] POST /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:56:24.305270 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-96d36d11-9cd7-4ce1-ab10-c98ff4103886 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:24.305893 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-96d36d11-9cd7-4ce1-ab10-c98ff4103886 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:24.312358 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-96d36d11-9cd7-4ce1-ab10-c98ff4103886 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:24.312850 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-96d36d11-9cd7-4ce1-ab10-c98ff4103886 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:24.313700 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-96d36d11-9cd7-4ce1-ab10-c98ff4103886 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:24.314176 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-96d36d11-9cd7-4ce1-ab10-c98ff4103886 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:24.458744 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-96d36d11-9cd7-4ce1-ab10-c98ff4103886 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:24.462122 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-58253a6a-3a35-4f10-b20c-ab5f711519ce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:24.463197 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-58253a6a-3a35-4f10-b20c-ab5f711519ce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:24.469710 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-58253a6a-3a35-4f10-b20c-ab5f711519ce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:24.470408 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-58253a6a-3a35-4f10-b20c-ab5f711519ce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:24.471399 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-58253a6a-3a35-4f10-b20c-ab5f711519ce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:24.472038 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-58253a6a-3a35-4f10-b20c-ab5f711519ce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:24.473709 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-96d36d11-9cd7-4ce1-ab10-c98ff4103886 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1723 microversion: 2.1 time: 0.172350 Apr 05 11:56:24.484402 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 356/757] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:24 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:24.504482 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-58253a6a-3a35-4f10-b20c-ab5f711519ce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047259 Apr 05 11:56:24.505296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 402/758] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:24 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:25.169388 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b6541434-3b0e-48db-b585-225dd3795d22 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:25.170641 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b6541434-3b0e-48db-b585-225dd3795d22 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:25.177381 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b6541434-3b0e-48db-b585-225dd3795d22 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:25.177818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b6541434-3b0e-48db-b585-225dd3795d22 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:25.178570 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b6541434-3b0e-48db-b585-225dd3795d22 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:25.178998 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b6541434-3b0e-48db-b585-225dd3795d22 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:25.207479 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b6541434-3b0e-48db-b585-225dd3795d22 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044975 Apr 05 11:56:25.208024 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 357/759] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:25 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:25.492186 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0a59db6a-496b-4e9e-ba66-f70a68a49caa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:25.492847 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0a59db6a-496b-4e9e-ba66-f70a68a49caa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:25.500066 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0a59db6a-496b-4e9e-ba66-f70a68a49caa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:25.500957 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0a59db6a-496b-4e9e-ba66-f70a68a49caa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:25.501282 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0a59db6a-496b-4e9e-ba66-f70a68a49caa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:25.501713 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0a59db6a-496b-4e9e-ba66-f70a68a49caa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:25.515747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a70484f4-e92d-46ab-8c53-04ce66fac506 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:25.517414 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a70484f4-e92d-46ab-8c53-04ce66fac506 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:25.523791 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a70484f4-e92d-46ab-8c53-04ce66fac506 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:25.524298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a70484f4-e92d-46ab-8c53-04ce66fac506 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:25.525206 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a70484f4-e92d-46ab-8c53-04ce66fac506 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:25.525634 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a70484f4-e92d-46ab-8c53-04ce66fac506 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:25.556783 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a70484f4-e92d-46ab-8c53-04ce66fac506 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044948 Apr 05 11:56:25.557383 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 358/760] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:25 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:56:25.637433 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0a59db6a-496b-4e9e-ba66-f70a68a49caa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:25.646031 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0a59db6a-496b-4e9e-ba66-f70a68a49caa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1723 microversion: 2.1 time: 0.158170 Apr 05 11:56:25.646608 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 403/761] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:25 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:26.224337 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c0b44058-3f47-4e06-95a8-b7c37fc87457 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:26.225799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c0b44058-3f47-4e06-95a8-b7c37fc87457 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:26.236567 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0b44058-3f47-4e06-95a8-b7c37fc87457 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:26.237307 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0b44058-3f47-4e06-95a8-b7c37fc87457 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:26.238535 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0b44058-3f47-4e06-95a8-b7c37fc87457 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:26.239242 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0b44058-3f47-4e06-95a8-b7c37fc87457 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:26.271886 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c0b44058-3f47-4e06-95a8-b7c37fc87457 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054876 Apr 05 11:56:26.272483 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 359/762] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:26 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:26.568783 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-86e8ea09-1bee-40b4-8fa7-fee91e1e609f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:26.569794 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-86e8ea09-1bee-40b4-8fa7-fee91e1e609f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:26.576711 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-86e8ea09-1bee-40b4-8fa7-fee91e1e609f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:26.577152 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-86e8ea09-1bee-40b4-8fa7-fee91e1e609f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:26.577905 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-86e8ea09-1bee-40b4-8fa7-fee91e1e609f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:26.578333 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-86e8ea09-1bee-40b4-8fa7-fee91e1e609f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:26.606556 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-86e8ea09-1bee-40b4-8fa7-fee91e1e609f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042019 Apr 05 11:56:26.607127 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 404/763] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:26 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:26.663825 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-75633210-ac8f-4d46-9398-21bb7b64190f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:26.664452 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-75633210-ac8f-4d46-9398-21bb7b64190f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:26.670833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-75633210-ac8f-4d46-9398-21bb7b64190f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:26.671305 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-75633210-ac8f-4d46-9398-21bb7b64190f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:26.672054 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-75633210-ac8f-4d46-9398-21bb7b64190f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:26.672512 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-75633210-ac8f-4d46-9398-21bb7b64190f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:26.807763 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-75633210-ac8f-4d46-9398-21bb7b64190f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:26.817811 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-75633210-ac8f-4d46-9398-21bb7b64190f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1723 microversion: 2.1 time: 0.157565 Apr 05 11:56:26.818635 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 360/764] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:26 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:27.289864 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2b4d4de0-d66f-4dca-a9a1-4e216198fba6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:27.291436 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2b4d4de0-d66f-4dca-a9a1-4e216198fba6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:27.301639 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2b4d4de0-d66f-4dca-a9a1-4e216198fba6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:27.302395 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2b4d4de0-d66f-4dca-a9a1-4e216198fba6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:27.303718 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2b4d4de0-d66f-4dca-a9a1-4e216198fba6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:27.304520 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2b4d4de0-d66f-4dca-a9a1-4e216198fba6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:27.335678 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2b4d4de0-d66f-4dca-a9a1-4e216198fba6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052592 Apr 05 11:56:27.336261 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 405/765] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:27 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:27.620498 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-156cc718-aedd-4433-9063-28a5d85fc0ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:27.621770 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-156cc718-aedd-4433-9063-28a5d85fc0ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:27.630549 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-156cc718-aedd-4433-9063-28a5d85fc0ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:27.631179 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-156cc718-aedd-4433-9063-28a5d85fc0ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:27.632280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-156cc718-aedd-4433-9063-28a5d85fc0ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:27.632885 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-156cc718-aedd-4433-9063-28a5d85fc0ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:27.663161 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-156cc718-aedd-4433-9063-28a5d85fc0ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048215 Apr 05 11:56:27.663718 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 361/766] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:27 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:27.838370 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e6cfb5b5-a6f4-4623-b675-27fbf554d96e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:27.838956 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e6cfb5b5-a6f4-4623-b675-27fbf554d96e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:27.846034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6cfb5b5-a6f4-4623-b675-27fbf554d96e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:27.846476 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6cfb5b5-a6f4-4623-b675-27fbf554d96e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:27.847235 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6cfb5b5-a6f4-4623-b675-27fbf554d96e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:27.847660 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6cfb5b5-a6f4-4623-b675-27fbf554d96e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:27.987768 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e6cfb5b5-a6f4-4623-b675-27fbf554d96e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:56:27.995678 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e6cfb5b5-a6f4-4623-b675-27fbf554d96e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1729 microversion: 2.1 time: 0.161152 Apr 05 11:56:27.996271 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 406/767] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 11:56:27 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:56:28.014065 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e4d55779-5182-42b1-a567-47ef148e5012 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:28.014645 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e4d55779-5182-42b1-a567-47ef148e5012 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:28.023913 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e4d55779-5182-42b1-a567-47ef148e5012 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:28.024522 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e4d55779-5182-42b1-a567-47ef148e5012 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:28.025669 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e4d55779-5182-42b1-a567-47ef148e5012 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:28.026278 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e4d55779-5182-42b1-a567-47ef148e5012 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:28.117334 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e4d55779-5182-42b1-a567-47ef148e5012 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108247 Apr 05 11:56:28.117952 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 362/768] 10.222.0.61 () {58 vars in 1274 bytes} [Tue Apr 5 11:56:28 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:28.350218 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-694e7b97-0e9f-4ee9-b8b3-5953f40ba7e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:28.351201 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-694e7b97-0e9f-4ee9-b8b3-5953f40ba7e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:28.358220 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-694e7b97-0e9f-4ee9-b8b3-5953f40ba7e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:28.358675 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-694e7b97-0e9f-4ee9-b8b3-5953f40ba7e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:28.359408 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-694e7b97-0e9f-4ee9-b8b3-5953f40ba7e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:28.359878 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-694e7b97-0e9f-4ee9-b8b3-5953f40ba7e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:28.391156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-694e7b97-0e9f-4ee9-b8b3-5953f40ba7e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045396 Apr 05 11:56:28.391677 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 407/769] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:28 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:28.675258 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ee2c9040-dde4-48b1-9ad3-0b4375fd0d7d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:28.676627 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ee2c9040-dde4-48b1-9ad3-0b4375fd0d7d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:28.683397 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee2c9040-dde4-48b1-9ad3-0b4375fd0d7d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:28.684057 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee2c9040-dde4-48b1-9ad3-0b4375fd0d7d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:28.684878 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee2c9040-dde4-48b1-9ad3-0b4375fd0d7d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:28.685350 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee2c9040-dde4-48b1-9ad3-0b4375fd0d7d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:28.716922 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ee2c9040-dde4-48b1-9ad3-0b4375fd0d7d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046149 Apr 05 11:56:28.717785 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 363/770] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:28 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:29.127369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-29c6a5e2-964c-4a16-9865-59a54d8244b4 req-8a07087b-8042-4d7f-b0a0-8557db11bfec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99328563-d12a-4ef5-952b-c6c86929a22d", "tag": "d788cf01-8528-46be-b9ed-aa38fac571ee"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:56:29.135578 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-29c6a5e2-964c-4a16-9865-59a54d8244b4 req-8a07087b-8042-4d7f-b0a0-8557db11bfec service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:29.136016 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-29c6a5e2-964c-4a16-9865-59a54d8244b4 req-8a07087b-8042-4d7f-b0a0-8557db11bfec service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:29.146972 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-29c6a5e2-964c-4a16-9865-59a54d8244b4 req-8a07087b-8042-4d7f-b0a0-8557db11bfec service nova] Creating event network-changed:d788cf01-8528-46be-b9ed-aa38fac571ee for instance 99328563-d12a-4ef5-952b-c6c86929a22d on hv-cinder-82956 Apr 05 11:56:29.151818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-29c6a5e2-964c-4a16-9865-59a54d8244b4 req-8a07087b-8042-4d7f-b0a0-8557db11bfec service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084965 Apr 05 11:56:29.152406 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 408/771] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:56:29.403015 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3420fcac-39e8-4515-8890-30cee6db460a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:29.404268 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3420fcac-39e8-4515-8890-30cee6db460a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:29.410960 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3420fcac-39e8-4515-8890-30cee6db460a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:29.411873 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3420fcac-39e8-4515-8890-30cee6db460a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:29.413129 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3420fcac-39e8-4515-8890-30cee6db460a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:29.413722 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3420fcac-39e8-4515-8890-30cee6db460a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:29.447242 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3420fcac-39e8-4515-8890-30cee6db460a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047946 Apr 05 11:56:29.448177 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 364/772] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:29 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:29.733288 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-58f60d29-021c-42f0-8402-1e3f278cb9db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:29.735076 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-58f60d29-021c-42f0-8402-1e3f278cb9db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:29.743616 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-58f60d29-021c-42f0-8402-1e3f278cb9db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:29.744463 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-58f60d29-021c-42f0-8402-1e3f278cb9db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:29.745471 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-58f60d29-021c-42f0-8402-1e3f278cb9db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:29.746088 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-58f60d29-021c-42f0-8402-1e3f278cb9db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:29.794527 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-58f60d29-021c-42f0-8402-1e3f278cb9db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069066 Apr 05 11:56:29.795153 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 409/773] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:29 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:56:30.460210 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-dcc4abb7-f2ac-4ab5-a15a-0537fc3f1338 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:30.461128 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-dcc4abb7-f2ac-4ab5-a15a-0537fc3f1338 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:30.467761 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dcc4abb7-f2ac-4ab5-a15a-0537fc3f1338 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:30.468241 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dcc4abb7-f2ac-4ab5-a15a-0537fc3f1338 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:30.469375 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dcc4abb7-f2ac-4ab5-a15a-0537fc3f1338 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:30.469809 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dcc4abb7-f2ac-4ab5-a15a-0537fc3f1338 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:30.499698 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-dcc4abb7-f2ac-4ab5-a15a-0537fc3f1338 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043655 Apr 05 11:56:30.500311 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 365/774] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:30 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:30.806345 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4d0f3964-af0d-4732-bf38-d314e861ca8a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:30.807270 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4d0f3964-af0d-4732-bf38-d314e861ca8a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:30.813834 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4d0f3964-af0d-4732-bf38-d314e861ca8a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:30.814284 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4d0f3964-af0d-4732-bf38-d314e861ca8a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:30.815195 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4d0f3964-af0d-4732-bf38-d314e861ca8a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:30.815488 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4d0f3964-af0d-4732-bf38-d314e861ca8a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:30.844763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4d0f3964-af0d-4732-bf38-d314e861ca8a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042314 Apr 05 11:56:30.845286 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 410/775] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:30 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:31.171847 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-ce365dc5-1fd7-4ecc-ae74-b70aab25dfec req-9b1bd01b-0d0e-40ef-95e0-81f81dbc73e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99328563-d12a-4ef5-952b-c6c86929a22d", "tag": "d788cf01-8528-46be-b9ed-aa38fac571ee"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:56:31.185177 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-ce365dc5-1fd7-4ecc-ae74-b70aab25dfec req-9b1bd01b-0d0e-40ef-95e0-81f81dbc73e4 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:31.185828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-ce365dc5-1fd7-4ecc-ae74-b70aab25dfec req-9b1bd01b-0d0e-40ef-95e0-81f81dbc73e4 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:31.197404 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-ce365dc5-1fd7-4ecc-ae74-b70aab25dfec req-9b1bd01b-0d0e-40ef-95e0-81f81dbc73e4 service nova] Creating event network-changed:d788cf01-8528-46be-b9ed-aa38fac571ee for instance 99328563-d12a-4ef5-952b-c6c86929a22d on hv-cinder-82956 Apr 05 11:56:31.202552 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-ce365dc5-1fd7-4ecc-ae74-b70aab25dfec req-9b1bd01b-0d0e-40ef-95e0-81f81dbc73e4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036794 Apr 05 11:56:31.203109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 366/776] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 11:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:31.511192 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-72e42fca-1307-40b4-b261-1a03a789446b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:31.512133 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-72e42fca-1307-40b4-b261-1a03a789446b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:31.518514 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-72e42fca-1307-40b4-b261-1a03a789446b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:31.518963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-72e42fca-1307-40b4-b261-1a03a789446b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:31.519724 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-72e42fca-1307-40b4-b261-1a03a789446b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:31.520186 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-72e42fca-1307-40b4-b261-1a03a789446b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:31.549566 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-72e42fca-1307-40b4-b261-1a03a789446b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042369 Apr 05 11:56:31.550134 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 411/777] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:31 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:31.862171 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3ebb6a8c-bf4e-48e9-875d-3b3bbf8f415b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:31.863770 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3ebb6a8c-bf4e-48e9-875d-3b3bbf8f415b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:31.873678 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3ebb6a8c-bf4e-48e9-875d-3b3bbf8f415b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:31.874114 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3ebb6a8c-bf4e-48e9-875d-3b3bbf8f415b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:31.874880 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3ebb6a8c-bf4e-48e9-875d-3b3bbf8f415b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:31.875303 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3ebb6a8c-bf4e-48e9-875d-3b3bbf8f415b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:31.904479 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3ebb6a8c-bf4e-48e9-875d-3b3bbf8f415b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050307 Apr 05 11:56:31.905250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 367/778] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:31 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:32.563318 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-03dad56a-aecf-4d71-a401-98be02637331 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:32.564472 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-03dad56a-aecf-4d71-a401-98be02637331 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:32.572805 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-03dad56a-aecf-4d71-a401-98be02637331 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:32.573349 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-03dad56a-aecf-4d71-a401-98be02637331 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:32.574299 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-03dad56a-aecf-4d71-a401-98be02637331 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:32.574836 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-03dad56a-aecf-4d71-a401-98be02637331 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:32.607111 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-03dad56a-aecf-4d71-a401-98be02637331 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048722 Apr 05 11:56:32.607843 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 412/779] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:32 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:32.920016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6b1ac0d5-7a0b-42f3-a1d2-e818a925b13a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:32.921524 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6b1ac0d5-7a0b-42f3-a1d2-e818a925b13a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:32.932005 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6b1ac0d5-7a0b-42f3-a1d2-e818a925b13a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:32.932795 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6b1ac0d5-7a0b-42f3-a1d2-e818a925b13a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:32.934050 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6b1ac0d5-7a0b-42f3-a1d2-e818a925b13a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:32.934758 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6b1ac0d5-7a0b-42f3-a1d2-e818a925b13a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:32.970737 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6b1ac0d5-7a0b-42f3-a1d2-e818a925b13a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057177 Apr 05 11:56:32.971310 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 368/780] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:32 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:33.624602 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ade7a02c-117e-4180-9276-a402ac22c032 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:33.625743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ade7a02c-117e-4180-9276-a402ac22c032 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:33.634143 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ade7a02c-117e-4180-9276-a402ac22c032 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:33.634701 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ade7a02c-117e-4180-9276-a402ac22c032 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:33.635713 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ade7a02c-117e-4180-9276-a402ac22c032 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:33.636294 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ade7a02c-117e-4180-9276-a402ac22c032 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:33.670980 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ade7a02c-117e-4180-9276-a402ac22c032 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052477 Apr 05 11:56:33.671787 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 413/781] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:33 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:33.984813 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-99c3276c-cf96-48ee-bac1-fdf65e5ffd65 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:33.985733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-99c3276c-cf96-48ee-bac1-fdf65e5ffd65 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:33.992379 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-99c3276c-cf96-48ee-bac1-fdf65e5ffd65 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:33.992820 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-99c3276c-cf96-48ee-bac1-fdf65e5ffd65 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:33.993576 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-99c3276c-cf96-48ee-bac1-fdf65e5ffd65 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:33.994005 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-99c3276c-cf96-48ee-bac1-fdf65e5ffd65 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:34.027571 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-99c3276c-cf96-48ee-bac1-fdf65e5ffd65 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047833 Apr 05 11:56:34.028179 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 369/782] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:33 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:34.684515 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8503667a-ff24-4487-bb8b-f8b450955e06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:34.685487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8503667a-ff24-4487-bb8b-f8b450955e06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:34.692886 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8503667a-ff24-4487-bb8b-f8b450955e06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:34.693403 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8503667a-ff24-4487-bb8b-f8b450955e06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:34.694510 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8503667a-ff24-4487-bb8b-f8b450955e06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:34.694812 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8503667a-ff24-4487-bb8b-f8b450955e06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:34.724306 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8503667a-ff24-4487-bb8b-f8b450955e06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044619 Apr 05 11:56:34.724836 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 414/783] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:34 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:35.042804 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b73e99d4-f5f5-4176-8054-2810e54e093c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:35.044391 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b73e99d4-f5f5-4176-8054-2810e54e093c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:35.055020 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b73e99d4-f5f5-4176-8054-2810e54e093c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:35.055768 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b73e99d4-f5f5-4176-8054-2810e54e093c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:35.057073 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b73e99d4-f5f5-4176-8054-2810e54e093c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:35.057803 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b73e99d4-f5f5-4176-8054-2810e54e093c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:35.088127 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b73e99d4-f5f5-4176-8054-2810e54e093c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051865 Apr 05 11:56:35.088694 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 370/784] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:35 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:35.737044 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-dc07b695-53ef-4189-9b95-ec4e5948d09f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:35.738047 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-dc07b695-53ef-4189-9b95-ec4e5948d09f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:35.745532 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dc07b695-53ef-4189-9b95-ec4e5948d09f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:35.745969 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dc07b695-53ef-4189-9b95-ec4e5948d09f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:35.746812 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dc07b695-53ef-4189-9b95-ec4e5948d09f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:35.747296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dc07b695-53ef-4189-9b95-ec4e5948d09f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:35.776326 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-dc07b695-53ef-4189-9b95-ec4e5948d09f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043806 Apr 05 11:56:35.776874 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 415/785] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:35 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:36.104787 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9666f1b4-a3a8-4832-a04d-7992868b5038 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:36.105440 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9666f1b4-a3a8-4832-a04d-7992868b5038 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:36.112663 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9666f1b4-a3a8-4832-a04d-7992868b5038 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:36.113118 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9666f1b4-a3a8-4832-a04d-7992868b5038 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:36.113861 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9666f1b4-a3a8-4832-a04d-7992868b5038 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:36.114470 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9666f1b4-a3a8-4832-a04d-7992868b5038 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:36.143885 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9666f1b4-a3a8-4832-a04d-7992868b5038 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046869 Apr 05 11:56:36.144489 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 371/786] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:36 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:36.793053 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-26c91c36-4c93-4551-9419-9f4e3fbbf564 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:36.794678 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-26c91c36-4c93-4551-9419-9f4e3fbbf564 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:36.801364 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-26c91c36-4c93-4551-9419-9f4e3fbbf564 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:36.801809 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-26c91c36-4c93-4551-9419-9f4e3fbbf564 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:36.802566 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-26c91c36-4c93-4551-9419-9f4e3fbbf564 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:36.802995 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-26c91c36-4c93-4551-9419-9f4e3fbbf564 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:36.835456 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-26c91c36-4c93-4551-9419-9f4e3fbbf564 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045932 Apr 05 11:56:36.835456 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 416/787] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:36 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:37.160606 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4eb7697a-acf2-4bca-8ada-2f40d3210371 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:37.162074 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4eb7697a-acf2-4bca-8ada-2f40d3210371 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:37.172901 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4eb7697a-acf2-4bca-8ada-2f40d3210371 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:37.173609 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4eb7697a-acf2-4bca-8ada-2f40d3210371 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:37.174907 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4eb7697a-acf2-4bca-8ada-2f40d3210371 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:37.175625 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4eb7697a-acf2-4bca-8ada-2f40d3210371 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:37.208440 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4eb7697a-acf2-4bca-8ada-2f40d3210371 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054933 Apr 05 11:56:37.209179 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 372/788] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:37 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:37.849540 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a92e4c59-b213-42c3-b194-8a44e598c5cc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:37.851837 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a92e4c59-b213-42c3-b194-8a44e598c5cc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:37.862771 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a92e4c59-b213-42c3-b194-8a44e598c5cc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:37.863488 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a92e4c59-b213-42c3-b194-8a44e598c5cc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:37.864792 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a92e4c59-b213-42c3-b194-8a44e598c5cc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:37.865501 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a92e4c59-b213-42c3-b194-8a44e598c5cc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:37.902847 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a92e4c59-b213-42c3-b194-8a44e598c5cc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060321 Apr 05 11:56:37.903848 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 417/789] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:37 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:38.222033 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-887917c5-4bf6-41f7-862c-e21679f0d80d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:38.224500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-887917c5-4bf6-41f7-862c-e21679f0d80d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:38.230018 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-887917c5-4bf6-41f7-862c-e21679f0d80d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:38.230655 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-887917c5-4bf6-41f7-862c-e21679f0d80d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:38.231809 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-887917c5-4bf6-41f7-862c-e21679f0d80d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:38.232399 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-887917c5-4bf6-41f7-862c-e21679f0d80d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:38.266421 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-887917c5-4bf6-41f7-862c-e21679f0d80d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048669 Apr 05 11:56:38.267129 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 373/790] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:38 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:38.919823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f79f7da5-6373-4444-97f7-7ebcf3546a54 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:38.921306 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f79f7da5-6373-4444-97f7-7ebcf3546a54 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:38.931501 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f79f7da5-6373-4444-97f7-7ebcf3546a54 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:38.932308 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f79f7da5-6373-4444-97f7-7ebcf3546a54 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:38.933562 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f79f7da5-6373-4444-97f7-7ebcf3546a54 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:38.934281 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f79f7da5-6373-4444-97f7-7ebcf3546a54 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:38.963864 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f79f7da5-6373-4444-97f7-7ebcf3546a54 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051138 Apr 05 11:56:38.964452 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 418/791] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:38 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:39.282489 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-011beef5-d651-4f07-93e7-856fa42da20a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:39.284249 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-011beef5-d651-4f07-93e7-856fa42da20a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:39.294624 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-011beef5-d651-4f07-93e7-856fa42da20a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:39.295075 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-011beef5-d651-4f07-93e7-856fa42da20a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:39.295846 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-011beef5-d651-4f07-93e7-856fa42da20a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:39.296308 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-011beef5-d651-4f07-93e7-856fa42da20a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:39.324545 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-011beef5-d651-4f07-93e7-856fa42da20a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048653 Apr 05 11:56:39.328327 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 374/792] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:39 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:39.979864 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7a52ff03-c5a3-40a9-9a47-5345a7a74b6d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:39.981392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7a52ff03-c5a3-40a9-9a47-5345a7a74b6d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:39.988636 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a52ff03-c5a3-40a9-9a47-5345a7a74b6d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:39.989102 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a52ff03-c5a3-40a9-9a47-5345a7a74b6d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:39.989910 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a52ff03-c5a3-40a9-9a47-5345a7a74b6d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:39.990364 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a52ff03-c5a3-40a9-9a47-5345a7a74b6d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:40.020203 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7a52ff03-c5a3-40a9-9a47-5345a7a74b6d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047078 Apr 05 11:56:40.020748 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 419/793] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:39 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:40.340141 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-82d9cd00-d930-4859-a019-db86edfc8430 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:40.341514 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-82d9cd00-d930-4859-a019-db86edfc8430 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:40.347982 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-82d9cd00-d930-4859-a019-db86edfc8430 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:40.350032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-82d9cd00-d930-4859-a019-db86edfc8430 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:40.350829 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-82d9cd00-d930-4859-a019-db86edfc8430 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:40.351270 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-82d9cd00-d930-4859-a019-db86edfc8430 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:40.380441 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-82d9cd00-d930-4859-a019-db86edfc8430 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047024 Apr 05 11:56:40.381205 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 375/794] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:40 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:41.036649 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e6c9446b-4be5-4c66-ac37-83e8bd81e65f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:41.038127 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e6c9446b-4be5-4c66-ac37-83e8bd81e65f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:41.048731 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6c9446b-4be5-4c66-ac37-83e8bd81e65f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:41.049481 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6c9446b-4be5-4c66-ac37-83e8bd81e65f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:41.050738 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6c9446b-4be5-4c66-ac37-83e8bd81e65f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:41.051477 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6c9446b-4be5-4c66-ac37-83e8bd81e65f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:41.083813 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e6c9446b-4be5-4c66-ac37-83e8bd81e65f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054077 Apr 05 11:56:41.084417 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 420/795] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:41 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:41.395782 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-45b05e87-e9f7-46a3-949a-d5ea2faeba1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:41.397367 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-45b05e87-e9f7-46a3-949a-d5ea2faeba1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:41.408246 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-45b05e87-e9f7-46a3-949a-d5ea2faeba1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:41.409011 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-45b05e87-e9f7-46a3-949a-d5ea2faeba1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:41.410290 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-45b05e87-e9f7-46a3-949a-d5ea2faeba1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:41.411017 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-45b05e87-e9f7-46a3-949a-d5ea2faeba1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:41.443653 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-45b05e87-e9f7-46a3-949a-d5ea2faeba1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054538 Apr 05 11:56:41.444396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 376/796] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:41 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:42.101935 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-33ec8867-739a-42a4-8fa3-95b7fe11c002 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:42.103414 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-33ec8867-739a-42a4-8fa3-95b7fe11c002 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:42.111560 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-33ec8867-739a-42a4-8fa3-95b7fe11c002 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:42.112007 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-33ec8867-739a-42a4-8fa3-95b7fe11c002 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:42.112804 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-33ec8867-739a-42a4-8fa3-95b7fe11c002 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:42.113239 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-33ec8867-739a-42a4-8fa3-95b7fe11c002 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:42.142183 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-33ec8867-739a-42a4-8fa3-95b7fe11c002 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046991 Apr 05 11:56:42.142724 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 421/797] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:42 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:42.459278 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3184f2c1-da57-46c5-932d-91d02ec066c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:42.460881 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3184f2c1-da57-46c5-932d-91d02ec066c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:42.470001 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3184f2c1-da57-46c5-932d-91d02ec066c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:42.470456 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3184f2c1-da57-46c5-932d-91d02ec066c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:42.471221 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3184f2c1-da57-46c5-932d-91d02ec066c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:42.471647 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3184f2c1-da57-46c5-932d-91d02ec066c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:42.500725 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3184f2c1-da57-46c5-932d-91d02ec066c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048356 Apr 05 11:56:42.501504 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 377/798] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:42 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:43.160003 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fb0dddaf-ae35-48e9-9703-e69b617bb03b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:43.161519 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fb0dddaf-ae35-48e9-9703-e69b617bb03b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:43.172140 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fb0dddaf-ae35-48e9-9703-e69b617bb03b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:43.172904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fb0dddaf-ae35-48e9-9703-e69b617bb03b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:43.174163 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fb0dddaf-ae35-48e9-9703-e69b617bb03b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:43.174881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fb0dddaf-ae35-48e9-9703-e69b617bb03b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:43.207763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fb0dddaf-ae35-48e9-9703-e69b617bb03b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054559 Apr 05 11:56:43.208342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 422/799] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:43 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:43.516063 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d2606c55-8700-48c6-84f2-8f61195eec03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:43.517225 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d2606c55-8700-48c6-84f2-8f61195eec03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:43.523661 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d2606c55-8700-48c6-84f2-8f61195eec03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:43.524114 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d2606c55-8700-48c6-84f2-8f61195eec03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:43.524869 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d2606c55-8700-48c6-84f2-8f61195eec03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:43.525293 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d2606c55-8700-48c6-84f2-8f61195eec03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:43.555066 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d2606c55-8700-48c6-84f2-8f61195eec03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044585 Apr 05 11:56:43.555679 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 378/800] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:43 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:44.223745 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-297e5cd8-3822-4979-ab76-e1b9678d0ab8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:44.225331 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-297e5cd8-3822-4979-ab76-e1b9678d0ab8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:44.234468 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-297e5cd8-3822-4979-ab76-e1b9678d0ab8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:44.234910 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-297e5cd8-3822-4979-ab76-e1b9678d0ab8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:44.235662 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-297e5cd8-3822-4979-ab76-e1b9678d0ab8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:44.236116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-297e5cd8-3822-4979-ab76-e1b9678d0ab8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:44.264114 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-297e5cd8-3822-4979-ab76-e1b9678d0ab8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047634 Apr 05 11:56:44.264697 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 423/801] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:44 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:44.570973 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-328065d2-c6a5-4e22-9164-fd16ef6e93a9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:44.572500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-328065d2-c6a5-4e22-9164-fd16ef6e93a9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:44.580314 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-328065d2-c6a5-4e22-9164-fd16ef6e93a9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:44.580763 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-328065d2-c6a5-4e22-9164-fd16ef6e93a9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:44.581533 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-328065d2-c6a5-4e22-9164-fd16ef6e93a9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:44.582016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-328065d2-c6a5-4e22-9164-fd16ef6e93a9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:44.611156 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-328065d2-c6a5-4e22-9164-fd16ef6e93a9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046787 Apr 05 11:56:44.611733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 379/802] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:44 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:45.282536 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c76cf534-79e7-4f32-863f-4c098bf6e576 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:45.284002 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c76cf534-79e7-4f32-863f-4c098bf6e576 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:45.294566 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c76cf534-79e7-4f32-863f-4c098bf6e576 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:45.295252 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c76cf534-79e7-4f32-863f-4c098bf6e576 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:45.296006 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c76cf534-79e7-4f32-863f-4c098bf6e576 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:45.296473 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c76cf534-79e7-4f32-863f-4c098bf6e576 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:45.324990 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c76cf534-79e7-4f32-863f-4c098bf6e576 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049561 Apr 05 11:56:45.325542 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 424/803] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:45 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:45.625756 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a460bdbc-da02-45b7-97f1-94d782fbb978 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:45.626690 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a460bdbc-da02-45b7-97f1-94d782fbb978 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:45.633912 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a460bdbc-da02-45b7-97f1-94d782fbb978 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:45.634335 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a460bdbc-da02-45b7-97f1-94d782fbb978 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:45.636700 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a460bdbc-da02-45b7-97f1-94d782fbb978 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:45.636700 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a460bdbc-da02-45b7-97f1-94d782fbb978 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:45.665838 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a460bdbc-da02-45b7-97f1-94d782fbb978 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045244 Apr 05 11:56:45.666613 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 380/804] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:45 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:46.337872 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7b9eccde-fcba-4e72-9b0c-acb70c12f90b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:46.338780 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7b9eccde-fcba-4e72-9b0c-acb70c12f90b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:46.345763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b9eccde-fcba-4e72-9b0c-acb70c12f90b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:46.346204 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b9eccde-fcba-4e72-9b0c-acb70c12f90b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:46.346954 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b9eccde-fcba-4e72-9b0c-acb70c12f90b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:46.347377 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b9eccde-fcba-4e72-9b0c-acb70c12f90b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:46.376143 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7b9eccde-fcba-4e72-9b0c-acb70c12f90b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042345 Apr 05 11:56:46.376724 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 425/805] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:46 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:46.682925 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5f8c0a4e-dd4f-4577-bc5b-d4e9218aecc4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:46.684341 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5f8c0a4e-dd4f-4577-bc5b-d4e9218aecc4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:46.694779 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5f8c0a4e-dd4f-4577-bc5b-d4e9218aecc4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:46.696416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5f8c0a4e-dd4f-4577-bc5b-d4e9218aecc4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:46.697315 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5f8c0a4e-dd4f-4577-bc5b-d4e9218aecc4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:46.698080 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5f8c0a4e-dd4f-4577-bc5b-d4e9218aecc4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:46.728382 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5f8c0a4e-dd4f-4577-bc5b-d4e9218aecc4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052902 Apr 05 11:56:46.728948 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 381/806] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:46 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:47.389354 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-20be32dd-cc8a-40d3-8521-a45795efcebe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:47.390266 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-20be32dd-cc8a-40d3-8521-a45795efcebe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:47.396990 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-20be32dd-cc8a-40d3-8521-a45795efcebe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:47.397442 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-20be32dd-cc8a-40d3-8521-a45795efcebe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:47.398212 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-20be32dd-cc8a-40d3-8521-a45795efcebe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:47.398640 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-20be32dd-cc8a-40d3-8521-a45795efcebe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:47.428041 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-20be32dd-cc8a-40d3-8521-a45795efcebe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042829 Apr 05 11:56:47.428631 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 426/807] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:47 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:47.740875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bbb6c11d-8b9d-48a0-bb9d-7d4840f65ca4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:47.741900 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bbb6c11d-8b9d-48a0-bb9d-7d4840f65ca4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:47.748675 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bbb6c11d-8b9d-48a0-bb9d-7d4840f65ca4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:47.749122 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bbb6c11d-8b9d-48a0-bb9d-7d4840f65ca4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:47.749891 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bbb6c11d-8b9d-48a0-bb9d-7d4840f65ca4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:47.750326 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bbb6c11d-8b9d-48a0-bb9d-7d4840f65ca4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:47.780503 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bbb6c11d-8b9d-48a0-bb9d-7d4840f65ca4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043640 Apr 05 11:56:47.781094 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 382/808] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:47 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:48.444009 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fad48ad7-17b3-45d4-a139-23da8d48058b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:48.445535 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fad48ad7-17b3-45d4-a139-23da8d48058b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:48.456705 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fad48ad7-17b3-45d4-a139-23da8d48058b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:48.457446 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fad48ad7-17b3-45d4-a139-23da8d48058b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:48.458708 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fad48ad7-17b3-45d4-a139-23da8d48058b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:48.459430 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fad48ad7-17b3-45d4-a139-23da8d48058b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:48.500346 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fad48ad7-17b3-45d4-a139-23da8d48058b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062935 Apr 05 11:56:48.500903 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 427/809] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:48 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:48.796617 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-330c1e1f-c45f-4e15-b0b6-52b882b499cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:48.798101 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-330c1e1f-c45f-4e15-b0b6-52b882b499cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:48.808210 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-330c1e1f-c45f-4e15-b0b6-52b882b499cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:48.809097 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-330c1e1f-c45f-4e15-b0b6-52b882b499cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:48.810483 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-330c1e1f-c45f-4e15-b0b6-52b882b499cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:48.810896 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-330c1e1f-c45f-4e15-b0b6-52b882b499cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:48.846696 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-330c1e1f-c45f-4e15-b0b6-52b882b499cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056792 Apr 05 11:56:48.847326 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 383/810] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:48 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:49.512690 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2790608d-d0ca-4650-90b0-28872da6a674 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:49.513622 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2790608d-d0ca-4650-90b0-28872da6a674 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:49.520489 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2790608d-d0ca-4650-90b0-28872da6a674 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:49.520942 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2790608d-d0ca-4650-90b0-28872da6a674 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:49.521697 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2790608d-d0ca-4650-90b0-28872da6a674 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:49.522145 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2790608d-d0ca-4650-90b0-28872da6a674 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:49.551517 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2790608d-d0ca-4650-90b0-28872da6a674 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042993 Apr 05 11:56:49.552065 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 428/811] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:49 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:49.863014 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c3a9894b-1176-4a96-b18e-f2fe70cd93a0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:49.864652 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c3a9894b-1176-4a96-b18e-f2fe70cd93a0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:49.874756 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3a9894b-1176-4a96-b18e-f2fe70cd93a0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:49.876692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3a9894b-1176-4a96-b18e-f2fe70cd93a0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:49.876692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3a9894b-1176-4a96-b18e-f2fe70cd93a0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:49.876692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3a9894b-1176-4a96-b18e-f2fe70cd93a0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:49.905716 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c3a9894b-1176-4a96-b18e-f2fe70cd93a0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049536 Apr 05 11:56:49.906312 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 384/812] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:49 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:50.568973 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5e5b72b3-0cad-43ea-b342-2634d8694ace tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:50.570456 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5e5b72b3-0cad-43ea-b342-2634d8694ace tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:50.581078 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5e5b72b3-0cad-43ea-b342-2634d8694ace tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:50.581824 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5e5b72b3-0cad-43ea-b342-2634d8694ace tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:50.583080 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5e5b72b3-0cad-43ea-b342-2634d8694ace tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:50.583783 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5e5b72b3-0cad-43ea-b342-2634d8694ace tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:50.615600 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5e5b72b3-0cad-43ea-b342-2634d8694ace tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053483 Apr 05 11:56:50.616165 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 429/813] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:50 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:50.921853 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-70b2cee3-9203-46f2-b275-388a28e171ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:50.922934 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-70b2cee3-9203-46f2-b275-388a28e171ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:50.929423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-70b2cee3-9203-46f2-b275-388a28e171ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:50.929871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-70b2cee3-9203-46f2-b275-388a28e171ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:50.930639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-70b2cee3-9203-46f2-b275-388a28e171ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:50.931073 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-70b2cee3-9203-46f2-b275-388a28e171ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:50.960273 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-70b2cee3-9203-46f2-b275-388a28e171ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044818 Apr 05 11:56:50.960807 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 385/814] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:50 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:51.631779 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2e740977-2ee7-40cf-a536-4a1b369235c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:51.633296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2e740977-2ee7-40cf-a536-4a1b369235c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:51.644024 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2e740977-2ee7-40cf-a536-4a1b369235c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:51.644825 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2e740977-2ee7-40cf-a536-4a1b369235c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:51.646065 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2e740977-2ee7-40cf-a536-4a1b369235c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:51.647318 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2e740977-2ee7-40cf-a536-4a1b369235c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:51.681364 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2e740977-2ee7-40cf-a536-4a1b369235c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055809 Apr 05 11:56:51.682169 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 430/815] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:51 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:51.977971 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fb45e400-f6cf-4036-82df-4476e98c89f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:51.978788 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fb45e400-f6cf-4036-82df-4476e98c89f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:51.987049 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fb45e400-f6cf-4036-82df-4476e98c89f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:51.987493 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fb45e400-f6cf-4036-82df-4476e98c89f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:51.988286 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fb45e400-f6cf-4036-82df-4476e98c89f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:51.988732 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fb45e400-f6cf-4036-82df-4476e98c89f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:52.018124 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fb45e400-f6cf-4036-82df-4476e98c89f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047981 Apr 05 11:56:52.018708 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 386/816] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:51 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:52.698109 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9856a96e-0f86-4b74-9592-cbdc95f3fc46 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:52.699528 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9856a96e-0f86-4b74-9592-cbdc95f3fc46 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:52.707195 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9856a96e-0f86-4b74-9592-cbdc95f3fc46 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:52.707645 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9856a96e-0f86-4b74-9592-cbdc95f3fc46 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:52.708477 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9856a96e-0f86-4b74-9592-cbdc95f3fc46 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:52.708912 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9856a96e-0f86-4b74-9592-cbdc95f3fc46 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:52.738697 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9856a96e-0f86-4b74-9592-cbdc95f3fc46 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047668 Apr 05 11:56:52.739270 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 431/817] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:52 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:53.034280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8c43668a-60df-47b5-bebf-91294058052e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:53.035984 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8c43668a-60df-47b5-bebf-91294058052e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:53.047896 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c43668a-60df-47b5-bebf-91294058052e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:53.049030 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c43668a-60df-47b5-bebf-91294058052e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:53.050288 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c43668a-60df-47b5-bebf-91294058052e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:53.051001 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c43668a-60df-47b5-bebf-91294058052e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:53.084801 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8c43668a-60df-47b5-bebf-91294058052e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057238 Apr 05 11:56:53.085538 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 387/818] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:53 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:53.755341 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-61814f34-e5eb-4eb4-b634-239ca25508cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:53.756740 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-61814f34-e5eb-4eb4-b634-239ca25508cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:53.767393 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-61814f34-e5eb-4eb4-b634-239ca25508cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:53.768158 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-61814f34-e5eb-4eb4-b634-239ca25508cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:53.769400 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-61814f34-e5eb-4eb4-b634-239ca25508cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:53.770173 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-61814f34-e5eb-4eb4-b634-239ca25508cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:53.803002 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-61814f34-e5eb-4eb4-b634-239ca25508cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054860 Apr 05 11:56:53.803554 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 432/819] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:53 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:54.099294 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cda893fa-ba77-44b3-803e-2f4b8398d7fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:54.100529 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cda893fa-ba77-44b3-803e-2f4b8398d7fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:54.108716 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cda893fa-ba77-44b3-803e-2f4b8398d7fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:54.109143 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cda893fa-ba77-44b3-803e-2f4b8398d7fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:54.110211 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cda893fa-ba77-44b3-803e-2f4b8398d7fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:54.110641 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cda893fa-ba77-44b3-803e-2f4b8398d7fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:54.139727 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cda893fa-ba77-44b3-803e-2f4b8398d7fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045698 Apr 05 11:56:54.143649 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 388/820] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:54 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:54.819150 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-75273655-a236-4f15-bb88-7f43f273cc4c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:54.820669 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-75273655-a236-4f15-bb88-7f43f273cc4c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:54.829758 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-75273655-a236-4f15-bb88-7f43f273cc4c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:54.830204 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-75273655-a236-4f15-bb88-7f43f273cc4c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:54.830962 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-75273655-a236-4f15-bb88-7f43f273cc4c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:54.831392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-75273655-a236-4f15-bb88-7f43f273cc4c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:54.861147 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-75273655-a236-4f15-bb88-7f43f273cc4c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048869 Apr 05 11:56:54.861700 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 433/821] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:54 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:55.155674 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2cc28a35-6dec-41a3-a9c6-3af8b5b80a7c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:55.156640 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2cc28a35-6dec-41a3-a9c6-3af8b5b80a7c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:55.163233 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2cc28a35-6dec-41a3-a9c6-3af8b5b80a7c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:55.163690 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2cc28a35-6dec-41a3-a9c6-3af8b5b80a7c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:55.164502 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2cc28a35-6dec-41a3-a9c6-3af8b5b80a7c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:55.164944 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2cc28a35-6dec-41a3-a9c6-3af8b5b80a7c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:55.194558 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2cc28a35-6dec-41a3-a9c6-3af8b5b80a7c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045425 Apr 05 11:56:55.195338 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 389/822] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:55 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:55.877389 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a5b962fe-4c71-4181-9627-4da760b7763d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:55.878798 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a5b962fe-4c71-4181-9627-4da760b7763d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:55.889637 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5b962fe-4c71-4181-9627-4da760b7763d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:55.890370 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5b962fe-4c71-4181-9627-4da760b7763d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:55.891617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5b962fe-4c71-4181-9627-4da760b7763d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:55.892392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5b962fe-4c71-4181-9627-4da760b7763d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:55.926071 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a5b962fe-4c71-4181-9627-4da760b7763d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055756 Apr 05 11:56:55.926596 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 434/823] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:55 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:56.210418 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-16651699-7cdf-48a8-9516-81153a6207e5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:56.211891 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-16651699-7cdf-48a8-9516-81153a6207e5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:56.222753 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-16651699-7cdf-48a8-9516-81153a6207e5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:56.224339 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-16651699-7cdf-48a8-9516-81153a6207e5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:56.225656 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-16651699-7cdf-48a8-9516-81153a6207e5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:56.226567 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-16651699-7cdf-48a8-9516-81153a6207e5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:56.259178 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-16651699-7cdf-48a8-9516-81153a6207e5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055259 Apr 05 11:56:56.259924 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 390/824] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:56 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:56.942209 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b4bb467d-54f0-41f8-98af-53f62a44388e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:56.943611 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b4bb467d-54f0-41f8-98af-53f62a44388e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:56.953530 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b4bb467d-54f0-41f8-98af-53f62a44388e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:56.953977 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b4bb467d-54f0-41f8-98af-53f62a44388e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:56.954736 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b4bb467d-54f0-41f8-98af-53f62a44388e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:56.955198 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b4bb467d-54f0-41f8-98af-53f62a44388e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:56.984604 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b4bb467d-54f0-41f8-98af-53f62a44388e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049325 Apr 05 11:56:56.985149 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 435/825] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:56 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:57.275284 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ff8788d1-4f69-4b44-897f-13c62034704d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:57.276814 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ff8788d1-4f69-4b44-897f-13c62034704d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:57.285036 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff8788d1-4f69-4b44-897f-13c62034704d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:57.285491 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff8788d1-4f69-4b44-897f-13c62034704d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:57.286262 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff8788d1-4f69-4b44-897f-13c62034704d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:57.286692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff8788d1-4f69-4b44-897f-13c62034704d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:57.315718 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ff8788d1-4f69-4b44-897f-13c62034704d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047413 Apr 05 11:56:57.316331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 391/826] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:57 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:58.000753 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7b968930-bb1a-462a-b4d8-edd724f912e8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:58.002187 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7b968930-bb1a-462a-b4d8-edd724f912e8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:58.013232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b968930-bb1a-462a-b4d8-edd724f912e8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:58.013979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b968930-bb1a-462a-b4d8-edd724f912e8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:58.015214 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b968930-bb1a-462a-b4d8-edd724f912e8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:58.015628 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b968930-bb1a-462a-b4d8-edd724f912e8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:58.044636 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7b968930-bb1a-462a-b4d8-edd724f912e8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050533 Apr 05 11:56:58.045198 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 436/827] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:57 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:58.330961 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-223f71c3-2b7b-4faa-b10e-3ad683923ce4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:58.332675 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-223f71c3-2b7b-4faa-b10e-3ad683923ce4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:58.344768 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-223f71c3-2b7b-4faa-b10e-3ad683923ce4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:58.345192 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-223f71c3-2b7b-4faa-b10e-3ad683923ce4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:58.346034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-223f71c3-2b7b-4faa-b10e-3ad683923ce4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:58.346462 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-223f71c3-2b7b-4faa-b10e-3ad683923ce4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:58.376669 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-223f71c3-2b7b-4faa-b10e-3ad683923ce4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052468 Apr 05 11:56:58.380520 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 392/828] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:58 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:56:59.056914 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-898a5251-dc2c-464d-b09c-d52a6ea8536c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:59.057917 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-898a5251-dc2c-464d-b09c-d52a6ea8536c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:59.065158 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-898a5251-dc2c-464d-b09c-d52a6ea8536c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:59.065676 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-898a5251-dc2c-464d-b09c-d52a6ea8536c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:59.066514 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-898a5251-dc2c-464d-b09c-d52a6ea8536c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:59.067034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-898a5251-dc2c-464d-b09c-d52a6ea8536c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:59.096169 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-898a5251-dc2c-464d-b09c-d52a6ea8536c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043599 Apr 05 11:56:59.096741 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 437/829] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:56:59 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:56:59.388366 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-da0d3efa-21f8-43c1-af1f-3f4d1c362338 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:56:59.389422 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-da0d3efa-21f8-43c1-af1f-3f4d1c362338 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:56:59.396656 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-da0d3efa-21f8-43c1-af1f-3f4d1c362338 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:59.397104 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-da0d3efa-21f8-43c1-af1f-3f4d1c362338 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:59.397872 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-da0d3efa-21f8-43c1-af1f-3f4d1c362338 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:56:59.398298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-da0d3efa-21f8-43c1-af1f-3f4d1c362338 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:56:59.427363 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-da0d3efa-21f8-43c1-af1f-3f4d1c362338 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043040 Apr 05 11:56:59.431248 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 393/830] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:56:59 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:00.107763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e1497078-8828-4f7c-a732-62f504f2cac0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:00.108811 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e1497078-8828-4f7c-a732-62f504f2cac0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:00.115487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e1497078-8828-4f7c-a732-62f504f2cac0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:00.115928 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e1497078-8828-4f7c-a732-62f504f2cac0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:00.116711 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e1497078-8828-4f7c-a732-62f504f2cac0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:00.117141 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e1497078-8828-4f7c-a732-62f504f2cac0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:00.145876 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e1497078-8828-4f7c-a732-62f504f2cac0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042172 Apr 05 11:57:00.146409 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 438/831] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:00 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:00.444637 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-82b6d41e-a867-4eb3-8695-6bb8bfb105f1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:00.447150 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-82b6d41e-a867-4eb3-8695-6bb8bfb105f1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:00.457747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-82b6d41e-a867-4eb3-8695-6bb8bfb105f1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:00.458493 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-82b6d41e-a867-4eb3-8695-6bb8bfb105f1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:00.459759 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-82b6d41e-a867-4eb3-8695-6bb8bfb105f1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:00.460559 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-82b6d41e-a867-4eb3-8695-6bb8bfb105f1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:00.493373 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-82b6d41e-a867-4eb3-8695-6bb8bfb105f1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056944 Apr 05 11:57:00.493941 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 394/832] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:00 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:01.162226 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-aa3fab13-a5b7-4eb4-960a-b2a866b77c4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:01.163838 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-aa3fab13-a5b7-4eb4-960a-b2a866b77c4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:01.174246 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aa3fab13-a5b7-4eb4-960a-b2a866b77c4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:01.175011 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aa3fab13-a5b7-4eb4-960a-b2a866b77c4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:01.176288 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aa3fab13-a5b7-4eb4-960a-b2a866b77c4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:01.177021 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aa3fab13-a5b7-4eb4-960a-b2a866b77c4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:01.209510 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-aa3fab13-a5b7-4eb4-960a-b2a866b77c4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054211 Apr 05 11:57:01.210079 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 439/833] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:01 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:01.440899 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4f966e2a-b269-438d-9d5b-2ae4bd7b6772 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:01.441384 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4f966e2a-b269-438d-9d5b-2ae4bd7b6772 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:01.447731 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4f966e2a-b269-438d-9d5b-2ae4bd7b6772 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:01.448350 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4f966e2a-b269-438d-9d5b-2ae4bd7b6772 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:01.448951 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4f966e2a-b269-438d-9d5b-2ae4bd7b6772 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:01.449416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4f966e2a-b269-438d-9d5b-2ae4bd7b6772 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:01.505439 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ec990594-04d0-4f38-827d-96d1b6895410 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:01.506366 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ec990594-04d0-4f38-827d-96d1b6895410 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:01.513157 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ec990594-04d0-4f38-827d-96d1b6895410 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:01.513614 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ec990594-04d0-4f38-827d-96d1b6895410 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:01.514381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ec990594-04d0-4f38-827d-96d1b6895410 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:01.514818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ec990594-04d0-4f38-827d-96d1b6895410 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:01.529778 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.objects.instance [None req-4f966e2a-b269-438d-9d5b-2ae4bd7b6772 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lazy-loading 'services' on Instance uuid 99328563-d12a-4ef5-952b-c6c86929a22d {{(pid=123357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:57:01.544414 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ec990594-04d0-4f38-827d-96d1b6895410 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042892 Apr 05 11:57:01.545190 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 440/834] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:01 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:01.642621 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4f966e2a-b269-438d-9d5b-2ae4bd7b6772 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "DELETE /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments/bf75b0b8-0993-4b63-83c7-baf577a39884" status: 202 len: 0 microversion: 2.1 time: 0.205481 Apr 05 11:57:01.643221 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 395/835] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Apr 5 11:57:01 2022] DELETE /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments/bf75b0b8-0993-4b63-83c7-baf577a39884 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:57:01.652346 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ecd5ebc8-9e8d-4116-8999-585db9b34fd4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:01.653406 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ecd5ebc8-9e8d-4116-8999-585db9b34fd4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:01.660288 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ecd5ebc8-9e8d-4116-8999-585db9b34fd4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:01.660883 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ecd5ebc8-9e8d-4116-8999-585db9b34fd4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:01.661715 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ecd5ebc8-9e8d-4116-8999-585db9b34fd4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:01.662183 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ecd5ebc8-9e8d-4116-8999-585db9b34fd4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:01.693951 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ecd5ebc8-9e8d-4116-8999-585db9b34fd4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046133 Apr 05 11:57:01.694510 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 441/836] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:01 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:02.227155 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0a8266b3-728f-4198-9afa-e4504a5be13a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:02.228833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0a8266b3-728f-4198-9afa-e4504a5be13a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:02.237657 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0a8266b3-728f-4198-9afa-e4504a5be13a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:02.238104 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0a8266b3-728f-4198-9afa-e4504a5be13a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:02.238892 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0a8266b3-728f-4198-9afa-e4504a5be13a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:02.239327 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0a8266b3-728f-4198-9afa-e4504a5be13a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:02.267479 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0a8266b3-728f-4198-9afa-e4504a5be13a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047845 Apr 05 11:57:02.268029 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 396/837] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:02 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:02.560917 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-556ec80a-f1ce-4f96-9bb4-9ce7545cfed3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:02.562400 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-556ec80a-f1ce-4f96-9bb4-9ce7545cfed3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:02.569249 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-556ec80a-f1ce-4f96-9bb4-9ce7545cfed3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:02.569712 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-556ec80a-f1ce-4f96-9bb4-9ce7545cfed3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:02.570450 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-556ec80a-f1ce-4f96-9bb4-9ce7545cfed3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:02.570880 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-556ec80a-f1ce-4f96-9bb4-9ce7545cfed3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:02.600246 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-556ec80a-f1ce-4f96-9bb4-9ce7545cfed3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045812 Apr 05 11:57:02.600788 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 442/838] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:02 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:02.705011 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-94bffef6-cbfc-4eb1-b963-c109f8971be2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:02.705934 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-94bffef6-cbfc-4eb1-b963-c109f8971be2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:02.712574 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-94bffef6-cbfc-4eb1-b963-c109f8971be2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:02.713020 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-94bffef6-cbfc-4eb1-b963-c109f8971be2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:02.713792 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-94bffef6-cbfc-4eb1-b963-c109f8971be2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:02.714245 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-94bffef6-cbfc-4eb1-b963-c109f8971be2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:02.743516 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-94bffef6-cbfc-4eb1-b963-c109f8971be2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042399 Apr 05 11:57:02.744034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 397/839] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:02 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:03.284102 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e0484114-8c49-4ce6-8361-d04390e59a7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:03.285014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e0484114-8c49-4ce6-8361-d04390e59a7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:03.292205 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0484114-8c49-4ce6-8361-d04390e59a7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:03.292655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0484114-8c49-4ce6-8361-d04390e59a7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:03.293436 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0484114-8c49-4ce6-8361-d04390e59a7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:03.293869 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0484114-8c49-4ce6-8361-d04390e59a7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:03.326063 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e0484114-8c49-4ce6-8361-d04390e59a7b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047128 Apr 05 11:57:03.326626 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 443/840] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:03 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:03.617150 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a08464a6-1de1-4147-ba2a-013c026baf9b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:03.618507 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a08464a6-1de1-4147-ba2a-013c026baf9b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:03.628572 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a08464a6-1de1-4147-ba2a-013c026baf9b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:03.630010 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a08464a6-1de1-4147-ba2a-013c026baf9b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:03.630530 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a08464a6-1de1-4147-ba2a-013c026baf9b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:03.631222 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a08464a6-1de1-4147-ba2a-013c026baf9b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:03.664557 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a08464a6-1de1-4147-ba2a-013c026baf9b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054283 Apr 05 11:57:03.665094 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 398/841] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:03 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:03.759468 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-437c7288-4c2e-4042-9148-22b0336b9ce1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:03.761014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-437c7288-4c2e-4042-9148-22b0336b9ce1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:03.769616 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-437c7288-4c2e-4042-9148-22b0336b9ce1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:03.770040 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-437c7288-4c2e-4042-9148-22b0336b9ce1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:03.770828 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-437c7288-4c2e-4042-9148-22b0336b9ce1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:03.771262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-437c7288-4c2e-4042-9148-22b0336b9ce1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:03.801623 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-437c7288-4c2e-4042-9148-22b0336b9ce1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048714 Apr 05 11:57:03.802179 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 444/842] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:03 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:04.342839 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2b378545-98c3-4064-acb8-d98c469fecc8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:04.344195 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2b378545-98c3-4064-acb8-d98c469fecc8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:04.351104 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2b378545-98c3-4064-acb8-d98c469fecc8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:04.351555 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2b378545-98c3-4064-acb8-d98c469fecc8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:04.352357 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2b378545-98c3-4064-acb8-d98c469fecc8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:04.352790 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2b378545-98c3-4064-acb8-d98c469fecc8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:04.381522 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2b378545-98c3-4064-acb8-d98c469fecc8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045837 Apr 05 11:57:04.382075 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 399/843] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:04 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:04.679071 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a5a2a845-b030-4118-83aa-f3923ccfa9e0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:04.680726 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a5a2a845-b030-4118-83aa-f3923ccfa9e0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:04.689179 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5a2a845-b030-4118-83aa-f3923ccfa9e0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:04.689723 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5a2a845-b030-4118-83aa-f3923ccfa9e0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:04.690677 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5a2a845-b030-4118-83aa-f3923ccfa9e0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:04.691198 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5a2a845-b030-4118-83aa-f3923ccfa9e0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:04.726460 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a5a2a845-b030-4118-83aa-f3923ccfa9e0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052996 Apr 05 11:57:04.727054 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 445/844] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:04 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:04.813506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-20dd1dc8-c5cb-4cb8-b66f-d1c6dd614e0b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:04.814431 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-20dd1dc8-c5cb-4cb8-b66f-d1c6dd614e0b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:04.820959 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-20dd1dc8-c5cb-4cb8-b66f-d1c6dd614e0b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:04.821410 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-20dd1dc8-c5cb-4cb8-b66f-d1c6dd614e0b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:04.822172 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-20dd1dc8-c5cb-4cb8-b66f-d1c6dd614e0b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:04.822604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-20dd1dc8-c5cb-4cb8-b66f-d1c6dd614e0b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:04.851654 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-20dd1dc8-c5cb-4cb8-b66f-d1c6dd614e0b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042202 Apr 05 11:57:04.852382 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 400/845] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:04 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:05.394333 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6fd31f01-afa7-461a-96a8-2bcd12be6a25 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:05.395262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6fd31f01-afa7-461a-96a8-2bcd12be6a25 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:05.402047 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6fd31f01-afa7-461a-96a8-2bcd12be6a25 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:05.402501 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6fd31f01-afa7-461a-96a8-2bcd12be6a25 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:05.403270 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6fd31f01-afa7-461a-96a8-2bcd12be6a25 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:05.403707 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6fd31f01-afa7-461a-96a8-2bcd12be6a25 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:05.432603 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6fd31f01-afa7-461a-96a8-2bcd12be6a25 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042517 Apr 05 11:57:05.433153 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 446/846] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:05 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:05.738164 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-372c2968-8067-440a-854c-31fe7219ab59 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:05.739078 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-372c2968-8067-440a-854c-31fe7219ab59 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:05.745761 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-372c2968-8067-440a-854c-31fe7219ab59 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:05.746207 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-372c2968-8067-440a-854c-31fe7219ab59 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:05.746959 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-372c2968-8067-440a-854c-31fe7219ab59 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:05.747392 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-372c2968-8067-440a-854c-31fe7219ab59 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:05.777725 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-372c2968-8067-440a-854c-31fe7219ab59 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043573 Apr 05 11:57:05.778296 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 401/847] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:05 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:05.869632 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b5fed38d-03d5-4aee-aab8-8d25a6b05c4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:05.871105 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b5fed38d-03d5-4aee-aab8-8d25a6b05c4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:05.881186 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b5fed38d-03d5-4aee-aab8-8d25a6b05c4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:05.881895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b5fed38d-03d5-4aee-aab8-8d25a6b05c4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:05.883203 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b5fed38d-03d5-4aee-aab8-8d25a6b05c4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:05.883980 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b5fed38d-03d5-4aee-aab8-8d25a6b05c4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:05.915363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b5fed38d-03d5-4aee-aab8-8d25a6b05c4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052363 Apr 05 11:57:05.915909 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 447/848] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:05 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:06.445644 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3c8725f1-99b5-42d2-8861-9a53ed38de7f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:06.446816 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3c8725f1-99b5-42d2-8861-9a53ed38de7f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:06.455405 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3c8725f1-99b5-42d2-8861-9a53ed38de7f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:06.455835 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3c8725f1-99b5-42d2-8861-9a53ed38de7f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:06.456992 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3c8725f1-99b5-42d2-8861-9a53ed38de7f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:06.457664 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3c8725f1-99b5-42d2-8861-9a53ed38de7f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:06.489927 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3c8725f1-99b5-42d2-8861-9a53ed38de7f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049432 Apr 05 11:57:06.490752 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 402/849] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:06 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:06.793975 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-27baeb16-dced-4f61-b7dd-ac64f7a48824 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:06.795447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-27baeb16-dced-4f61-b7dd-ac64f7a48824 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:06.802743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-27baeb16-dced-4f61-b7dd-ac64f7a48824 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:06.803191 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-27baeb16-dced-4f61-b7dd-ac64f7a48824 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:06.804006 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-27baeb16-dced-4f61-b7dd-ac64f7a48824 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:06.804462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-27baeb16-dced-4f61-b7dd-ac64f7a48824 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:06.834037 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-27baeb16-dced-4f61-b7dd-ac64f7a48824 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046749 Apr 05 11:57:06.834609 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 448/850] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:06 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:06.930075 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-66def990-25d3-4e6c-a38b-50f42498c41f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:06.931545 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-66def990-25d3-4e6c-a38b-50f42498c41f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:06.942688 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66def990-25d3-4e6c-a38b-50f42498c41f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:06.943441 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66def990-25d3-4e6c-a38b-50f42498c41f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:06.944807 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66def990-25d3-4e6c-a38b-50f42498c41f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:06.945524 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66def990-25d3-4e6c-a38b-50f42498c41f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:06.977859 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-66def990-25d3-4e6c-a38b-50f42498c41f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054325 Apr 05 11:57:06.978412 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 403/851] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:06 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:07.505977 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-79bc0650-252c-4bcd-952a-c7a5d406c2fc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:07.507454 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-79bc0650-252c-4bcd-952a-c7a5d406c2fc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:07.516826 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79bc0650-252c-4bcd-952a-c7a5d406c2fc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:07.517264 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79bc0650-252c-4bcd-952a-c7a5d406c2fc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:07.518018 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79bc0650-252c-4bcd-952a-c7a5d406c2fc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:07.518444 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79bc0650-252c-4bcd-952a-c7a5d406c2fc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:07.546837 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-79bc0650-252c-4bcd-952a-c7a5d406c2fc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047662 Apr 05 11:57:07.547363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 449/852] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:07 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:07.846879 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a9ac89a6-0963-4200-856c-92ccc7ddd629 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:07.847849 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a9ac89a6-0963-4200-856c-92ccc7ddd629 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:07.855506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a9ac89a6-0963-4200-856c-92ccc7ddd629 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:07.855960 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a9ac89a6-0963-4200-856c-92ccc7ddd629 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:07.856823 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a9ac89a6-0963-4200-856c-92ccc7ddd629 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:07.857263 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a9ac89a6-0963-4200-856c-92ccc7ddd629 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:07.886735 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a9ac89a6-0963-4200-856c-92ccc7ddd629 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044516 Apr 05 11:57:07.890640 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 404/853] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:07 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:07.992470 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6bf05270-c04b-4ac1-9c5d-5a313a6ab5dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:07.993812 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6bf05270-c04b-4ac1-9c5d-5a313a6ab5dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:08.002227 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6bf05270-c04b-4ac1-9c5d-5a313a6ab5dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:08.002650 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6bf05270-c04b-4ac1-9c5d-5a313a6ab5dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:08.003443 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6bf05270-c04b-4ac1-9c5d-5a313a6ab5dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:08.004116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6bf05270-c04b-4ac1-9c5d-5a313a6ab5dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:08.033553 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6bf05270-c04b-4ac1-9c5d-5a313a6ab5dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046725 Apr 05 11:57:08.034025 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 450/854] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:07 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:08.563173 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ffba166f-a6ab-45f0-8d30-e76183ca814c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:08.564708 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ffba166f-a6ab-45f0-8d30-e76183ca814c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:08.575264 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ffba166f-a6ab-45f0-8d30-e76183ca814c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:08.576009 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ffba166f-a6ab-45f0-8d30-e76183ca814c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:08.577325 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ffba166f-a6ab-45f0-8d30-e76183ca814c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:08.578044 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ffba166f-a6ab-45f0-8d30-e76183ca814c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:08.612877 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ffba166f-a6ab-45f0-8d30-e76183ca814c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056718 Apr 05 11:57:08.613414 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 405/855] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:08 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:08.903201 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d2bf7509-fcd6-45f4-9a68-a25ee543e3f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:08.904734 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d2bf7509-fcd6-45f4-9a68-a25ee543e3f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:08.915196 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d2bf7509-fcd6-45f4-9a68-a25ee543e3f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:08.915949 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d2bf7509-fcd6-45f4-9a68-a25ee543e3f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:08.917507 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d2bf7509-fcd6-45f4-9a68-a25ee543e3f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:08.918233 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d2bf7509-fcd6-45f4-9a68-a25ee543e3f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:08.951075 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d2bf7509-fcd6-45f4-9a68-a25ee543e3f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054854 Apr 05 11:57:08.951646 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 451/856] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:08 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:09.045654 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4b13d721-58f9-46a6-bb17-4693a7c7df08 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:09.046599 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4b13d721-58f9-46a6-bb17-4693a7c7df08 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:09.052787 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4b13d721-58f9-46a6-bb17-4693a7c7df08 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:09.053234 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4b13d721-58f9-46a6-bb17-4693a7c7df08 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:09.054215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4b13d721-58f9-46a6-bb17-4693a7c7df08 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:09.054648 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4b13d721-58f9-46a6-bb17-4693a7c7df08 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:09.083769 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4b13d721-58f9-46a6-bb17-4693a7c7df08 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042192 Apr 05 11:57:09.084369 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 406/857] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:09 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:09.629299 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4ce28906-ddbd-4ce9-8356-d29818f89bd8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:09.630903 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4ce28906-ddbd-4ce9-8356-d29818f89bd8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:09.641185 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4ce28906-ddbd-4ce9-8356-d29818f89bd8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:09.641941 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4ce28906-ddbd-4ce9-8356-d29818f89bd8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:09.642901 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4ce28906-ddbd-4ce9-8356-d29818f89bd8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:09.643333 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4ce28906-ddbd-4ce9-8356-d29818f89bd8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:09.672160 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4ce28906-ddbd-4ce9-8356-d29818f89bd8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049671 Apr 05 11:57:09.672712 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 452/858] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:09 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:09.967564 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3a83dcd4-0462-4753-afdf-42a4286d49fd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:09.969043 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3a83dcd4-0462-4753-afdf-42a4286d49fd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:09.976310 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3a83dcd4-0462-4753-afdf-42a4286d49fd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:09.976761 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3a83dcd4-0462-4753-afdf-42a4286d49fd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:09.977526 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3a83dcd4-0462-4753-afdf-42a4286d49fd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:09.977954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3a83dcd4-0462-4753-afdf-42a4286d49fd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:10.007378 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3a83dcd4-0462-4753-afdf-42a4286d49fd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046849 Apr 05 11:57:10.007921 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 407/859] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:09 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:10.097337 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0c4a6ba5-11c4-4729-8067-6319db5ff57a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:10.098265 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0c4a6ba5-11c4-4729-8067-6319db5ff57a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:10.104965 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0c4a6ba5-11c4-4729-8067-6319db5ff57a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:10.105421 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0c4a6ba5-11c4-4729-8067-6319db5ff57a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:10.106183 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0c4a6ba5-11c4-4729-8067-6319db5ff57a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:10.106605 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0c4a6ba5-11c4-4729-8067-6319db5ff57a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:10.135452 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0c4a6ba5-11c4-4729-8067-6319db5ff57a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043952 Apr 05 11:57:10.135993 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 453/860] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:10 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:10.688764 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6888a450-b186-43f7-89d7-057603ee1ba6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:10.689880 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6888a450-b186-43f7-89d7-057603ee1ba6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:10.696336 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6888a450-b186-43f7-89d7-057603ee1ba6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:10.696781 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6888a450-b186-43f7-89d7-057603ee1ba6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:10.697545 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6888a450-b186-43f7-89d7-057603ee1ba6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:10.697979 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6888a450-b186-43f7-89d7-057603ee1ba6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:10.727104 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6888a450-b186-43f7-89d7-057603ee1ba6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045240 Apr 05 11:57:10.727593 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 408/861] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:10 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:11.023529 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-73b17e16-9359-4bb5-a2f0-214b724bb909 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:11.024950 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-73b17e16-9359-4bb5-a2f0-214b724bb909 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:11.034281 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-73b17e16-9359-4bb5-a2f0-214b724bb909 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:11.034744 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-73b17e16-9359-4bb5-a2f0-214b724bb909 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:11.035551 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-73b17e16-9359-4bb5-a2f0-214b724bb909 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:11.037193 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-73b17e16-9359-4bb5-a2f0-214b724bb909 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:11.065221 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-73b17e16-9359-4bb5-a2f0-214b724bb909 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048454 Apr 05 11:57:11.066106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 454/862] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:11 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:11.150571 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-365c4d5c-c333-4fe9-889a-594c230ee4c6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:11.152045 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-365c4d5c-c333-4fe9-889a-594c230ee4c6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:11.163040 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-365c4d5c-c333-4fe9-889a-594c230ee4c6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:11.163797 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-365c4d5c-c333-4fe9-889a-594c230ee4c6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:11.165123 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-365c4d5c-c333-4fe9-889a-594c230ee4c6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:11.165844 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-365c4d5c-c333-4fe9-889a-594c230ee4c6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:11.197531 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-365c4d5c-c333-4fe9-889a-594c230ee4c6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053687 Apr 05 11:57:11.198083 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 409/863] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:11 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:11.743383 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5a760e41-4cc3-4b1a-b4f3-2435d19516ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:11.744904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5a760e41-4cc3-4b1a-b4f3-2435d19516ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:11.754182 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5a760e41-4cc3-4b1a-b4f3-2435d19516ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:11.754536 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5a760e41-4cc3-4b1a-b4f3-2435d19516ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:11.755294 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5a760e41-4cc3-4b1a-b4f3-2435d19516ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:11.755731 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5a760e41-4cc3-4b1a-b4f3-2435d19516ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:11.785121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5a760e41-4cc3-4b1a-b4f3-2435d19516ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048640 Apr 05 11:57:11.785668 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 455/864] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:11 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:12.082190 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-797d0228-4bfc-49ad-9eb7-0f9992e65abd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:12.082378 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-797d0228-4bfc-49ad-9eb7-0f9992e65abd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:12.090251 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-797d0228-4bfc-49ad-9eb7-0f9992e65abd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:12.090812 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-797d0228-4bfc-49ad-9eb7-0f9992e65abd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:12.093620 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-797d0228-4bfc-49ad-9eb7-0f9992e65abd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:12.093620 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-797d0228-4bfc-49ad-9eb7-0f9992e65abd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:12.126021 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-797d0228-4bfc-49ad-9eb7-0f9992e65abd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051211 Apr 05 11:57:12.126537 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 410/865] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:12 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:12.213167 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-99fac151-9786-491a-8704-f625afa907b7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:12.214669 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-99fac151-9786-491a-8704-f625afa907b7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:12.223398 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-99fac151-9786-491a-8704-f625afa907b7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:12.223845 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-99fac151-9786-491a-8704-f625afa907b7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:12.224652 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-99fac151-9786-491a-8704-f625afa907b7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:12.225086 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-99fac151-9786-491a-8704-f625afa907b7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:12.253761 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-99fac151-9786-491a-8704-f625afa907b7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047219 Apr 05 11:57:12.254303 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 456/866] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:12 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:12.803099 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3985ffd6-d2ab-4868-936d-55cf186edb15 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:12.804512 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3985ffd6-d2ab-4868-936d-55cf186edb15 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:12.814921 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3985ffd6-d2ab-4868-936d-55cf186edb15 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:12.815675 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3985ffd6-d2ab-4868-936d-55cf186edb15 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:12.817007 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3985ffd6-d2ab-4868-936d-55cf186edb15 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:12.817734 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3985ffd6-d2ab-4868-936d-55cf186edb15 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:12.852020 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3985ffd6-d2ab-4868-936d-55cf186edb15 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055995 Apr 05 11:57:12.852625 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 411/867] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:12 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:13.142301 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-163e1850-d8aa-4296-9d24-5665b3b9b34d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:13.143784 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-163e1850-d8aa-4296-9d24-5665b3b9b34d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:13.154342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-163e1850-d8aa-4296-9d24-5665b3b9b34d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:13.155094 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-163e1850-d8aa-4296-9d24-5665b3b9b34d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:13.156409 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-163e1850-d8aa-4296-9d24-5665b3b9b34d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:13.157131 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-163e1850-d8aa-4296-9d24-5665b3b9b34d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:13.186767 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-163e1850-d8aa-4296-9d24-5665b3b9b34d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051123 Apr 05 11:57:13.190721 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 457/868] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:13 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:13.269587 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ffbbf2a0-bd09-4c79-a0bf-d55588720918 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:13.271085 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ffbbf2a0-bd09-4c79-a0bf-d55588720918 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:13.281357 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ffbbf2a0-bd09-4c79-a0bf-d55588720918 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:13.282135 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ffbbf2a0-bd09-4c79-a0bf-d55588720918 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:13.283120 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ffbbf2a0-bd09-4c79-a0bf-d55588720918 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:13.283558 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ffbbf2a0-bd09-4c79-a0bf-d55588720918 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:13.312519 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ffbbf2a0-bd09-4c79-a0bf-d55588720918 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049586 Apr 05 11:57:13.313058 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 412/869] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:13 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:13.867461 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-54195692-9c21-4d99-9c35-aa2b9bdc41f8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:13.868951 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-54195692-9c21-4d99-9c35-aa2b9bdc41f8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:13.878980 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-54195692-9c21-4d99-9c35-aa2b9bdc41f8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:13.879419 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-54195692-9c21-4d99-9c35-aa2b9bdc41f8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:13.880204 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-54195692-9c21-4d99-9c35-aa2b9bdc41f8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:13.880629 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-54195692-9c21-4d99-9c35-aa2b9bdc41f8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:13.909296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-54195692-9c21-4d99-9c35-aa2b9bdc41f8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048828 Apr 05 11:57:13.909920 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 458/870] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:13 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:14.203280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4c585145-3d45-4e09-ac64-af421a23fb78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:14.204819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4c585145-3d45-4e09-ac64-af421a23fb78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:14.212597 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c585145-3d45-4e09-ac64-af421a23fb78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:14.213043 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c585145-3d45-4e09-ac64-af421a23fb78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:14.213828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c585145-3d45-4e09-ac64-af421a23fb78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:14.214272 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c585145-3d45-4e09-ac64-af421a23fb78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:14.243401 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4c585145-3d45-4e09-ac64-af421a23fb78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047378 Apr 05 11:57:14.247411 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 413/871] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:14 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:14.330054 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e71d65dd-6111-4ac7-9328-c0368b066033 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:14.331528 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e71d65dd-6111-4ac7-9328-c0368b066033 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:14.339572 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e71d65dd-6111-4ac7-9328-c0368b066033 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:14.340125 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e71d65dd-6111-4ac7-9328-c0368b066033 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:14.341024 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e71d65dd-6111-4ac7-9328-c0368b066033 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:14.341907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e71d65dd-6111-4ac7-9328-c0368b066033 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:14.373742 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e71d65dd-6111-4ac7-9328-c0368b066033 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050358 Apr 05 11:57:14.374289 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 459/872] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:14 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:14.925733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cab15ba6-01b6-4837-b473-222e6e15bffd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:14.926938 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cab15ba6-01b6-4837-b473-222e6e15bffd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:14.934290 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cab15ba6-01b6-4837-b473-222e6e15bffd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:14.934819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cab15ba6-01b6-4837-b473-222e6e15bffd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:14.935708 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cab15ba6-01b6-4837-b473-222e6e15bffd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:14.936269 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cab15ba6-01b6-4837-b473-222e6e15bffd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:14.968433 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cab15ba6-01b6-4837-b473-222e6e15bffd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049525 Apr 05 11:57:14.968980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 414/873] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:14 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:15.259158 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-33e8a15e-7b24-4f89-b839-6d071584680e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:15.260687 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-33e8a15e-7b24-4f89-b839-6d071584680e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:15.270596 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-33e8a15e-7b24-4f89-b839-6d071584680e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:15.271326 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-33e8a15e-7b24-4f89-b839-6d071584680e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:15.272623 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-33e8a15e-7b24-4f89-b839-6d071584680e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:15.273294 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-33e8a15e-7b24-4f89-b839-6d071584680e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:15.307606 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-33e8a15e-7b24-4f89-b839-6d071584680e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055104 Apr 05 11:57:15.308211 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 460/874] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:15 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:15.387328 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e15a5966-d045-4bc0-9880-d9fa6a3d671e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:15.388666 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e15a5966-d045-4bc0-9880-d9fa6a3d671e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:15.397861 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e15a5966-d045-4bc0-9880-d9fa6a3d671e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:15.398505 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e15a5966-d045-4bc0-9880-d9fa6a3d671e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:15.399583 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e15a5966-d045-4bc0-9880-d9fa6a3d671e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:15.400235 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e15a5966-d045-4bc0-9880-d9fa6a3d671e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:15.432884 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e15a5966-d045-4bc0-9880-d9fa6a3d671e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051296 Apr 05 11:57:15.433442 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 415/875] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:15 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:15.984910 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7446fa5e-9f76-4666-8946-ea878d130713 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:15.986398 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7446fa5e-9f76-4666-8946-ea878d130713 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:15.997044 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7446fa5e-9f76-4666-8946-ea878d130713 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:15.997788 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7446fa5e-9f76-4666-8946-ea878d130713 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:15.999043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7446fa5e-9f76-4666-8946-ea878d130713 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:15.999763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7446fa5e-9f76-4666-8946-ea878d130713 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:16.030549 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7446fa5e-9f76-4666-8946-ea878d130713 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052479 Apr 05 11:57:16.031104 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 461/876] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:15 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:16.324688 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f32214f6-1fb3-4271-ba11-291d4abb9658 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:16.325132 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f32214f6-1fb3-4271-ba11-291d4abb9658 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:16.334241 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f32214f6-1fb3-4271-ba11-291d4abb9658 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:16.334709 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f32214f6-1fb3-4271-ba11-291d4abb9658 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:16.335640 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f32214f6-1fb3-4271-ba11-291d4abb9658 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:16.336179 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f32214f6-1fb3-4271-ba11-291d4abb9658 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:16.366648 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f32214f6-1fb3-4271-ba11-291d4abb9658 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049684 Apr 05 11:57:16.367217 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 416/877] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:16 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:16.448864 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f9d19980-5f22-4701-ade4-faa217656c85 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:16.450351 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f9d19980-5f22-4701-ade4-faa217656c85 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:16.459621 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9d19980-5f22-4701-ade4-faa217656c85 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:16.460095 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9d19980-5f22-4701-ade4-faa217656c85 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:16.460852 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9d19980-5f22-4701-ade4-faa217656c85 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:16.461405 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9d19980-5f22-4701-ade4-faa217656c85 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:16.491215 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f9d19980-5f22-4701-ade4-faa217656c85 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049058 Apr 05 11:57:16.491784 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 462/878] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:16 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:17.046779 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e4dcaafd-f5f2-46a2-9b38-85bbe3b6fa72 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:17.048342 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e4dcaafd-f5f2-46a2-9b38-85bbe3b6fa72 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:17.056004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e4dcaafd-f5f2-46a2-9b38-85bbe3b6fa72 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:17.056499 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e4dcaafd-f5f2-46a2-9b38-85bbe3b6fa72 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:17.057270 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e4dcaafd-f5f2-46a2-9b38-85bbe3b6fa72 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:17.057706 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e4dcaafd-f5f2-46a2-9b38-85bbe3b6fa72 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:17.086660 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e4dcaafd-f5f2-46a2-9b38-85bbe3b6fa72 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046643 Apr 05 11:57:17.087191 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 417/879] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:17 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:17.381394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a0583e26-5653-4b73-aba0-6584a1eb7cd9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:17.382321 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a0583e26-5653-4b73-aba0-6584a1eb7cd9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:17.388915 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a0583e26-5653-4b73-aba0-6584a1eb7cd9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:17.389394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a0583e26-5653-4b73-aba0-6584a1eb7cd9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:17.390169 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a0583e26-5653-4b73-aba0-6584a1eb7cd9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:17.390603 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a0583e26-5653-4b73-aba0-6584a1eb7cd9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:17.421999 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a0583e26-5653-4b73-aba0-6584a1eb7cd9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045937 Apr 05 11:57:17.425739 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 463/880] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:17 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:17.502928 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-65fe51e3-b00d-4c3a-b0a7-0d2600b4b0de tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:17.503886 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-65fe51e3-b00d-4c3a-b0a7-0d2600b4b0de tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:17.510360 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-65fe51e3-b00d-4c3a-b0a7-0d2600b4b0de tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:17.510808 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-65fe51e3-b00d-4c3a-b0a7-0d2600b4b0de tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:17.511568 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-65fe51e3-b00d-4c3a-b0a7-0d2600b4b0de tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:17.512000 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-65fe51e3-b00d-4c3a-b0a7-0d2600b4b0de tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:17.540802 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-65fe51e3-b00d-4c3a-b0a7-0d2600b4b0de tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041852 Apr 05 11:57:17.541354 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 418/881] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:17 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:18.102581 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-019f0aab-3e15-4641-b35e-a22745ab6da7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:18.103508 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-019f0aab-3e15-4641-b35e-a22745ab6da7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:18.109908 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-019f0aab-3e15-4641-b35e-a22745ab6da7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:18.110327 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-019f0aab-3e15-4641-b35e-a22745ab6da7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:18.111138 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-019f0aab-3e15-4641-b35e-a22745ab6da7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:18.111567 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-019f0aab-3e15-4641-b35e-a22745ab6da7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:18.140996 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-019f0aab-3e15-4641-b35e-a22745ab6da7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042711 Apr 05 11:57:18.141578 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 464/882] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:18 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:18.437391 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-507ef52e-6547-4ef1-a9cc-b6665713aa73 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:18.438915 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-507ef52e-6547-4ef1-a9cc-b6665713aa73 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:18.449463 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-507ef52e-6547-4ef1-a9cc-b6665713aa73 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:18.450207 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-507ef52e-6547-4ef1-a9cc-b6665713aa73 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:18.453635 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-507ef52e-6547-4ef1-a9cc-b6665713aa73 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:18.453635 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-507ef52e-6547-4ef1-a9cc-b6665713aa73 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:18.484040 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-507ef52e-6547-4ef1-a9cc-b6665713aa73 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053321 Apr 05 11:57:18.484613 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 419/883] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:18 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:18.554936 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fa8affb1-58fb-4ced-805b-5c3023050d4b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:18.555888 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fa8affb1-58fb-4ced-805b-5c3023050d4b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:18.562769 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fa8affb1-58fb-4ced-805b-5c3023050d4b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:18.563216 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fa8affb1-58fb-4ced-805b-5c3023050d4b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:18.563970 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fa8affb1-58fb-4ced-805b-5c3023050d4b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:18.564439 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fa8affb1-58fb-4ced-805b-5c3023050d4b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:18.593309 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fa8affb1-58fb-4ced-805b-5c3023050d4b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042434 Apr 05 11:57:18.593857 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 465/884] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:18 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:19.156771 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f0494517-205b-4eac-b7f5-6e0add5ba181 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:19.158134 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f0494517-205b-4eac-b7f5-6e0add5ba181 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:19.167641 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f0494517-205b-4eac-b7f5-6e0add5ba181 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:19.168388 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f0494517-205b-4eac-b7f5-6e0add5ba181 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:19.169550 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f0494517-205b-4eac-b7f5-6e0add5ba181 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:19.170223 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f0494517-205b-4eac-b7f5-6e0add5ba181 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:19.200952 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f0494517-205b-4eac-b7f5-6e0add5ba181 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050471 Apr 05 11:57:19.201502 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 420/885] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:19 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:19.495145 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-64d64829-1c7c-4ae4-8de9-90267f05f25a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:19.496165 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-64d64829-1c7c-4ae4-8de9-90267f05f25a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:19.502822 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-64d64829-1c7c-4ae4-8de9-90267f05f25a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:19.503461 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-64d64829-1c7c-4ae4-8de9-90267f05f25a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:19.504660 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-64d64829-1c7c-4ae4-8de9-90267f05f25a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:19.505095 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-64d64829-1c7c-4ae4-8de9-90267f05f25a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:19.534283 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-64d64829-1c7c-4ae4-8de9-90267f05f25a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043019 Apr 05 11:57:19.534822 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 466/886] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:19 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:19.609925 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-03175c2b-edd8-41ab-b06f-10ad88c6d302 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:19.611423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-03175c2b-edd8-41ab-b06f-10ad88c6d302 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:19.622119 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03175c2b-edd8-41ab-b06f-10ad88c6d302 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:19.623348 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03175c2b-edd8-41ab-b06f-10ad88c6d302 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:19.624693 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03175c2b-edd8-41ab-b06f-10ad88c6d302 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:19.625612 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03175c2b-edd8-41ab-b06f-10ad88c6d302 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:19.655894 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-03175c2b-edd8-41ab-b06f-10ad88c6d302 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052976 Apr 05 11:57:19.656606 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 421/887] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:19 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:20.217629 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ef4470e8-9b2f-47c6-9751-3a5e21e070b0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:20.219102 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ef4470e8-9b2f-47c6-9751-3a5e21e070b0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:20.227503 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ef4470e8-9b2f-47c6-9751-3a5e21e070b0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:20.227884 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ef4470e8-9b2f-47c6-9751-3a5e21e070b0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:20.228672 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ef4470e8-9b2f-47c6-9751-3a5e21e070b0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:20.229109 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ef4470e8-9b2f-47c6-9751-3a5e21e070b0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:20.258038 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ef4470e8-9b2f-47c6-9751-3a5e21e070b0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047523 Apr 05 11:57:20.258575 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 467/888] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:20 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:20.549508 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-19a55f63-c28a-4ef2-a821-fc967f81e196 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:20.551269 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-19a55f63-c28a-4ef2-a821-fc967f81e196 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:20.558460 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-19a55f63-c28a-4ef2-a821-fc967f81e196 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:20.558954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-19a55f63-c28a-4ef2-a821-fc967f81e196 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:20.559835 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-19a55f63-c28a-4ef2-a821-fc967f81e196 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:20.560382 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-19a55f63-c28a-4ef2-a821-fc967f81e196 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:20.591846 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-19a55f63-c28a-4ef2-a821-fc967f81e196 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048623 Apr 05 11:57:20.592454 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 422/889] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:20 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:20.668931 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-82a65d34-7e72-43ee-a083-e21a38c2b33b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:20.669859 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-82a65d34-7e72-43ee-a083-e21a38c2b33b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:20.675945 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-82a65d34-7e72-43ee-a083-e21a38c2b33b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:20.676685 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-82a65d34-7e72-43ee-a083-e21a38c2b33b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:20.677462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-82a65d34-7e72-43ee-a083-e21a38c2b33b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:20.677898 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-82a65d34-7e72-43ee-a083-e21a38c2b33b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:20.708743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-82a65d34-7e72-43ee-a083-e21a38c2b33b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043793 Apr 05 11:57:20.709302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 468/890] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:20 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:21.274386 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-83e0840e-242a-40f3-b1a0-18db9bfecc39 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:21.275861 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-83e0840e-242a-40f3-b1a0-18db9bfecc39 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:21.286647 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-83e0840e-242a-40f3-b1a0-18db9bfecc39 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:21.287396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-83e0840e-242a-40f3-b1a0-18db9bfecc39 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:21.288699 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-83e0840e-242a-40f3-b1a0-18db9bfecc39 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:21.289419 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-83e0840e-242a-40f3-b1a0-18db9bfecc39 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:21.322584 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-83e0840e-242a-40f3-b1a0-18db9bfecc39 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055105 Apr 05 11:57:21.323147 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 423/891] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:21 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:21.607407 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-95312e16-037c-43ba-986e-79b23a6e199a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:21.608875 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-95312e16-037c-43ba-986e-79b23a6e199a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:21.619691 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95312e16-037c-43ba-986e-79b23a6e199a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:21.620449 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95312e16-037c-43ba-986e-79b23a6e199a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:21.621699 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95312e16-037c-43ba-986e-79b23a6e199a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:21.622407 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95312e16-037c-43ba-986e-79b23a6e199a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:21.654244 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-95312e16-037c-43ba-986e-79b23a6e199a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053496 Apr 05 11:57:21.654818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 469/892] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:21 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:21.720794 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b5ed21e3-db4c-4d48-af54-f4bfd9f2a345 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:21.721720 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b5ed21e3-db4c-4d48-af54-f4bfd9f2a345 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:21.728174 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b5ed21e3-db4c-4d48-af54-f4bfd9f2a345 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:21.728627 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b5ed21e3-db4c-4d48-af54-f4bfd9f2a345 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:21.729399 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b5ed21e3-db4c-4d48-af54-f4bfd9f2a345 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:21.729832 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b5ed21e3-db4c-4d48-af54-f4bfd9f2a345 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:21.759740 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b5ed21e3-db4c-4d48-af54-f4bfd9f2a345 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043257 Apr 05 11:57:21.760459 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 424/893] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:21 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:22.339317 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ca2ab1af-ea16-4904-a302-85739c47bab1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:22.340876 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ca2ab1af-ea16-4904-a302-85739c47bab1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:22.350282 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ca2ab1af-ea16-4904-a302-85739c47bab1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:22.350727 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ca2ab1af-ea16-4904-a302-85739c47bab1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:22.351488 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ca2ab1af-ea16-4904-a302-85739c47bab1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:22.351915 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ca2ab1af-ea16-4904-a302-85739c47bab1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:22.382797 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ca2ab1af-ea16-4904-a302-85739c47bab1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050344 Apr 05 11:57:22.383732 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 470/894] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:22 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:22.670674 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-061d7689-408a-44c9-ac80-1b10d1c9df91 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:22.672025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-061d7689-408a-44c9-ac80-1b10d1c9df91 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:22.681240 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-061d7689-408a-44c9-ac80-1b10d1c9df91 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:22.681789 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-061d7689-408a-44c9-ac80-1b10d1c9df91 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:22.682612 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-061d7689-408a-44c9-ac80-1b10d1c9df91 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:22.683279 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-061d7689-408a-44c9-ac80-1b10d1c9df91 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:22.714873 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-061d7689-408a-44c9-ac80-1b10d1c9df91 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051126 Apr 05 11:57:22.715595 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 425/895] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:22 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:22.771535 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c9b0b5c3-b068-411c-85b2-59f5041d449c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:22.772898 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c9b0b5c3-b068-411c-85b2-59f5041d449c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:22.781394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9b0b5c3-b068-411c-85b2-59f5041d449c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:22.782101 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9b0b5c3-b068-411c-85b2-59f5041d449c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:22.783101 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9b0b5c3-b068-411c-85b2-59f5041d449c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:22.783669 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9b0b5c3-b068-411c-85b2-59f5041d449c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:22.816960 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c9b0b5c3-b068-411c-85b2-59f5041d449c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049904 Apr 05 11:57:22.817536 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 471/896] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:22 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:23.398245 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a547e2b9-53b8-4eea-9e5f-7fe25d05596f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:23.399188 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a547e2b9-53b8-4eea-9e5f-7fe25d05596f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:23.405626 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a547e2b9-53b8-4eea-9e5f-7fe25d05596f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:23.406074 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a547e2b9-53b8-4eea-9e5f-7fe25d05596f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:23.406839 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a547e2b9-53b8-4eea-9e5f-7fe25d05596f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:23.407270 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a547e2b9-53b8-4eea-9e5f-7fe25d05596f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:23.436251 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a547e2b9-53b8-4eea-9e5f-7fe25d05596f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042803 Apr 05 11:57:23.437129 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 426/897] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:23 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:23.728034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-135c1441-a550-47c6-bcfa-8ce59892ff84 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:23.728475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-135c1441-a550-47c6-bcfa-8ce59892ff84 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:23.734940 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-135c1441-a550-47c6-bcfa-8ce59892ff84 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:23.735389 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-135c1441-a550-47c6-bcfa-8ce59892ff84 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:23.736189 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-135c1441-a550-47c6-bcfa-8ce59892ff84 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:23.736623 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-135c1441-a550-47c6-bcfa-8ce59892ff84 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:23.766144 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-135c1441-a550-47c6-bcfa-8ce59892ff84 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042754 Apr 05 11:57:23.766708 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 472/898] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:23 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:23.829875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b4910dce-5ff1-40dd-8ac5-4cf8692ff71c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:23.830807 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b4910dce-5ff1-40dd-8ac5-4cf8692ff71c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:23.837303 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b4910dce-5ff1-40dd-8ac5-4cf8692ff71c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:23.837751 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b4910dce-5ff1-40dd-8ac5-4cf8692ff71c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:23.838510 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b4910dce-5ff1-40dd-8ac5-4cf8692ff71c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:23.838944 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b4910dce-5ff1-40dd-8ac5-4cf8692ff71c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:23.870415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b4910dce-5ff1-40dd-8ac5-4cf8692ff71c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044682 Apr 05 11:57:23.871344 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 427/899] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:23 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:24.451307 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d8334c2b-d8ac-4fca-b428-da1db20fcce4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:24.452822 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d8334c2b-d8ac-4fca-b428-da1db20fcce4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:24.461718 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d8334c2b-d8ac-4fca-b428-da1db20fcce4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:24.462466 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d8334c2b-d8ac-4fca-b428-da1db20fcce4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:24.462900 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d8334c2b-d8ac-4fca-b428-da1db20fcce4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:24.463321 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d8334c2b-d8ac-4fca-b428-da1db20fcce4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:24.492352 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d8334c2b-d8ac-4fca-b428-da1db20fcce4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047806 Apr 05 11:57:24.493402 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 473/900] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:24 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:24.781869 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a384f3a6-8144-485c-97dd-50cae7eb149d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:24.784000 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a384f3a6-8144-485c-97dd-50cae7eb149d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:24.791041 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a384f3a6-8144-485c-97dd-50cae7eb149d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:24.791486 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a384f3a6-8144-485c-97dd-50cae7eb149d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:24.792314 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a384f3a6-8144-485c-97dd-50cae7eb149d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:24.792719 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a384f3a6-8144-485c-97dd-50cae7eb149d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:24.821640 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a384f3a6-8144-485c-97dd-50cae7eb149d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046555 Apr 05 11:57:24.822209 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 428/901] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:24 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:24.883633 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-95d7a29b-7fc7-4679-bf17-0c8cf38e6c8d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:24.884585 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-95d7a29b-7fc7-4679-bf17-0c8cf38e6c8d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:24.891392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95d7a29b-7fc7-4679-bf17-0c8cf38e6c8d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:24.891834 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95d7a29b-7fc7-4679-bf17-0c8cf38e6c8d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:24.892627 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95d7a29b-7fc7-4679-bf17-0c8cf38e6c8d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:24.893051 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95d7a29b-7fc7-4679-bf17-0c8cf38e6c8d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:24.921659 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-95d7a29b-7fc7-4679-bf17-0c8cf38e6c8d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042101 Apr 05 11:57:24.922196 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 474/902] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:24 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:25.507939 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7008f493-4aed-4bd3-9e86-adff9b703ad4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:25.509366 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7008f493-4aed-4bd3-9e86-adff9b703ad4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:25.519136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7008f493-4aed-4bd3-9e86-adff9b703ad4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:25.519828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7008f493-4aed-4bd3-9e86-adff9b703ad4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:25.521060 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7008f493-4aed-4bd3-9e86-adff9b703ad4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:25.521812 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7008f493-4aed-4bd3-9e86-adff9b703ad4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:25.550412 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7008f493-4aed-4bd3-9e86-adff9b703ad4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048821 Apr 05 11:57:25.550952 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 429/903] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:25 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:25.838293 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fdbe6a15-fb96-423d-8703-e83b0d0f66cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:25.839710 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fdbe6a15-fb96-423d-8703-e83b0d0f66cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:25.852162 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fdbe6a15-fb96-423d-8703-e83b0d0f66cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:25.852162 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fdbe6a15-fb96-423d-8703-e83b0d0f66cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:25.852162 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fdbe6a15-fb96-423d-8703-e83b0d0f66cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:25.852528 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fdbe6a15-fb96-423d-8703-e83b0d0f66cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:25.881617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fdbe6a15-fb96-423d-8703-e83b0d0f66cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050445 Apr 05 11:57:25.882188 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 475/904] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:25 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:25.933437 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1d199309-364e-48ad-8418-4df2c63311a0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:25.934375 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1d199309-364e-48ad-8418-4df2c63311a0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:25.940797 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1d199309-364e-48ad-8418-4df2c63311a0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:25.941244 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1d199309-364e-48ad-8418-4df2c63311a0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:25.942011 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1d199309-364e-48ad-8418-4df2c63311a0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:25.942445 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1d199309-364e-48ad-8418-4df2c63311a0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:25.971811 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1d199309-364e-48ad-8418-4df2c63311a0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042322 Apr 05 11:57:25.972405 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 430/905] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:25 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:26.566512 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6cf1f41f-3068-4a3f-981d-21e9ce6ab39a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:26.567992 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6cf1f41f-3068-4a3f-981d-21e9ce6ab39a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:26.575061 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6cf1f41f-3068-4a3f-981d-21e9ce6ab39a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:26.575533 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6cf1f41f-3068-4a3f-981d-21e9ce6ab39a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:26.576372 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6cf1f41f-3068-4a3f-981d-21e9ce6ab39a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:26.576860 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6cf1f41f-3068-4a3f-981d-21e9ce6ab39a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:26.607626 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6cf1f41f-3068-4a3f-981d-21e9ce6ab39a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047863 Apr 05 11:57:26.608203 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 476/906] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:26 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:26.897811 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-efe24dac-544e-4ac9-8f13-fe6e1d3e3e9c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:26.898570 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-efe24dac-544e-4ac9-8f13-fe6e1d3e3e9c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:26.905480 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-efe24dac-544e-4ac9-8f13-fe6e1d3e3e9c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:26.905959 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-efe24dac-544e-4ac9-8f13-fe6e1d3e3e9c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:26.906807 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-efe24dac-544e-4ac9-8f13-fe6e1d3e3e9c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:26.907263 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-efe24dac-544e-4ac9-8f13-fe6e1d3e3e9c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:26.937966 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-efe24dac-544e-4ac9-8f13-fe6e1d3e3e9c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046959 Apr 05 11:57:26.938951 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 431/907] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:26 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:26.983030 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d92046ef-7ba4-49c2-9fb3-9109cef92c62 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:26.983963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d92046ef-7ba4-49c2-9fb3-9109cef92c62 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:26.990724 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d92046ef-7ba4-49c2-9fb3-9109cef92c62 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:26.991184 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d92046ef-7ba4-49c2-9fb3-9109cef92c62 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:26.992040 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d92046ef-7ba4-49c2-9fb3-9109cef92c62 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:26.992511 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d92046ef-7ba4-49c2-9fb3-9109cef92c62 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:27.022881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d92046ef-7ba4-49c2-9fb3-9109cef92c62 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043813 Apr 05 11:57:27.023456 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 477/908] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:26 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:27.620934 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cadfc0ce-4e1b-4642-b089-a155ba9f94c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:27.621854 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cadfc0ce-4e1b-4642-b089-a155ba9f94c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:27.628255 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cadfc0ce-4e1b-4642-b089-a155ba9f94c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:27.628713 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cadfc0ce-4e1b-4642-b089-a155ba9f94c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:27.629471 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cadfc0ce-4e1b-4642-b089-a155ba9f94c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:27.630175 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cadfc0ce-4e1b-4642-b089-a155ba9f94c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:27.658567 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cadfc0ce-4e1b-4642-b089-a155ba9f94c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041816 Apr 05 11:57:27.659103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 432/909] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:27 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:27.954949 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-64a48254-9c29-4c36-a6a4-f6a3e17a1b40 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:27.956530 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-64a48254-9c29-4c36-a6a4-f6a3e17a1b40 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:27.967570 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-64a48254-9c29-4c36-a6a4-f6a3e17a1b40 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:27.968372 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-64a48254-9c29-4c36-a6a4-f6a3e17a1b40 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:27.969630 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-64a48254-9c29-4c36-a6a4-f6a3e17a1b40 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:27.970398 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-64a48254-9c29-4c36-a6a4-f6a3e17a1b40 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:28.001015 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-64a48254-9c29-4c36-a6a4-f6a3e17a1b40 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052866 Apr 05 11:57:28.005015 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 478/910] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:27 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:28.035355 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2d4a1b47-eb78-4728-b3c3-f93f921a74d2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:28.036310 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2d4a1b47-eb78-4728-b3c3-f93f921a74d2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:28.042764 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2d4a1b47-eb78-4728-b3c3-f93f921a74d2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:28.043206 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2d4a1b47-eb78-4728-b3c3-f93f921a74d2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:28.043956 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2d4a1b47-eb78-4728-b3c3-f93f921a74d2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:28.044409 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2d4a1b47-eb78-4728-b3c3-f93f921a74d2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:28.072213 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2d4a1b47-eb78-4728-b3c3-f93f921a74d2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041116 Apr 05 11:57:28.072811 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 433/911] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:28 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:28.673826 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c5aba419-8608-4464-8e11-4212bb992c62 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:28.675303 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c5aba419-8608-4464-8e11-4212bb992c62 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:28.686008 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c5aba419-8608-4464-8e11-4212bb992c62 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:28.686795 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c5aba419-8608-4464-8e11-4212bb992c62 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:28.688013 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c5aba419-8608-4464-8e11-4212bb992c62 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:28.688777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c5aba419-8608-4464-8e11-4212bb992c62 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:28.726425 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c5aba419-8608-4464-8e11-4212bb992c62 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059230 Apr 05 11:57:28.726890 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 479/912] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:28 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:29.020106 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d138b1cf-1cbc-4b80-b0e8-80d2d8c49237 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:29.021659 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d138b1cf-1cbc-4b80-b0e8-80d2d8c49237 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:29.029875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d138b1cf-1cbc-4b80-b0e8-80d2d8c49237 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:29.030348 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d138b1cf-1cbc-4b80-b0e8-80d2d8c49237 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:29.031177 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d138b1cf-1cbc-4b80-b0e8-80d2d8c49237 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:29.031623 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d138b1cf-1cbc-4b80-b0e8-80d2d8c49237 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:29.062313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d138b1cf-1cbc-4b80-b0e8-80d2d8c49237 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050838 Apr 05 11:57:29.062313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 434/913] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:29 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:29.083166 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-672b132b-8f2e-4608-a0ce-a92c2597bccd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:29.084060 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-672b132b-8f2e-4608-a0ce-a92c2597bccd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:29.090530 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-672b132b-8f2e-4608-a0ce-a92c2597bccd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:29.091339 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-672b132b-8f2e-4608-a0ce-a92c2597bccd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:29.092143 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-672b132b-8f2e-4608-a0ce-a92c2597bccd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:29.092583 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-672b132b-8f2e-4608-a0ce-a92c2597bccd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:29.120576 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-672b132b-8f2e-4608-a0ce-a92c2597bccd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041472 Apr 05 11:57:29.121117 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 480/914] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:29 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:29.739956 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-358f6a92-fd8e-4f7a-b1c9-88261c77b01c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:29.741111 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-358f6a92-fd8e-4f7a-b1c9-88261c77b01c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:29.748093 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-358f6a92-fd8e-4f7a-b1c9-88261c77b01c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:29.748477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-358f6a92-fd8e-4f7a-b1c9-88261c77b01c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:29.749233 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-358f6a92-fd8e-4f7a-b1c9-88261c77b01c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:29.749657 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-358f6a92-fd8e-4f7a-b1c9-88261c77b01c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:29.778558 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-358f6a92-fd8e-4f7a-b1c9-88261c77b01c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043628 Apr 05 11:57:29.779109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 435/915] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:29 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:30.075546 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-71fff220-bef1-4802-af1b-a424d511380b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:30.076668 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-71fff220-bef1-4802-af1b-a424d511380b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:30.084008 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71fff220-bef1-4802-af1b-a424d511380b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:30.084708 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71fff220-bef1-4802-af1b-a424d511380b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:30.085442 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71fff220-bef1-4802-af1b-a424d511380b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:30.085941 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71fff220-bef1-4802-af1b-a424d511380b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:30.118438 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-71fff220-bef1-4802-af1b-a424d511380b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047539 Apr 05 11:57:30.122427 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 481/916] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:30 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:30.131684 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9532a551-5cd1-42e6-b642-ac3ea6888019 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:30.132780 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9532a551-5cd1-42e6-b642-ac3ea6888019 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:30.139321 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9532a551-5cd1-42e6-b642-ac3ea6888019 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:30.139780 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9532a551-5cd1-42e6-b642-ac3ea6888019 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:30.140567 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9532a551-5cd1-42e6-b642-ac3ea6888019 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:30.141002 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9532a551-5cd1-42e6-b642-ac3ea6888019 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:30.169153 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9532a551-5cd1-42e6-b642-ac3ea6888019 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041412 Apr 05 11:57:30.169714 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 436/917] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:30 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:30.794915 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c47af74c-820e-40bf-a1d7-38cfebaeb208 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:30.796334 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c47af74c-820e-40bf-a1d7-38cfebaeb208 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:30.806262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c47af74c-820e-40bf-a1d7-38cfebaeb208 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:30.806710 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c47af74c-820e-40bf-a1d7-38cfebaeb208 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:30.807474 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c47af74c-820e-40bf-a1d7-38cfebaeb208 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:30.807904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c47af74c-820e-40bf-a1d7-38cfebaeb208 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:30.839349 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c47af74c-820e-40bf-a1d7-38cfebaeb208 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051133 Apr 05 11:57:30.840152 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 482/918] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:30 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:31.130599 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ac4447d9-aff5-4ccc-bf90-d81a27e2701d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:31.131273 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ac4447d9-aff5-4ccc-bf90-d81a27e2701d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:31.138191 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ac4447d9-aff5-4ccc-bf90-d81a27e2701d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:31.138765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ac4447d9-aff5-4ccc-bf90-d81a27e2701d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:31.139395 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ac4447d9-aff5-4ccc-bf90-d81a27e2701d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:31.139822 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ac4447d9-aff5-4ccc-bf90-d81a27e2701d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:31.169926 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ac4447d9-aff5-4ccc-bf90-d81a27e2701d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043591 Apr 05 11:57:31.173821 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 437/919] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:31 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:31.181846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6131abf4-d924-4496-8fa4-3c9c2a83854a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:31.183447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6131abf4-d924-4496-8fa4-3c9c2a83854a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:31.190344 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6131abf4-d924-4496-8fa4-3c9c2a83854a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:31.190799 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6131abf4-d924-4496-8fa4-3c9c2a83854a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:31.191577 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6131abf4-d924-4496-8fa4-3c9c2a83854a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:31.192014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6131abf4-d924-4496-8fa4-3c9c2a83854a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:31.220740 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6131abf4-d924-4496-8fa4-3c9c2a83854a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043231 Apr 05 11:57:31.221291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 483/920] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:31 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:31.857889 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-087139a6-e2a7-4aec-af73-7f75d0ae38a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:31.859241 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-087139a6-e2a7-4aec-af73-7f75d0ae38a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:31.869622 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-087139a6-e2a7-4aec-af73-7f75d0ae38a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:31.870366 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-087139a6-e2a7-4aec-af73-7f75d0ae38a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:31.871618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-087139a6-e2a7-4aec-af73-7f75d0ae38a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:31.872403 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-087139a6-e2a7-4aec-af73-7f75d0ae38a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:31.905389 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-087139a6-e2a7-4aec-af73-7f75d0ae38a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054527 Apr 05 11:57:31.905978 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 438/921] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:31 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:32.186090 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f88ef925-32e8-4339-ac22-e6e33e3dabab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:32.187696 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f88ef925-32e8-4339-ac22-e6e33e3dabab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:32.198369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f88ef925-32e8-4339-ac22-e6e33e3dabab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:32.199125 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f88ef925-32e8-4339-ac22-e6e33e3dabab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:32.200810 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f88ef925-32e8-4339-ac22-e6e33e3dabab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:32.201552 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f88ef925-32e8-4339-ac22-e6e33e3dabab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:32.232545 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d6f1a5c5-2ad5-45b4-a918-ef86832020d5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:32.233468 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d6f1a5c5-2ad5-45b4-a918-ef86832020d5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:32.244772 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f88ef925-32e8-4339-ac22-e6e33e3dabab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056724 Apr 05 11:57:32.244886 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d6f1a5c5-2ad5-45b4-a918-ef86832020d5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:32.244886 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d6f1a5c5-2ad5-45b4-a918-ef86832020d5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:32.245067 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 484/922] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:32 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:32.245165 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d6f1a5c5-2ad5-45b4-a918-ef86832020d5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:32.245165 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d6f1a5c5-2ad5-45b4-a918-ef86832020d5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:32.269669 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d6f1a5c5-2ad5-45b4-a918-ef86832020d5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041095 Apr 05 11:57:32.270220 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 439/923] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:32 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:32.921863 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fcdf49b0-9f83-449b-96a1-83f2e63eb2fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:32.923253 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fcdf49b0-9f83-449b-96a1-83f2e63eb2fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:32.931994 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fcdf49b0-9f83-449b-96a1-83f2e63eb2fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:32.932462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fcdf49b0-9f83-449b-96a1-83f2e63eb2fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:32.933221 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fcdf49b0-9f83-449b-96a1-83f2e63eb2fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:32.933649 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fcdf49b0-9f83-449b-96a1-83f2e63eb2fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:32.962072 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fcdf49b0-9f83-449b-96a1-83f2e63eb2fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047114 Apr 05 11:57:32.962612 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 485/924] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:32 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:33.252237 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e011bae5-1f13-413f-a5d7-0909f605481d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:33.254018 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e011bae5-1f13-413f-a5d7-0909f605481d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:33.262210 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e011bae5-1f13-413f-a5d7-0909f605481d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:33.262669 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e011bae5-1f13-413f-a5d7-0909f605481d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:33.263445 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e011bae5-1f13-413f-a5d7-0909f605481d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:33.263876 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e011bae5-1f13-413f-a5d7-0909f605481d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:33.281425 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-539899bc-0428-4939-a536-cdd288078812 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:33.282368 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-539899bc-0428-4939-a536-cdd288078812 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:33.289073 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-539899bc-0428-4939-a536-cdd288078812 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:33.289518 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-539899bc-0428-4939-a536-cdd288078812 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:33.290283 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-539899bc-0428-4939-a536-cdd288078812 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:33.290721 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-539899bc-0428-4939-a536-cdd288078812 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:33.293682 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e011bae5-1f13-413f-a5d7-0909f605481d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048119 Apr 05 11:57:33.295147 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 440/925] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:33 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:33.319769 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-539899bc-0428-4939-a536-cdd288078812 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042299 Apr 05 11:57:33.320676 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 486/926] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:33 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:33.978489 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4bdabf02-c6a7-4c8a-ad7e-99341044ab47 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:33.979538 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4bdabf02-c6a7-4c8a-ad7e-99341044ab47 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:33.986862 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4bdabf02-c6a7-4c8a-ad7e-99341044ab47 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:33.987384 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4bdabf02-c6a7-4c8a-ad7e-99341044ab47 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:33.988330 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4bdabf02-c6a7-4c8a-ad7e-99341044ab47 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:33.988872 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4bdabf02-c6a7-4c8a-ad7e-99341044ab47 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:34.021313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4bdabf02-c6a7-4c8a-ad7e-99341044ab47 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049550 Apr 05 11:57:34.021859 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 441/927] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:33 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:34.309235 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5cb5d9f3-99fa-4d0a-a4ba-df3fcf3991c8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:34.310323 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5cb5d9f3-99fa-4d0a-a4ba-df3fcf3991c8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:34.318063 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5cb5d9f3-99fa-4d0a-a4ba-df3fcf3991c8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:34.318581 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5cb5d9f3-99fa-4d0a-a4ba-df3fcf3991c8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:34.319472 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5cb5d9f3-99fa-4d0a-a4ba-df3fcf3991c8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:34.319976 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5cb5d9f3-99fa-4d0a-a4ba-df3fcf3991c8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:34.332445 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-79b1e0d0-8268-4acf-84fb-b1efbe01c7da tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:34.333521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-79b1e0d0-8268-4acf-84fb-b1efbe01c7da tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:34.340999 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79b1e0d0-8268-4acf-84fb-b1efbe01c7da tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:34.341449 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79b1e0d0-8268-4acf-84fb-b1efbe01c7da tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:34.342193 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79b1e0d0-8268-4acf-84fb-b1efbe01c7da tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:34.342621 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79b1e0d0-8268-4acf-84fb-b1efbe01c7da tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:34.352041 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5cb5d9f3-99fa-4d0a-a4ba-df3fcf3991c8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048906 Apr 05 11:57:34.356355 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 487/928] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:34 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:34.373768 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-79b1e0d0-8268-4acf-84fb-b1efbe01c7da tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046318 Apr 05 11:57:34.374325 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 442/929] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:34 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:35.037415 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-df01877d-8026-493e-bc76-17f6cb1e9dda tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:35.038884 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-df01877d-8026-493e-bc76-17f6cb1e9dda tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:35.049113 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-df01877d-8026-493e-bc76-17f6cb1e9dda tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:35.049879 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-df01877d-8026-493e-bc76-17f6cb1e9dda tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:35.051121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-df01877d-8026-493e-bc76-17f6cb1e9dda tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:35.051836 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-df01877d-8026-493e-bc76-17f6cb1e9dda tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:35.082392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-df01877d-8026-493e-bc76-17f6cb1e9dda tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051675 Apr 05 11:57:35.082934 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 488/930] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:35 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:35.368450 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cd9cd473-5341-4746-9d49-912fd316ca99 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:35.369713 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cd9cd473-5341-4746-9d49-912fd316ca99 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:35.380598 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd9cd473-5341-4746-9d49-912fd316ca99 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:35.380966 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd9cd473-5341-4746-9d49-912fd316ca99 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:35.382374 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd9cd473-5341-4746-9d49-912fd316ca99 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:35.383120 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd9cd473-5341-4746-9d49-912fd316ca99 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:35.388300 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0c305536-d8a6-4567-9e14-64c9a2624c29 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:35.388882 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0c305536-d8a6-4567-9e14-64c9a2624c29 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:35.396299 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0c305536-d8a6-4567-9e14-64c9a2624c29 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:35.396769 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0c305536-d8a6-4567-9e14-64c9a2624c29 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:35.397523 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0c305536-d8a6-4567-9e14-64c9a2624c29 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:35.397956 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0c305536-d8a6-4567-9e14-64c9a2624c29 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:35.412740 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cd9cd473-5341-4746-9d49-912fd316ca99 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050969 Apr 05 11:57:35.413438 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 443/931] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:35 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:35.429007 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0c305536-d8a6-4567-9e14-64c9a2624c29 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045828 Apr 05 11:57:35.429775 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 489/932] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:35 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:36.098812 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5b50aac5-1818-4a5a-b4d5-b139301ec50c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:36.100318 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5b50aac5-1818-4a5a-b4d5-b139301ec50c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:36.107996 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5b50aac5-1818-4a5a-b4d5-b139301ec50c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:36.108506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5b50aac5-1818-4a5a-b4d5-b139301ec50c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:36.109315 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5b50aac5-1818-4a5a-b4d5-b139301ec50c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:36.109778 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5b50aac5-1818-4a5a-b4d5-b139301ec50c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:36.139883 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5b50aac5-1818-4a5a-b4d5-b139301ec50c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047861 Apr 05 11:57:36.140473 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 444/933] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:36 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:36.427027 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-befca73b-c08d-430b-85a5-b6a24e4969d9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:36.428028 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-befca73b-c08d-430b-85a5-b6a24e4969d9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:36.435383 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-befca73b-c08d-430b-85a5-b6a24e4969d9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:36.436718 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-befca73b-c08d-430b-85a5-b6a24e4969d9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:36.437685 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-befca73b-c08d-430b-85a5-b6a24e4969d9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:36.438274 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-befca73b-c08d-430b-85a5-b6a24e4969d9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:36.441267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-78856019-f441-40d9-83ba-ef953f90d103 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:36.444547 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-78856019-f441-40d9-83ba-ef953f90d103 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:36.451413 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-78856019-f441-40d9-83ba-ef953f90d103 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:36.451902 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-78856019-f441-40d9-83ba-ef953f90d103 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:36.452919 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-78856019-f441-40d9-83ba-ef953f90d103 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:36.453587 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-78856019-f441-40d9-83ba-ef953f90d103 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:36.469565 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-befca73b-c08d-430b-85a5-b6a24e4969d9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048105 Apr 05 11:57:36.470457 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 490/934] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:36 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:36.483088 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-78856019-f441-40d9-83ba-ef953f90d103 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046278 Apr 05 11:57:36.483645 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 445/935] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:36 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:37.156303 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-84c308aa-625e-490a-8410-227df42461ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:37.157723 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-84c308aa-625e-490a-8410-227df42461ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:37.167955 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84c308aa-625e-490a-8410-227df42461ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:37.168805 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84c308aa-625e-490a-8410-227df42461ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:37.170135 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84c308aa-625e-490a-8410-227df42461ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:37.170854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84c308aa-625e-490a-8410-227df42461ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:37.204535 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-84c308aa-625e-490a-8410-227df42461ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055077 Apr 05 11:57:37.205087 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 491/936] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:37 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:37.482675 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-66ceba26-6ea5-48cc-8a15-7ef14ec4edea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:37.483866 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-66ceba26-6ea5-48cc-8a15-7ef14ec4edea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:37.492136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66ceba26-6ea5-48cc-8a15-7ef14ec4edea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:37.492711 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66ceba26-6ea5-48cc-8a15-7ef14ec4edea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:37.493739 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66ceba26-6ea5-48cc-8a15-7ef14ec4edea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:37.494181 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66ceba26-6ea5-48cc-8a15-7ef14ec4edea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:37.496002 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-17b2c59e-6f55-4ed2-9985-9d61f532d51d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:37.497036 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-17b2c59e-6f55-4ed2-9985-9d61f532d51d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:37.503988 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-17b2c59e-6f55-4ed2-9985-9d61f532d51d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:37.504464 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-17b2c59e-6f55-4ed2-9985-9d61f532d51d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:37.505318 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-17b2c59e-6f55-4ed2-9985-9d61f532d51d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:37.505782 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-17b2c59e-6f55-4ed2-9985-9d61f532d51d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:37.524845 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-66ceba26-6ea5-48cc-8a15-7ef14ec4edea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047108 Apr 05 11:57:37.525591 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 446/937] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:37 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:37.535324 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-17b2c59e-6f55-4ed2-9985-9d61f532d51d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043688 Apr 05 11:57:37.539233 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 492/938] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:37 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:38.226882 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-344e0f2b-d1b1-4fd8-96e1-d1729e4722c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:38.228728 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-344e0f2b-d1b1-4fd8-96e1-d1729e4722c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:38.239559 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-344e0f2b-d1b1-4fd8-96e1-d1729e4722c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:38.240359 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-344e0f2b-d1b1-4fd8-96e1-d1729e4722c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:38.241614 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-344e0f2b-d1b1-4fd8-96e1-d1729e4722c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:38.242325 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-344e0f2b-d1b1-4fd8-96e1-d1729e4722c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:38.272103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-344e0f2b-d1b1-4fd8-96e1-d1729e4722c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056972 Apr 05 11:57:38.272693 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 447/939] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:38 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:38.537985 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-07a358e2-389f-4728-8095-4fc8c91739c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:38.539063 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-07a358e2-389f-4728-8095-4fc8c91739c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:38.546454 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-07a358e2-389f-4728-8095-4fc8c91739c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:38.546773 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-92598f51-1e81-4d5d-89d3-f69e4f51f344 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:38.547197 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-07a358e2-389f-4728-8095-4fc8c91739c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:38.547633 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-07a358e2-389f-4728-8095-4fc8c91739c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:38.547780 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-92598f51-1e81-4d5d-89d3-f69e4f51f344 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:38.548105 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-07a358e2-389f-4728-8095-4fc8c91739c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:38.554414 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-92598f51-1e81-4d5d-89d3-f69e4f51f344 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:38.554845 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-92598f51-1e81-4d5d-89d3-f69e4f51f344 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:38.555651 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-92598f51-1e81-4d5d-89d3-f69e4f51f344 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:38.556103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-92598f51-1e81-4d5d-89d3-f69e4f51f344 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:38.578286 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-07a358e2-389f-4728-8095-4fc8c91739c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045008 Apr 05 11:57:38.579076 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 493/940] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:38 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:38.587953 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-92598f51-1e81-4d5d-89d3-f69e4f51f344 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045510 Apr 05 11:57:38.592190 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 448/941] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:38 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:39.288763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0c9ced5a-71f0-4b5d-9f42-c9d7d40ca688 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:39.290411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0c9ced5a-71f0-4b5d-9f42-c9d7d40ca688 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:39.297201 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0c9ced5a-71f0-4b5d-9f42-c9d7d40ca688 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:39.297640 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0c9ced5a-71f0-4b5d-9f42-c9d7d40ca688 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:39.298403 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0c9ced5a-71f0-4b5d-9f42-c9d7d40ca688 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:39.298833 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0c9ced5a-71f0-4b5d-9f42-c9d7d40ca688 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:39.327829 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0c9ced5a-71f0-4b5d-9f42-c9d7d40ca688 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046120 Apr 05 11:57:39.328407 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 494/942] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:39 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:39.590628 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b7bdb381-81e4-4eb9-bd7f-b40952efcb1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:39.591453 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b7bdb381-81e4-4eb9-bd7f-b40952efcb1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:39.598324 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b7bdb381-81e4-4eb9-bd7f-b40952efcb1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:39.598780 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b7bdb381-81e4-4eb9-bd7f-b40952efcb1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:39.599863 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b7bdb381-81e4-4eb9-bd7f-b40952efcb1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:39.600062 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b7bdb381-81e4-4eb9-bd7f-b40952efcb1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:39.600415 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cef5c3f4-33c9-42ae-a1e6-4ce7f561291b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:39.601418 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cef5c3f4-33c9-42ae-a1e6-4ce7f561291b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:39.614569 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cef5c3f4-33c9-42ae-a1e6-4ce7f561291b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:39.615018 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cef5c3f4-33c9-42ae-a1e6-4ce7f561291b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:39.615813 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cef5c3f4-33c9-42ae-a1e6-4ce7f561291b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:39.616453 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cef5c3f4-33c9-42ae-a1e6-4ce7f561291b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:39.631926 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b7bdb381-81e4-4eb9-bd7f-b40952efcb1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045866 Apr 05 11:57:39.635956 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 449/943] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:39 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:39.648387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cef5c3f4-33c9-42ae-a1e6-4ce7f561291b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050516 Apr 05 11:57:39.648387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 495/944] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:39 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:40.344663 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c1502df1-2e69-4147-9939-73693e147f78 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:40.346207 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c1502df1-2e69-4147-9939-73693e147f78 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:40.356395 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1502df1-2e69-4147-9939-73693e147f78 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:40.357126 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1502df1-2e69-4147-9939-73693e147f78 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:40.358362 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1502df1-2e69-4147-9939-73693e147f78 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:40.359084 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1502df1-2e69-4147-9939-73693e147f78 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:40.391286 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c1502df1-2e69-4147-9939-73693e147f78 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053860 Apr 05 11:57:40.391840 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 450/945] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:40 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:40.648244 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-712aee39-0fdb-410e-a3c0-eaf4d83afc07 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:40.649778 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-712aee39-0fdb-410e-a3c0-eaf4d83afc07 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:40.660519 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-712aee39-0fdb-410e-a3c0-eaf4d83afc07 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:40.661253 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-712aee39-0fdb-410e-a3c0-eaf4d83afc07 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:40.662424 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-61aa014b-3e66-41e6-b444-d30758a2bb47 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:40.663046 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-712aee39-0fdb-410e-a3c0-eaf4d83afc07 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:40.663181 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-712aee39-0fdb-410e-a3c0-eaf4d83afc07 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:40.663775 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-61aa014b-3e66-41e6-b444-d30758a2bb47 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:40.671560 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-61aa014b-3e66-41e6-b444-d30758a2bb47 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:40.672008 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-61aa014b-3e66-41e6-b444-d30758a2bb47 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:40.672833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-61aa014b-3e66-41e6-b444-d30758a2bb47 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:40.673263 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-61aa014b-3e66-41e6-b444-d30758a2bb47 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:40.694655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-712aee39-0fdb-410e-a3c0-eaf4d83afc07 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053095 Apr 05 11:57:40.695608 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 496/946] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:40 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:40.703086 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-61aa014b-3e66-41e6-b444-d30758a2bb47 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048382 Apr 05 11:57:40.703854 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 451/947] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:40 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:41.407246 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-79b21647-4b54-4765-8a87-443b0e2d44d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:41.408749 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-79b21647-4b54-4765-8a87-443b0e2d44d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:41.417873 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79b21647-4b54-4765-8a87-443b0e2d44d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:41.418343 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79b21647-4b54-4765-8a87-443b0e2d44d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:41.419096 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79b21647-4b54-4765-8a87-443b0e2d44d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:41.419529 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79b21647-4b54-4765-8a87-443b0e2d44d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:41.447994 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-79b21647-4b54-4765-8a87-443b0e2d44d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047473 Apr 05 11:57:41.448588 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 497/948] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:41 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:41.711123 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-479fc9b0-63cf-48fc-85aa-eca26e4a91bc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:41.713485 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-479fc9b0-63cf-48fc-85aa-eca26e4a91bc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:41.717475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b2f13fe9-4fc9-4cef-8986-2795b0397bbf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:41.718462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b2f13fe9-4fc9-4cef-8986-2795b0397bbf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:41.720878 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-479fc9b0-63cf-48fc-85aa-eca26e4a91bc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:41.721326 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-479fc9b0-63cf-48fc-85aa-eca26e4a91bc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:41.722122 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-479fc9b0-63cf-48fc-85aa-eca26e4a91bc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:41.722560 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-479fc9b0-63cf-48fc-85aa-eca26e4a91bc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:41.724822 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b2f13fe9-4fc9-4cef-8986-2795b0397bbf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:41.725259 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b2f13fe9-4fc9-4cef-8986-2795b0397bbf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:41.727561 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b2f13fe9-4fc9-4cef-8986-2795b0397bbf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:41.728012 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b2f13fe9-4fc9-4cef-8986-2795b0397bbf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:41.751551 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-479fc9b0-63cf-48fc-85aa-eca26e4a91bc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047008 Apr 05 11:57:41.752159 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 452/949] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:41 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:41.759988 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b2f13fe9-4fc9-4cef-8986-2795b0397bbf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048119 Apr 05 11:57:41.760714 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 498/950] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:41 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:42.465506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-243ea721-becb-4b46-882c-8e998bf7066c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:42.466439 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-243ea721-becb-4b46-882c-8e998bf7066c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:42.473047 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-243ea721-becb-4b46-882c-8e998bf7066c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:42.473361 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-243ea721-becb-4b46-882c-8e998bf7066c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:42.474120 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-243ea721-becb-4b46-882c-8e998bf7066c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:42.474554 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-243ea721-becb-4b46-882c-8e998bf7066c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:42.503858 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-243ea721-becb-4b46-882c-8e998bf7066c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044501 Apr 05 11:57:42.504432 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 453/951] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:42 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:42.767594 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1656322a-7aef-40ed-9330-ae3157e14699 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:42.768963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1656322a-7aef-40ed-9330-ae3157e14699 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:42.775775 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c6a92179-d776-4129-b91c-bd426fee7605 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:42.777508 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c6a92179-d776-4129-b91c-bd426fee7605 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:42.779266 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1656322a-7aef-40ed-9330-ae3157e14699 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:42.780148 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1656322a-7aef-40ed-9330-ae3157e14699 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:42.781796 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1656322a-7aef-40ed-9330-ae3157e14699 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:42.782444 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1656322a-7aef-40ed-9330-ae3157e14699 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:42.788404 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c6a92179-d776-4129-b91c-bd426fee7605 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:42.788404 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c6a92179-d776-4129-b91c-bd426fee7605 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:42.789652 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c6a92179-d776-4129-b91c-bd426fee7605 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:42.790359 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c6a92179-d776-4129-b91c-bd426fee7605 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:42.814885 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1656322a-7aef-40ed-9330-ae3157e14699 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054172 Apr 05 11:57:42.815441 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 499/952] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:42 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:42.821307 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c6a92179-d776-4129-b91c-bd426fee7605 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052482 Apr 05 11:57:42.825389 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 454/953] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:42 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:43.517901 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e6cfd8e8-b823-4fa5-b928-b555c2044924 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:43.518969 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e6cfd8e8-b823-4fa5-b928-b555c2044924 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:43.526642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6cfd8e8-b823-4fa5-b928-b555c2044924 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:43.527166 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6cfd8e8-b823-4fa5-b928-b555c2044924 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:43.528106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6cfd8e8-b823-4fa5-b928-b555c2044924 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:43.528612 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6cfd8e8-b823-4fa5-b928-b555c2044924 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:43.559493 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e6cfd8e8-b823-4fa5-b928-b555c2044924 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046342 Apr 05 11:57:43.560047 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 500/954] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:43 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:43.826965 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2e038ccf-ee8b-4287-b56f-d720447aea2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:43.827864 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2e038ccf-ee8b-4287-b56f-d720447aea2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:43.833384 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-35be344a-7c22-4d4f-808f-ef4827553e52 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:43.834541 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-35be344a-7c22-4d4f-808f-ef4827553e52 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:43.834691 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2e038ccf-ee8b-4287-b56f-d720447aea2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:43.835285 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2e038ccf-ee8b-4287-b56f-d720447aea2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:43.835935 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2e038ccf-ee8b-4287-b56f-d720447aea2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:43.836396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2e038ccf-ee8b-4287-b56f-d720447aea2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:43.841039 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-35be344a-7c22-4d4f-808f-ef4827553e52 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:43.841540 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-35be344a-7c22-4d4f-808f-ef4827553e52 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:43.842279 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-35be344a-7c22-4d4f-808f-ef4827553e52 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:43.842720 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-35be344a-7c22-4d4f-808f-ef4827553e52 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:43.867691 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2e038ccf-ee8b-4287-b56f-d720447aea2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044844 Apr 05 11:57:43.868657 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 455/955] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:43 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:43.876367 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-35be344a-7c22-4d4f-808f-ef4827553e52 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047232 Apr 05 11:57:43.877139 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 501/956] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:43 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:44.576143 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cec12937-0f0e-44d9-b0a5-c4addd3b6558 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:44.577655 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cec12937-0f0e-44d9-b0a5-c4addd3b6558 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:44.587780 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cec12937-0f0e-44d9-b0a5-c4addd3b6558 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:44.588761 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cec12937-0f0e-44d9-b0a5-c4addd3b6558 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:44.590416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cec12937-0f0e-44d9-b0a5-c4addd3b6558 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:44.591143 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cec12937-0f0e-44d9-b0a5-c4addd3b6558 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:44.625207 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cec12937-0f0e-44d9-b0a5-c4addd3b6558 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055961 Apr 05 11:57:44.625757 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 456/957] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:44 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:44.883979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e64172dc-fa8c-4015-a802-330c42c8ff1f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:44.885379 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e64172dc-fa8c-4015-a802-330c42c8ff1f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:44.891371 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-669c1cf0-6f28-4c15-af7d-0f2e5f399ab1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:44.893235 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-669c1cf0-6f28-4c15-af7d-0f2e5f399ab1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:44.895973 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e64172dc-fa8c-4015-a802-330c42c8ff1f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:44.896763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e64172dc-fa8c-4015-a802-330c42c8ff1f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:44.898015 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e64172dc-fa8c-4015-a802-330c42c8ff1f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:44.898771 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e64172dc-fa8c-4015-a802-330c42c8ff1f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:44.902096 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-669c1cf0-6f28-4c15-af7d-0f2e5f399ab1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:44.902699 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-669c1cf0-6f28-4c15-af7d-0f2e5f399ab1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:44.903471 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-669c1cf0-6f28-4c15-af7d-0f2e5f399ab1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:44.903901 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-669c1cf0-6f28-4c15-af7d-0f2e5f399ab1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:44.931085 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e64172dc-fa8c-4015-a802-330c42c8ff1f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053879 Apr 05 11:57:44.931698 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 502/958] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:44 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:44.934841 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-669c1cf0-6f28-4c15-af7d-0f2e5f399ab1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050644 Apr 05 11:57:44.935616 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 457/959] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:44 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:45.641501 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a94f9c20-6ed3-4665-912e-4912750dd20a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:45.643017 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a94f9c20-6ed3-4665-912e-4912750dd20a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:45.652375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a94f9c20-6ed3-4665-912e-4912750dd20a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:45.652832 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a94f9c20-6ed3-4665-912e-4912750dd20a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:45.653605 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a94f9c20-6ed3-4665-912e-4912750dd20a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:45.654039 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a94f9c20-6ed3-4665-912e-4912750dd20a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:45.682990 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a94f9c20-6ed3-4665-912e-4912750dd20a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048387 Apr 05 11:57:45.683689 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 503/960] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:45 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:45.947304 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b3113626-596e-4f28-ae79-c66760f91741 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:45.948573 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b3113626-596e-4f28-ae79-c66760f91741 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:45.949703 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-70497357-efd4-48c0-818c-3c559a2bceb5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:45.950610 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-70497357-efd4-48c0-818c-3c559a2bceb5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:45.954961 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b3113626-596e-4f28-ae79-c66760f91741 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:45.955414 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b3113626-596e-4f28-ae79-c66760f91741 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:45.956228 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b3113626-596e-4f28-ae79-c66760f91741 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:45.956635 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b3113626-596e-4f28-ae79-c66760f91741 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:45.957393 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-70497357-efd4-48c0-818c-3c559a2bceb5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:45.957967 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-70497357-efd4-48c0-818c-3c559a2bceb5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:45.958709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-70497357-efd4-48c0-818c-3c559a2bceb5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:45.959146 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-70497357-efd4-48c0-818c-3c559a2bceb5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:45.988146 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b3113626-596e-4f28-ae79-c66760f91741 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047662 Apr 05 11:57:45.988718 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 458/961] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:45 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:45.989659 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-70497357-efd4-48c0-818c-3c559a2bceb5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045430 Apr 05 11:57:45.990388 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 504/962] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:45 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:46.698258 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-72948728-3bcc-4255-998f-a8fc3fc5a26d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:46.699174 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-72948728-3bcc-4255-998f-a8fc3fc5a26d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:46.705751 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-72948728-3bcc-4255-998f-a8fc3fc5a26d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:46.706247 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-72948728-3bcc-4255-998f-a8fc3fc5a26d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:46.706999 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-72948728-3bcc-4255-998f-a8fc3fc5a26d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:46.707427 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-72948728-3bcc-4255-998f-a8fc3fc5a26d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:46.737264 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-72948728-3bcc-4255-998f-a8fc3fc5a26d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043531 Apr 05 11:57:46.737763 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 459/963] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:46 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:47.004248 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2b1aeae4-2ee2-4124-b565-c7f943577bd0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:47.005359 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9209536a-30b5-4f35-8371-c0ff4e7e480d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:47.006006 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2b1aeae4-2ee2-4124-b565-c7f943577bd0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:47.006884 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9209536a-30b5-4f35-8371-c0ff4e7e480d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:47.017822 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2b1aeae4-2ee2-4124-b565-c7f943577bd0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:47.018051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9209536a-30b5-4f35-8371-c0ff4e7e480d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:47.018232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2b1aeae4-2ee2-4124-b565-c7f943577bd0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:47.018379 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9209536a-30b5-4f35-8371-c0ff4e7e480d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:47.018537 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2b1aeae4-2ee2-4124-b565-c7f943577bd0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:47.018906 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2b1aeae4-2ee2-4124-b565-c7f943577bd0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:47.019103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9209536a-30b5-4f35-8371-c0ff4e7e480d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:47.019768 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9209536a-30b5-4f35-8371-c0ff4e7e480d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:47.054751 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9209536a-30b5-4f35-8371-c0ff4e7e480d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056102 Apr 05 11:57:47.055557 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 460/964] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:46 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:47.055685 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2b1aeae4-2ee2-4124-b565-c7f943577bd0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057943 Apr 05 11:57:47.058935 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 505/965] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:46 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:47.753367 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-eaf8a807-5d28-447e-9e76-c80ee61ab64e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:47.754748 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-eaf8a807-5d28-447e-9e76-c80ee61ab64e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:47.764952 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eaf8a807-5d28-447e-9e76-c80ee61ab64e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:47.765700 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eaf8a807-5d28-447e-9e76-c80ee61ab64e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:47.766957 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eaf8a807-5d28-447e-9e76-c80ee61ab64e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:47.767672 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eaf8a807-5d28-447e-9e76-c80ee61ab64e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:47.800952 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-eaf8a807-5d28-447e-9e76-c80ee61ab64e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054467 Apr 05 11:57:47.801524 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 461/966] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:47 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:48.066882 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-47c094bd-2f6d-4058-a577-7876cf2d4cb5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:48.067475 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-24e7a504-bf92-4668-90cd-4067f1d0c066 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:48.067856 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-47c094bd-2f6d-4058-a577-7876cf2d4cb5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:48.068365 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-24e7a504-bf92-4668-90cd-4067f1d0c066 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:48.074508 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-47c094bd-2f6d-4058-a577-7876cf2d4cb5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:48.074936 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-47c094bd-2f6d-4058-a577-7876cf2d4cb5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:48.075779 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-47c094bd-2f6d-4058-a577-7876cf2d4cb5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:48.076251 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-47c094bd-2f6d-4058-a577-7876cf2d4cb5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:48.076422 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-24e7a504-bf92-4668-90cd-4067f1d0c066 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:48.076899 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-24e7a504-bf92-4668-90cd-4067f1d0c066 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:48.077680 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-24e7a504-bf92-4668-90cd-4067f1d0c066 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:48.078106 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-24e7a504-bf92-4668-90cd-4067f1d0c066 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:48.105894 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-47c094bd-2f6d-4058-a577-7876cf2d4cb5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043190 Apr 05 11:57:48.110004 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 506/967] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:48 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:48.110417 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-24e7a504-bf92-4668-90cd-4067f1d0c066 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045508 Apr 05 11:57:48.112853 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 462/968] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:48 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:48.817192 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f4670f16-96b4-47a7-abd1-6b7ebf919808 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:48.818538 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f4670f16-96b4-47a7-abd1-6b7ebf919808 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:48.826426 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f4670f16-96b4-47a7-abd1-6b7ebf919808 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:48.826865 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f4670f16-96b4-47a7-abd1-6b7ebf919808 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:48.827622 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f4670f16-96b4-47a7-abd1-6b7ebf919808 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:48.828049 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f4670f16-96b4-47a7-abd1-6b7ebf919808 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:48.856825 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f4670f16-96b4-47a7-abd1-6b7ebf919808 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046544 Apr 05 11:57:48.857365 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 507/969] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:48 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:49.118040 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-223ee0cd-81cd-4bf4-9377-ea111d7ce2f2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:49.118870 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-223ee0cd-81cd-4bf4-9377-ea111d7ce2f2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:49.120649 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4993719b-1efe-4f8a-bdc1-67f7b079392f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:49.121584 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4993719b-1efe-4f8a-bdc1-67f7b079392f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:49.125583 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-223ee0cd-81cd-4bf4-9377-ea111d7ce2f2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:49.126029 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-223ee0cd-81cd-4bf4-9377-ea111d7ce2f2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:49.126803 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-223ee0cd-81cd-4bf4-9377-ea111d7ce2f2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:49.127238 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-223ee0cd-81cd-4bf4-9377-ea111d7ce2f2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:49.128107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4993719b-1efe-4f8a-bdc1-67f7b079392f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:49.128582 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4993719b-1efe-4f8a-bdc1-67f7b079392f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:49.129386 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4993719b-1efe-4f8a-bdc1-67f7b079392f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:49.129789 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4993719b-1efe-4f8a-bdc1-67f7b079392f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:49.160044 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4993719b-1efe-4f8a-bdc1-67f7b079392f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043352 Apr 05 11:57:49.160510 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-223ee0cd-81cd-4bf4-9377-ea111d7ce2f2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046535 Apr 05 11:57:49.161047 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 463/970] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:49 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:49.164900 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 508/971] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:49 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:49.868798 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e74838ec-1750-49ab-886f-f431e7be08a2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:49.869893 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e74838ec-1750-49ab-886f-f431e7be08a2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:49.876698 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e74838ec-1750-49ab-886f-f431e7be08a2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:49.877148 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e74838ec-1750-49ab-886f-f431e7be08a2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:49.877914 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e74838ec-1750-49ab-886f-f431e7be08a2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:49.878389 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e74838ec-1750-49ab-886f-f431e7be08a2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:49.909699 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e74838ec-1750-49ab-886f-f431e7be08a2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044870 Apr 05 11:57:49.910265 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 464/972] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:49 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:50.172377 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-86567c2f-c4a9-469b-8401-a359fbfdcda2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:50.173073 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-10229323-2e1e-4b0b-b2eb-4e688912f43a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:50.173459 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-86567c2f-c4a9-469b-8401-a359fbfdcda2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:50.173771 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-10229323-2e1e-4b0b-b2eb-4e688912f43a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:50.179802 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86567c2f-c4a9-469b-8401-a359fbfdcda2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:50.180205 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-10229323-2e1e-4b0b-b2eb-4e688912f43a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:50.180360 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86567c2f-c4a9-469b-8401-a359fbfdcda2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:50.180736 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-10229323-2e1e-4b0b-b2eb-4e688912f43a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:50.181051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86567c2f-c4a9-469b-8401-a359fbfdcda2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:50.181520 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86567c2f-c4a9-469b-8401-a359fbfdcda2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:50.181738 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-10229323-2e1e-4b0b-b2eb-4e688912f43a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:50.182475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-10229323-2e1e-4b0b-b2eb-4e688912f43a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:50.212957 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-10229323-2e1e-4b0b-b2eb-4e688912f43a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044400 Apr 05 11:57:50.213851 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 509/973] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:50 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:50.226028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-86567c2f-c4a9-469b-8401-a359fbfdcda2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057489 Apr 05 11:57:50.226607 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 465/974] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:50 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:57:50.925421 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3a408fbf-6967-45ea-abcd-14f7b203b7f8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:50.926904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3a408fbf-6967-45ea-abcd-14f7b203b7f8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:50.935098 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a408fbf-6967-45ea-abcd-14f7b203b7f8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:50.935547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a408fbf-6967-45ea-abcd-14f7b203b7f8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:50.936349 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a408fbf-6967-45ea-abcd-14f7b203b7f8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:50.936777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a408fbf-6967-45ea-abcd-14f7b203b7f8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:50.965828 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3a408fbf-6967-45ea-abcd-14f7b203b7f8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047300 Apr 05 11:57:50.966384 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 510/975] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:50 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:51.229620 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-679ed9b9-4fa7-4510-b0e5-79c35e78bf4a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:51.230763 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-679ed9b9-4fa7-4510-b0e5-79c35e78bf4a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:51.239622 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1430ef99-b472-4e3b-8e47-16a364315913 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:51.241342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1430ef99-b472-4e3b-8e47-16a364315913 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:51.241521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-679ed9b9-4fa7-4510-b0e5-79c35e78bf4a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:51.242140 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-679ed9b9-4fa7-4510-b0e5-79c35e78bf4a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:51.243134 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-679ed9b9-4fa7-4510-b0e5-79c35e78bf4a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:51.243755 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-679ed9b9-4fa7-4510-b0e5-79c35e78bf4a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:51.249868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1430ef99-b472-4e3b-8e47-16a364315913 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:51.250498 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1430ef99-b472-4e3b-8e47-16a364315913 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:51.251518 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1430ef99-b472-4e3b-8e47-16a364315913 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:51.252122 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1430ef99-b472-4e3b-8e47-16a364315913 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:51.277155 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-679ed9b9-4fa7-4510-b0e5-79c35e78bf4a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054391 Apr 05 11:57:51.280671 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 466/976] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:51 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:51.286722 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1430ef99-b472-4e3b-8e47-16a364315913 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052171 Apr 05 11:57:51.287434 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 511/977] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:51 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:51.981598 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e74557c6-07c5-49d1-8eae-cc2a264d2fff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:51.982829 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e74557c6-07c5-49d1-8eae-cc2a264d2fff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:51.991088 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e74557c6-07c5-49d1-8eae-cc2a264d2fff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:51.991686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e74557c6-07c5-49d1-8eae-cc2a264d2fff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:51.992732 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e74557c6-07c5-49d1-8eae-cc2a264d2fff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:51.993303 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e74557c6-07c5-49d1-8eae-cc2a264d2fff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:52.025984 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e74557c6-07c5-49d1-8eae-cc2a264d2fff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050640 Apr 05 11:57:52.026462 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 467/978] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:51 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:52.293686 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2b98b84a-4860-4aab-80cd-ea78d49938c3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:52.294998 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2b98b84a-4860-4aab-80cd-ea78d49938c3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:52.302473 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b981268a-3e08-4f30-b7dd-1e3e7d664348 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:52.303960 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b981268a-3e08-4f30-b7dd-1e3e7d664348 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:52.305314 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2b98b84a-4860-4aab-80cd-ea78d49938c3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:52.306059 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2b98b84a-4860-4aab-80cd-ea78d49938c3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:52.307104 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2b98b84a-4860-4aab-80cd-ea78d49938c3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:52.307502 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2b98b84a-4860-4aab-80cd-ea78d49938c3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:52.310982 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b981268a-3e08-4f30-b7dd-1e3e7d664348 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:52.311465 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b981268a-3e08-4f30-b7dd-1e3e7d664348 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:52.312266 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b981268a-3e08-4f30-b7dd-1e3e7d664348 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:52.312894 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b981268a-3e08-4f30-b7dd-1e3e7d664348 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:52.340420 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2b98b84a-4860-4aab-80cd-ea78d49938c3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053567 Apr 05 11:57:52.343086 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 512/979] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:52 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:52.343239 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b981268a-3e08-4f30-b7dd-1e3e7d664348 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046999 Apr 05 11:57:52.344347 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 468/980] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:52 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:53.042377 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bdced713-95e9-4e08-b11d-3aa73a517c12 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:53.043891 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bdced713-95e9-4e08-b11d-3aa73a517c12 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:53.053924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bdced713-95e9-4e08-b11d-3aa73a517c12 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:53.054666 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bdced713-95e9-4e08-b11d-3aa73a517c12 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:53.055893 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bdced713-95e9-4e08-b11d-3aa73a517c12 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:53.056722 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bdced713-95e9-4e08-b11d-3aa73a517c12 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:53.085530 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bdced713-95e9-4e08-b11d-3aa73a517c12 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049898 Apr 05 11:57:53.086011 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 513/981] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:53 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:53.355612 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1b688c44-1d9b-4a5e-935c-a1cbdd3c1a2b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:53.356571 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1b688c44-1d9b-4a5e-935c-a1cbdd3c1a2b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:53.356776 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-db68b014-118d-427a-9204-ce2e5671c94d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:53.357651 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-db68b014-118d-427a-9204-ce2e5671c94d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:53.363682 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1b688c44-1d9b-4a5e-935c-a1cbdd3c1a2b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:53.364197 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1b688c44-1d9b-4a5e-935c-a1cbdd3c1a2b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:53.364592 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-db68b014-118d-427a-9204-ce2e5671c94d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:53.365055 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1b688c44-1d9b-4a5e-935c-a1cbdd3c1a2b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:53.365174 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-db68b014-118d-427a-9204-ce2e5671c94d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:53.365541 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1b688c44-1d9b-4a5e-935c-a1cbdd3c1a2b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:53.365927 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-db68b014-118d-427a-9204-ce2e5671c94d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:53.366405 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-db68b014-118d-427a-9204-ce2e5671c94d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:53.397285 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1b688c44-1d9b-4a5e-935c-a1cbdd3c1a2b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047572 Apr 05 11:57:53.398075 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 469/982] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:53 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:53.400010 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-db68b014-118d-427a-9204-ce2e5671c94d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048478 Apr 05 11:57:53.400924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 514/983] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:53 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:54.098095 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a886d0e5-decc-4808-b901-d70319958d72 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:54.100508 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a886d0e5-decc-4808-b901-d70319958d72 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:54.108107 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a886d0e5-decc-4808-b901-d70319958d72 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:54.108570 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a886d0e5-decc-4808-b901-d70319958d72 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:54.109340 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a886d0e5-decc-4808-b901-d70319958d72 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:54.109775 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a886d0e5-decc-4808-b901-d70319958d72 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:54.138923 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a886d0e5-decc-4808-b901-d70319958d72 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045738 Apr 05 11:57:54.139491 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 470/984] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:54 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:54.413374 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-afb71e46-11d7-4ed2-a686-c5285255faf2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:54.414858 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-afb71e46-11d7-4ed2-a686-c5285255faf2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:54.415121 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-97010e9a-bfc8-430b-9d02-f441e2da9dca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:54.416423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-97010e9a-bfc8-430b-9d02-f441e2da9dca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:54.427387 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-97010e9a-bfc8-430b-9d02-f441e2da9dca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:54.428238 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-97010e9a-bfc8-430b-9d02-f441e2da9dca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:54.428985 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-afb71e46-11d7-4ed2-a686-c5285255faf2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:54.429491 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-97010e9a-bfc8-430b-9d02-f441e2da9dca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:54.429993 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-afb71e46-11d7-4ed2-a686-c5285255faf2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:54.431444 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-afb71e46-11d7-4ed2-a686-c5285255faf2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:54.431639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-97010e9a-bfc8-430b-9d02-f441e2da9dca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:54.432415 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-afb71e46-11d7-4ed2-a686-c5285255faf2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:54.463974 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-afb71e46-11d7-4ed2-a686-c5285255faf2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057608 Apr 05 11:57:54.464161 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-97010e9a-bfc8-430b-9d02-f441e2da9dca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055930 Apr 05 11:57:54.468383 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 515/985] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:54 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:54.468534 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 471/986] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:54 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:55.154261 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2568f94a-0adb-483a-bb25-bb9d08a44164 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:55.155187 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2568f94a-0adb-483a-bb25-bb9d08a44164 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:55.164427 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2568f94a-0adb-483a-bb25-bb9d08a44164 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:55.164881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2568f94a-0adb-483a-bb25-bb9d08a44164 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:55.165655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2568f94a-0adb-483a-bb25-bb9d08a44164 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:55.166091 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2568f94a-0adb-483a-bb25-bb9d08a44164 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:55.201363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2568f94a-0adb-483a-bb25-bb9d08a44164 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052925 Apr 05 11:57:55.201919 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 516/987] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:55 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:55.476414 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5ae36a14-719e-4b86-a557-7bbd7c19b85a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:55.477156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-74fd781d-de30-4794-83ed-2d795d9bff2d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:55.477784 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-74fd781d-de30-4794-83ed-2d795d9bff2d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:55.477910 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5ae36a14-719e-4b86-a557-7bbd7c19b85a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:55.484192 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-74fd781d-de30-4794-83ed-2d795d9bff2d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:55.484449 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5ae36a14-719e-4b86-a557-7bbd7c19b85a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:55.484616 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-74fd781d-de30-4794-83ed-2d795d9bff2d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:55.484901 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5ae36a14-719e-4b86-a557-7bbd7c19b85a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:55.485424 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-74fd781d-de30-4794-83ed-2d795d9bff2d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:55.485763 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5ae36a14-719e-4b86-a557-7bbd7c19b85a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:55.485878 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-74fd781d-de30-4794-83ed-2d795d9bff2d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:55.488542 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5ae36a14-719e-4b86-a557-7bbd7c19b85a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:55.518432 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5ae36a14-719e-4b86-a557-7bbd7c19b85a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046021 Apr 05 11:57:55.520049 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-74fd781d-de30-4794-83ed-2d795d9bff2d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047346 Apr 05 11:57:55.523819 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 517/988] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:55 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:55.523964 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 472/989] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:55 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:56.218030 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8646f32c-89e0-403e-a331-26b5d327f737 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:56.219567 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8646f32c-89e0-403e-a331-26b5d327f737 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:56.229976 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8646f32c-89e0-403e-a331-26b5d327f737 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:56.230421 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8646f32c-89e0-403e-a331-26b5d327f737 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:56.231181 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8646f32c-89e0-403e-a331-26b5d327f737 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:56.231610 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8646f32c-89e0-403e-a331-26b5d327f737 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:56.259869 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8646f32c-89e0-403e-a331-26b5d327f737 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048972 Apr 05 11:57:56.260448 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 518/990] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:56 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:56.530682 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-87f5655a-4ffa-499b-a19a-21b3107df31c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:56.531710 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-87f5655a-4ffa-499b-a19a-21b3107df31c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:56.531878 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c70e813f-0ae4-49ff-a828-8d5499858049 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:56.533260 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c70e813f-0ae4-49ff-a828-8d5499858049 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:56.538525 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-87f5655a-4ffa-499b-a19a-21b3107df31c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:56.539002 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-87f5655a-4ffa-499b-a19a-21b3107df31c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:56.539784 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-87f5655a-4ffa-499b-a19a-21b3107df31c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:56.540266 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-87f5655a-4ffa-499b-a19a-21b3107df31c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:56.542021 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c70e813f-0ae4-49ff-a828-8d5499858049 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:56.542847 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c70e813f-0ae4-49ff-a828-8d5499858049 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:56.544988 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c70e813f-0ae4-49ff-a828-8d5499858049 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:56.544988 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c70e813f-0ae4-49ff-a828-8d5499858049 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:56.570351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-87f5655a-4ffa-499b-a19a-21b3107df31c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043894 Apr 05 11:57:56.570957 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 473/991] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:56 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:56.573602 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c70e813f-0ae4-49ff-a828-8d5499858049 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045867 Apr 05 11:57:56.577475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 519/992] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:56 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:57.278033 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-56cbad32-6b28-4059-8517-f48d9d380332 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:57.279520 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-56cbad32-6b28-4059-8517-f48d9d380332 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:57.289740 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56cbad32-6b28-4059-8517-f48d9d380332 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:57.290493 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56cbad32-6b28-4059-8517-f48d9d380332 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:57.291761 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56cbad32-6b28-4059-8517-f48d9d380332 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:57.292550 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56cbad32-6b28-4059-8517-f48d9d380332 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:57.478455 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-56cbad32-6b28-4059-8517-f48d9d380332 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.207146 Apr 05 11:57:57.479004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 474/993] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:57 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:57.586320 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8cd5ca79-1481-48c2-aec7-6a4a60e649a5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:57.587683 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8cd5ca79-1481-48c2-aec7-6a4a60e649a5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:57.589120 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5aadcf8f-5543-4728-b95a-ba97df64e1ac tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:57.591235 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5aadcf8f-5543-4728-b95a-ba97df64e1ac tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:57.595533 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8cd5ca79-1481-48c2-aec7-6a4a60e649a5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:57.595981 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8cd5ca79-1481-48c2-aec7-6a4a60e649a5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:57.596907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8cd5ca79-1481-48c2-aec7-6a4a60e649a5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:57.597364 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8cd5ca79-1481-48c2-aec7-6a4a60e649a5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:57.599289 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5aadcf8f-5543-4728-b95a-ba97df64e1ac tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:57.599768 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5aadcf8f-5543-4728-b95a-ba97df64e1ac tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:57.600462 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5aadcf8f-5543-4728-b95a-ba97df64e1ac tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:57.600902 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5aadcf8f-5543-4728-b95a-ba97df64e1ac tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:57.627950 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8cd5ca79-1481-48c2-aec7-6a4a60e649a5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048370 Apr 05 11:57:57.631853 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 520/994] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:57 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:57.632716 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5aadcf8f-5543-4728-b95a-ba97df64e1ac tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049875 Apr 05 11:57:57.636381 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 475/995] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:57 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:58.494686 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a7dc3e5c-93e8-4208-8dc8-8e3e05829950 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:58.496220 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a7dc3e5c-93e8-4208-8dc8-8e3e05829950 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:58.507311 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7dc3e5c-93e8-4208-8dc8-8e3e05829950 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:58.508050 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7dc3e5c-93e8-4208-8dc8-8e3e05829950 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:58.509353 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7dc3e5c-93e8-4208-8dc8-8e3e05829950 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:58.510067 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7dc3e5c-93e8-4208-8dc8-8e3e05829950 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:58.539334 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a7dc3e5c-93e8-4208-8dc8-8e3e05829950 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051453 Apr 05 11:57:58.539879 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 521/996] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:58 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:58.641100 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-256b3abb-5420-43c4-ac84-d5d5abfac159 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:58.642011 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-256b3abb-5420-43c4-ac84-d5d5abfac159 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:58.644104 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-561ffcd6-0dee-47e1-970b-e7a56523d153 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:58.645025 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-561ffcd6-0dee-47e1-970b-e7a56523d153 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:58.648819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-256b3abb-5420-43c4-ac84-d5d5abfac159 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:58.649264 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-256b3abb-5420-43c4-ac84-d5d5abfac159 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:58.650032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-256b3abb-5420-43c4-ac84-d5d5abfac159 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:58.650458 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-256b3abb-5420-43c4-ac84-d5d5abfac159 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:58.651107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-561ffcd6-0dee-47e1-970b-e7a56523d153 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:58.651547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-561ffcd6-0dee-47e1-970b-e7a56523d153 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:58.652330 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-561ffcd6-0dee-47e1-970b-e7a56523d153 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:58.652759 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-561ffcd6-0dee-47e1-970b-e7a56523d153 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:58.680263 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-256b3abb-5420-43c4-ac84-d5d5abfac159 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043360 Apr 05 11:57:58.684212 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 476/997] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:58 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:58.684604 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-561ffcd6-0dee-47e1-970b-e7a56523d153 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044081 Apr 05 11:57:58.685323 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 522/998] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:58 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:57:59.554862 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7b2f1b3a-a32f-4b0f-952c-fb95616d9583 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:59.556430 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7b2f1b3a-a32f-4b0f-952c-fb95616d9583 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:59.563456 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7b2f1b3a-a32f-4b0f-952c-fb95616d9583 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:59.563903 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7b2f1b3a-a32f-4b0f-952c-fb95616d9583 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:59.564680 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7b2f1b3a-a32f-4b0f-952c-fb95616d9583 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:59.565107 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7b2f1b3a-a32f-4b0f-952c-fb95616d9583 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:59.595437 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7b2f1b3a-a32f-4b0f-952c-fb95616d9583 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047352 Apr 05 11:57:59.595968 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 477/999] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:57:59 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:57:59.696407 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-de7a92a1-b4d1-41c5-9cf3-a0413e166e84 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:59.697953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-de7a92a1-b4d1-41c5-9cf3-a0413e166e84 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:59.700012 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b12406e3-572c-4486-8858-4ffeb7fd1f20 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:57:59.702953 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b12406e3-572c-4486-8858-4ffeb7fd1f20 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:57:59.708025 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-de7a92a1-b4d1-41c5-9cf3-a0413e166e84 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:59.708805 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-de7a92a1-b4d1-41c5-9cf3-a0413e166e84 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:59.710097 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-de7a92a1-b4d1-41c5-9cf3-a0413e166e84 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:59.710831 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-de7a92a1-b4d1-41c5-9cf3-a0413e166e84 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:59.711673 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b12406e3-572c-4486-8858-4ffeb7fd1f20 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:59.712467 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b12406e3-572c-4486-8858-4ffeb7fd1f20 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:59.713690 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b12406e3-572c-4486-8858-4ffeb7fd1f20 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:57:59.715172 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b12406e3-572c-4486-8858-4ffeb7fd1f20 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:57:59.745739 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-de7a92a1-b4d1-41c5-9cf3-a0413e166e84 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056180 Apr 05 11:57:59.745871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b12406e3-572c-4486-8858-4ffeb7fd1f20 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052318 Apr 05 11:57:59.746570 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 478/1000] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:59 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:59.746746 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 523/1001] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:57:59 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:00.610818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-09e288ab-9c2a-426b-9846-fac1fbdd5557 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:00.612345 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-09e288ab-9c2a-426b-9846-fac1fbdd5557 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:00.622043 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-09e288ab-9c2a-426b-9846-fac1fbdd5557 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:00.622488 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-09e288ab-9c2a-426b-9846-fac1fbdd5557 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:00.623249 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-09e288ab-9c2a-426b-9846-fac1fbdd5557 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:00.623681 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-09e288ab-9c2a-426b-9846-fac1fbdd5557 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:00.652022 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-09e288ab-9c2a-426b-9846-fac1fbdd5557 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047983 Apr 05 11:58:00.652660 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 479/1002] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:00 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:00.761786 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-869cb90f-b5f7-4755-ad62-64c595084c98 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:00.762727 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-869cb90f-b5f7-4755-ad62-64c595084c98 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:00.763422 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-20113bb4-754f-430a-9505-e0fcc385a381 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:00.764651 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-20113bb4-754f-430a-9505-e0fcc385a381 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:00.769475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-869cb90f-b5f7-4755-ad62-64c595084c98 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:00.769895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-869cb90f-b5f7-4755-ad62-64c595084c98 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:00.770707 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-869cb90f-b5f7-4755-ad62-64c595084c98 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:00.771002 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-20113bb4-754f-430a-9505-e0fcc385a381 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:00.771121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-869cb90f-b5f7-4755-ad62-64c595084c98 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:00.771482 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-20113bb4-754f-430a-9505-e0fcc385a381 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:00.772278 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-20113bb4-754f-430a-9505-e0fcc385a381 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:00.772707 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-20113bb4-754f-430a-9505-e0fcc385a381 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:00.801150 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-869cb90f-b5f7-4755-ad62-64c595084c98 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046000 Apr 05 11:58:00.801723 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 524/1003] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:00 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:00.801855 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-20113bb4-754f-430a-9505-e0fcc385a381 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044302 Apr 05 11:58:00.802377 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 480/1004] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:00 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:01.667644 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ac0a7659-d07a-48f0-8409-0d336654cb83 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:01.668969 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ac0a7659-d07a-48f0-8409-0d336654cb83 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:01.676402 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ac0a7659-d07a-48f0-8409-0d336654cb83 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:01.676932 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ac0a7659-d07a-48f0-8409-0d336654cb83 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:01.677818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ac0a7659-d07a-48f0-8409-0d336654cb83 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:01.678329 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ac0a7659-d07a-48f0-8409-0d336654cb83 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:01.709771 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ac0a7659-d07a-48f0-8409-0d336654cb83 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048776 Apr 05 11:58:01.710340 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 525/1005] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:01 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:01.816812 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3b76ff10-474d-48d6-b15c-293949ba20ca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:01.817624 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e1b9bf7a-b543-48de-95cf-3aa7eef083e9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:01.818218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3b76ff10-474d-48d6-b15c-293949ba20ca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:01.818631 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e1b9bf7a-b543-48de-95cf-3aa7eef083e9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:01.828279 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b76ff10-474d-48d6-b15c-293949ba20ca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:01.829017 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b76ff10-474d-48d6-b15c-293949ba20ca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:01.829281 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e1b9bf7a-b543-48de-95cf-3aa7eef083e9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:01.830030 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e1b9bf7a-b543-48de-95cf-3aa7eef083e9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:01.830270 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b76ff10-474d-48d6-b15c-293949ba20ca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:01.830957 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b76ff10-474d-48d6-b15c-293949ba20ca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:01.831345 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e1b9bf7a-b543-48de-95cf-3aa7eef083e9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:01.831977 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e1b9bf7a-b543-48de-95cf-3aa7eef083e9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:01.864713 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3b76ff10-474d-48d6-b15c-293949ba20ca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054514 Apr 05 11:58:01.868926 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 481/1006] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:01 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:01.869212 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e1b9bf7a-b543-48de-95cf-3aa7eef083e9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054686 Apr 05 11:58:01.869212 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 526/1007] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:01 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:02.726214 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6c57f40b-a13f-4cef-82b1-d9a9ccd086d9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:02.727736 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6c57f40b-a13f-4cef-82b1-d9a9ccd086d9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:02.738187 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6c57f40b-a13f-4cef-82b1-d9a9ccd086d9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:02.738780 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6c57f40b-a13f-4cef-82b1-d9a9ccd086d9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:02.740023 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6c57f40b-a13f-4cef-82b1-d9a9ccd086d9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:02.740792 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6c57f40b-a13f-4cef-82b1-d9a9ccd086d9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:02.771527 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6c57f40b-a13f-4cef-82b1-d9a9ccd086d9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052033 Apr 05 11:58:02.772067 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 482/1008] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:02 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:02.880758 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ef05a7cb-1ce9-4a92-9bf1-ae3e8d709e86 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:02.881778 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5d089904-9965-4a26-9ebb-a6d7285b1a0c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:02.882359 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ef05a7cb-1ce9-4a92-9bf1-ae3e8d709e86 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:02.882507 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5d089904-9965-4a26-9ebb-a6d7285b1a0c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:02.893563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef05a7cb-1ce9-4a92-9bf1-ae3e8d709e86 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:02.894305 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef05a7cb-1ce9-4a92-9bf1-ae3e8d709e86 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:02.894557 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5d089904-9965-4a26-9ebb-a6d7285b1a0c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:02.895119 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5d089904-9965-4a26-9ebb-a6d7285b1a0c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:02.895553 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef05a7cb-1ce9-4a92-9bf1-ae3e8d709e86 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:02.896294 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef05a7cb-1ce9-4a92-9bf1-ae3e8d709e86 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:02.896513 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5d089904-9965-4a26-9ebb-a6d7285b1a0c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:02.897160 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5d089904-9965-4a26-9ebb-a6d7285b1a0c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:02.931625 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5d089904-9965-4a26-9ebb-a6d7285b1a0c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057237 Apr 05 11:58:02.932432 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 527/1009] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:02 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:02.935051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ef05a7cb-1ce9-4a92-9bf1-ae3e8d709e86 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058020 Apr 05 11:58:02.935806 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 483/1010] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:02 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:03.787943 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8836fb44-97bc-43fd-a540-8ca4323a2977 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:03.789877 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8836fb44-97bc-43fd-a540-8ca4323a2977 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:03.797282 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8836fb44-97bc-43fd-a540-8ca4323a2977 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:03.797723 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8836fb44-97bc-43fd-a540-8ca4323a2977 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:03.798491 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8836fb44-97bc-43fd-a540-8ca4323a2977 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:03.798904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8836fb44-97bc-43fd-a540-8ca4323a2977 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:03.827926 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8836fb44-97bc-43fd-a540-8ca4323a2977 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047125 Apr 05 11:58:03.828497 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 528/1011] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:03 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:03.949988 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ee00183d-5437-44a0-aae5-903f24c56ec1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:03.950647 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d011b851-c1a2-48a9-b42c-2607a1452acc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:03.950996 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ee00183d-5437-44a0-aae5-903f24c56ec1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:03.951474 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d011b851-c1a2-48a9-b42c-2607a1452acc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:03.958220 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d011b851-c1a2-48a9-b42c-2607a1452acc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:03.958668 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d011b851-c1a2-48a9-b42c-2607a1452acc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:03.958830 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee00183d-5437-44a0-aae5-903f24c56ec1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:03.959394 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee00183d-5437-44a0-aae5-903f24c56ec1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:03.959533 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d011b851-c1a2-48a9-b42c-2607a1452acc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:03.959852 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d011b851-c1a2-48a9-b42c-2607a1452acc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:03.960434 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee00183d-5437-44a0-aae5-903f24c56ec1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:03.960869 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee00183d-5437-44a0-aae5-903f24c56ec1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:03.989303 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d011b851-c1a2-48a9-b42c-2607a1452acc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045020 Apr 05 11:58:03.989851 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 529/1012] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:03 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:03.990030 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ee00183d-5437-44a0-aae5-903f24c56ec1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049369 Apr 05 11:58:03.990549 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 484/1013] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:03 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:04.844905 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-96ecae90-bca2-4430-98ca-8ed77cfca804 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:04.846251 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-96ecae90-bca2-4430-98ca-8ed77cfca804 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:04.855947 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-96ecae90-bca2-4430-98ca-8ed77cfca804 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:04.856734 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-96ecae90-bca2-4430-98ca-8ed77cfca804 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:04.857960 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-96ecae90-bca2-4430-98ca-8ed77cfca804 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:04.858664 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-96ecae90-bca2-4430-98ca-8ed77cfca804 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:04.891741 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-96ecae90-bca2-4430-98ca-8ed77cfca804 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054273 Apr 05 11:58:04.892315 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 530/1014] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:04 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:05.004842 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-08fd7554-c3c1-42fd-83b1-dbeec0287b80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:05.005847 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a5c8208d-4749-4742-a955-031421ee3f64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:05.006480 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-08fd7554-c3c1-42fd-83b1-dbeec0287b80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:05.007357 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a5c8208d-4749-4742-a955-031421ee3f64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:05.016842 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-08fd7554-c3c1-42fd-83b1-dbeec0287b80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:05.017576 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-08fd7554-c3c1-42fd-83b1-dbeec0287b80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:05.018033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5c8208d-4749-4742-a955-031421ee3f64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:05.018778 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5c8208d-4749-4742-a955-031421ee3f64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:05.019038 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-08fd7554-c3c1-42fd-83b1-dbeec0287b80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:05.019520 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-08fd7554-c3c1-42fd-83b1-dbeec0287b80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:05.020273 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5c8208d-4749-4742-a955-031421ee3f64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:05.021041 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5c8208d-4749-4742-a955-031421ee3f64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:05.051630 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-08fd7554-c3c1-42fd-83b1-dbeec0287b80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053394 Apr 05 11:58:05.052207 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 485/1015] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:04 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:05.052912 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a5c8208d-4749-4742-a955-031421ee3f64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053874 Apr 05 11:58:05.053507 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 531/1016] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:04 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:05.907556 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1f9df6d7-f559-4755-b713-aa6534bd3ec6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:05.908954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1f9df6d7-f559-4755-b713-aa6534bd3ec6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:05.918612 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1f9df6d7-f559-4755-b713-aa6534bd3ec6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:05.919057 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1f9df6d7-f559-4755-b713-aa6534bd3ec6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:05.919818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1f9df6d7-f559-4755-b713-aa6534bd3ec6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:05.920284 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1f9df6d7-f559-4755-b713-aa6534bd3ec6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:05.949001 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1f9df6d7-f559-4755-b713-aa6534bd3ec6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048468 Apr 05 11:58:05.949541 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 486/1017] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:05 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:06.066282 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3a53b875-7359-4320-bf8c-e2a8721d4940 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:06.066889 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b45c1fdf-ed3c-46ea-8644-268187cdab2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:06.067264 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3a53b875-7359-4320-bf8c-e2a8721d4940 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:06.067872 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b45c1fdf-ed3c-46ea-8644-268187cdab2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:06.076448 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a53b875-7359-4320-bf8c-e2a8721d4940 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:06.076890 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a53b875-7359-4320-bf8c-e2a8721d4940 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:06.077043 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b45c1fdf-ed3c-46ea-8644-268187cdab2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:06.077395 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b45c1fdf-ed3c-46ea-8644-268187cdab2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:06.077646 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a53b875-7359-4320-bf8c-e2a8721d4940 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:06.078079 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a53b875-7359-4320-bf8c-e2a8721d4940 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:06.078237 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b45c1fdf-ed3c-46ea-8644-268187cdab2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:06.078611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b45c1fdf-ed3c-46ea-8644-268187cdab2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:06.106971 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3a53b875-7359-4320-bf8c-e2a8721d4940 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046948 Apr 05 11:58:06.107533 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 532/1018] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:06 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:06.108300 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b45c1fdf-ed3c-46ea-8644-268187cdab2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047352 Apr 05 11:58:06.108895 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 487/1019] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:06 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:58:06.965400 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2a7a8363-9259-4392-9565-e8d8c1a8603e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:06.966925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2a7a8363-9259-4392-9565-e8d8c1a8603e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:06.977057 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2a7a8363-9259-4392-9565-e8d8c1a8603e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:06.977789 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2a7a8363-9259-4392-9565-e8d8c1a8603e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:06.979027 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2a7a8363-9259-4392-9565-e8d8c1a8603e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:06.979732 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2a7a8363-9259-4392-9565-e8d8c1a8603e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:07.009702 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2a7a8363-9259-4392-9565-e8d8c1a8603e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051408 Apr 05 11:58:07.010261 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 533/1020] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:06 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:07.122599 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2ecfbeb1-e76d-469c-9376-4c0b27446c5d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:07.123285 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-152abacb-5a0f-4bc4-9957-4c2b408cbef7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:07.123731 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2ecfbeb1-e76d-469c-9376-4c0b27446c5d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:07.124229 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-152abacb-5a0f-4bc4-9957-4c2b408cbef7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:07.130133 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ecfbeb1-e76d-469c-9376-4c0b27446c5d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:07.130580 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ecfbeb1-e76d-469c-9376-4c0b27446c5d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:07.130765 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-152abacb-5a0f-4bc4-9957-4c2b408cbef7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:07.131153 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-152abacb-5a0f-4bc4-9957-4c2b408cbef7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:07.131301 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ecfbeb1-e76d-469c-9376-4c0b27446c5d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:07.131755 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ecfbeb1-e76d-469c-9376-4c0b27446c5d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:07.131898 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-152abacb-5a0f-4bc4-9957-4c2b408cbef7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:07.132377 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-152abacb-5a0f-4bc4-9957-4c2b408cbef7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:07.160896 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2ecfbeb1-e76d-469c-9376-4c0b27446c5d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044611 Apr 05 11:58:07.161395 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-152abacb-5a0f-4bc4-9957-4c2b408cbef7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044074 Apr 05 11:58:07.161558 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 488/1021] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:07 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:07.161943 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 534/1022] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:07 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:08.025828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6a980e0c-11a1-4a22-9e95-c6ddf57b7cd7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:08.027308 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6a980e0c-11a1-4a22-9e95-c6ddf57b7cd7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:08.034296 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6a980e0c-11a1-4a22-9e95-c6ddf57b7cd7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:08.034743 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6a980e0c-11a1-4a22-9e95-c6ddf57b7cd7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:08.035500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6a980e0c-11a1-4a22-9e95-c6ddf57b7cd7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:08.036277 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6a980e0c-11a1-4a22-9e95-c6ddf57b7cd7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:08.068757 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6a980e0c-11a1-4a22-9e95-c6ddf57b7cd7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049531 Apr 05 11:58:08.069323 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 489/1023] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:08 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:08.176863 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-19a26bc3-a7cc-40d5-8c7a-b69325f699c7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:08.177749 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e2477405-ab99-4678-a059-c470e427c81b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:08.178318 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e2477405-ab99-4678-a059-c470e427c81b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:08.178447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-19a26bc3-a7cc-40d5-8c7a-b69325f699c7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:08.188821 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-19a26bc3-a7cc-40d5-8c7a-b69325f699c7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:08.189106 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e2477405-ab99-4678-a059-c470e427c81b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:08.189636 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-19a26bc3-a7cc-40d5-8c7a-b69325f699c7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:08.189876 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e2477405-ab99-4678-a059-c470e427c81b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:08.190997 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e2477405-ab99-4678-a059-c470e427c81b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:08.191241 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-19a26bc3-a7cc-40d5-8c7a-b69325f699c7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:08.191723 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e2477405-ab99-4678-a059-c470e427c81b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:08.192011 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-19a26bc3-a7cc-40d5-8c7a-b69325f699c7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:08.224447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e2477405-ab99-4678-a059-c470e427c81b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053879 Apr 05 11:58:08.225011 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 490/1024] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:08 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:08.225167 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-19a26bc3-a7cc-40d5-8c7a-b69325f699c7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054707 Apr 05 11:58:08.225569 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 535/1025] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:08 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:09.081150 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-aaeb31af-05e4-4d52-9369-ea3fc8d1ccdd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:09.082065 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-aaeb31af-05e4-4d52-9369-ea3fc8d1ccdd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:09.088456 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aaeb31af-05e4-4d52-9369-ea3fc8d1ccdd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:09.089267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aaeb31af-05e4-4d52-9369-ea3fc8d1ccdd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:09.090031 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aaeb31af-05e4-4d52-9369-ea3fc8d1ccdd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:09.090466 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aaeb31af-05e4-4d52-9369-ea3fc8d1ccdd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:09.119676 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-aaeb31af-05e4-4d52-9369-ea3fc8d1ccdd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042526 Apr 05 11:58:09.120261 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 491/1026] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:09 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:09.240194 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f5ced581-1ed4-43ec-b9e2-d373f6dd65df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:09.241175 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f1bd62ca-7989-4d99-82e8-81b717a2bb9a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:09.241800 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f5ced581-1ed4-43ec-b9e2-d373f6dd65df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:09.241985 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f1bd62ca-7989-4d99-82e8-81b717a2bb9a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:09.250294 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f1bd62ca-7989-4d99-82e8-81b717a2bb9a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:09.250708 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f1bd62ca-7989-4d99-82e8-81b717a2bb9a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:09.250870 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f5ced581-1ed4-43ec-b9e2-d373f6dd65df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:09.251310 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f5ced581-1ed4-43ec-b9e2-d373f6dd65df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:09.251489 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f1bd62ca-7989-4d99-82e8-81b717a2bb9a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:09.251944 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f1bd62ca-7989-4d99-82e8-81b717a2bb9a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:09.252114 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f5ced581-1ed4-43ec-b9e2-d373f6dd65df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:09.252535 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f5ced581-1ed4-43ec-b9e2-d373f6dd65df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:09.280922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f1bd62ca-7989-4d99-82e8-81b717a2bb9a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047317 Apr 05 11:58:09.281199 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f5ced581-1ed4-43ec-b9e2-d373f6dd65df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047468 Apr 05 11:58:09.281974 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 492/1028] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:09 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:09.282102 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 536/1028] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:09 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:10.135849 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-36c8d22b-18aa-46e3-8678-023f02f83f7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:10.137359 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-36c8d22b-18aa-46e3-8678-023f02f83f7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:10.147485 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-36c8d22b-18aa-46e3-8678-023f02f83f7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:10.148279 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-36c8d22b-18aa-46e3-8678-023f02f83f7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:10.149517 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-36c8d22b-18aa-46e3-8678-023f02f83f7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:10.150233 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-36c8d22b-18aa-46e3-8678-023f02f83f7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:10.180500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-36c8d22b-18aa-46e3-8678-023f02f83f7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051376 Apr 05 11:58:10.181053 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 493/1029] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:10 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:10.295990 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0c5e600e-143d-4059-b970-7d377152cf6d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:10.297038 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bebdbe82-3f21-4710-bcaa-ea84a1a2ad42 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:10.297658 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0c5e600e-143d-4059-b970-7d377152cf6d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:10.297811 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bebdbe82-3f21-4710-bcaa-ea84a1a2ad42 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:10.308276 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0c5e600e-143d-4059-b970-7d377152cf6d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:10.308566 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bebdbe82-3f21-4710-bcaa-ea84a1a2ad42 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:10.309026 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bebdbe82-3f21-4710-bcaa-ea84a1a2ad42 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:10.309288 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0c5e600e-143d-4059-b970-7d377152cf6d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:10.310261 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0c5e600e-143d-4059-b970-7d377152cf6d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:10.310405 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bebdbe82-3f21-4710-bcaa-ea84a1a2ad42 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:10.310699 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0c5e600e-143d-4059-b970-7d377152cf6d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:10.310898 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bebdbe82-3f21-4710-bcaa-ea84a1a2ad42 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:10.339649 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0c5e600e-143d-4059-b970-7d377152cf6d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049912 Apr 05 11:58:10.339991 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bebdbe82-3f21-4710-bcaa-ea84a1a2ad42 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050201 Apr 05 11:58:10.343648 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 537/1030] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:10 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:10.343794 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 494/1031] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:10 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:11.196726 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bb670370-29e9-47a3-ba0a-cba58eb7ec89 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:11.198212 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bb670370-29e9-47a3-ba0a-cba58eb7ec89 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:11.205863 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bb670370-29e9-47a3-ba0a-cba58eb7ec89 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:11.206312 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bb670370-29e9-47a3-ba0a-cba58eb7ec89 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:11.207069 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bb670370-29e9-47a3-ba0a-cba58eb7ec89 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:11.207500 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bb670370-29e9-47a3-ba0a-cba58eb7ec89 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:11.236702 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bb670370-29e9-47a3-ba0a-cba58eb7ec89 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046828 Apr 05 11:58:11.237242 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 538/1032] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:11 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:11.355365 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-42882655-0e40-485b-b3de-64aa15cc1ac6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:11.356594 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9f8f4120-49d4-4de9-b0a9-4a2276a4b1de tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:11.357591 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-42882655-0e40-485b-b3de-64aa15cc1ac6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:11.357772 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9f8f4120-49d4-4de9-b0a9-4a2276a4b1de tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:11.363585 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9f8f4120-49d4-4de9-b0a9-4a2276a4b1de tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:11.363871 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-42882655-0e40-485b-b3de-64aa15cc1ac6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:11.364013 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9f8f4120-49d4-4de9-b0a9-4a2276a4b1de tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:11.364352 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-42882655-0e40-485b-b3de-64aa15cc1ac6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:11.364844 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9f8f4120-49d4-4de9-b0a9-4a2276a4b1de tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:11.365127 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-42882655-0e40-485b-b3de-64aa15cc1ac6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:11.365261 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9f8f4120-49d4-4de9-b0a9-4a2276a4b1de tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:11.365557 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-42882655-0e40-485b-b3de-64aa15cc1ac6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:11.395889 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9f8f4120-49d4-4de9-b0a9-4a2276a4b1de tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046905 Apr 05 11:58:11.396374 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-42882655-0e40-485b-b3de-64aa15cc1ac6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047427 Apr 05 11:58:11.396526 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 495/1033] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:11 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:11.396924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 539/1034] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:11 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:12.251183 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-42b67d9b-973d-4547-85b9-470a9ee65f29 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:12.252284 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-42b67d9b-973d-4547-85b9-470a9ee65f29 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:12.259727 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-42b67d9b-973d-4547-85b9-470a9ee65f29 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:12.260280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-42b67d9b-973d-4547-85b9-470a9ee65f29 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:12.261170 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-42b67d9b-973d-4547-85b9-470a9ee65f29 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:12.261671 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-42b67d9b-973d-4547-85b9-470a9ee65f29 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:12.292602 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-42b67d9b-973d-4547-85b9-470a9ee65f29 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047153 Apr 05 11:58:12.293129 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 496/1035] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:12 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:12.410241 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-769899c0-269b-4560-abac-99590b34bd1f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:12.410829 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d8eec006-2260-48b2-9949-cd58976db4bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:12.411187 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-769899c0-269b-4560-abac-99590b34bd1f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:12.411602 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d8eec006-2260-48b2-9949-cd58976db4bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:12.417889 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-769899c0-269b-4560-abac-99590b34bd1f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:12.418143 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d8eec006-2260-48b2-9949-cd58976db4bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:12.418326 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-769899c0-269b-4560-abac-99590b34bd1f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:12.418587 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d8eec006-2260-48b2-9949-cd58976db4bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:12.419100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-769899c0-269b-4560-abac-99590b34bd1f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:12.419368 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d8eec006-2260-48b2-9949-cd58976db4bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:12.419508 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-769899c0-269b-4560-abac-99590b34bd1f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:12.419805 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d8eec006-2260-48b2-9949-cd58976db4bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:12.449057 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d8eec006-2260-48b2-9949-cd58976db4bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043242 Apr 05 11:58:12.449622 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 497/1036] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:12 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:12.450897 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-769899c0-269b-4560-abac-99590b34bd1f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045949 Apr 05 11:58:12.451501 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 540/1037] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:12 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:13.308856 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bb7c6d6a-0a67-436e-87bf-566a17f59af2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:13.310480 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bb7c6d6a-0a67-436e-87bf-566a17f59af2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:13.317492 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bb7c6d6a-0a67-436e-87bf-566a17f59af2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:13.317982 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bb7c6d6a-0a67-436e-87bf-566a17f59af2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:13.318821 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bb7c6d6a-0a67-436e-87bf-566a17f59af2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:13.319298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bb7c6d6a-0a67-436e-87bf-566a17f59af2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:13.350192 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bb7c6d6a-0a67-436e-87bf-566a17f59af2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048186 Apr 05 11:58:13.350720 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 498/1038] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:13 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:13.465055 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-be3826b0-5303-4231-9711-c90e9a34323d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:13.465723 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-028c914f-de84-40f6-8230-3dce58fc8d14 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:13.466096 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-be3826b0-5303-4231-9711-c90e9a34323d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:13.466626 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-028c914f-de84-40f6-8230-3dce58fc8d14 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:13.475283 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-be3826b0-5303-4231-9711-c90e9a34323d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:13.475501 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-028c914f-de84-40f6-8230-3dce58fc8d14 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:13.475715 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-be3826b0-5303-4231-9711-c90e9a34323d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:13.476045 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-028c914f-de84-40f6-8230-3dce58fc8d14 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:13.476791 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-be3826b0-5303-4231-9711-c90e9a34323d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:13.477054 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-028c914f-de84-40f6-8230-3dce58fc8d14 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:13.477223 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-be3826b0-5303-4231-9711-c90e9a34323d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:13.477692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-028c914f-de84-40f6-8230-3dce58fc8d14 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:13.508641 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-be3826b0-5303-4231-9711-c90e9a34323d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050510 Apr 05 11:58:13.508863 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-028c914f-de84-40f6-8230-3dce58fc8d14 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049403 Apr 05 11:58:13.509203 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 541/1039] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:13 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:13.509358 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 499/1040] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:13 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:14.366514 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b48f597f-de45-4b36-9879-0499debedb4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:14.368003 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b48f597f-de45-4b36-9879-0499debedb4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:14.378128 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b48f597f-de45-4b36-9879-0499debedb4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:14.378871 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b48f597f-de45-4b36-9879-0499debedb4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:14.380163 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b48f597f-de45-4b36-9879-0499debedb4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:14.380892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b48f597f-de45-4b36-9879-0499debedb4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:14.412032 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b48f597f-de45-4b36-9879-0499debedb4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052299 Apr 05 11:58:14.412849 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 542/1041] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:14 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:14.520639 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-58e16a11-cde2-4343-a92c-471f96505547 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:14.521249 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-74006152-9932-4ec9-baf8-1d3a283ea4ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:14.521621 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-58e16a11-cde2-4343-a92c-471f96505547 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:14.521727 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-74006152-9932-4ec9-baf8-1d3a283ea4ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:14.528303 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-58e16a11-cde2-4343-a92c-471f96505547 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:14.528743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-58e16a11-cde2-4343-a92c-471f96505547 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:14.528901 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-74006152-9932-4ec9-baf8-1d3a283ea4ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:14.529226 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-74006152-9932-4ec9-baf8-1d3a283ea4ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:14.529572 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-58e16a11-cde2-4343-a92c-471f96505547 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:14.530002 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-58e16a11-cde2-4343-a92c-471f96505547 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:14.530155 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-74006152-9932-4ec9-baf8-1d3a283ea4ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:14.530440 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-74006152-9932-4ec9-baf8-1d3a283ea4ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:14.559252 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-74006152-9932-4ec9-baf8-1d3a283ea4ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042565 Apr 05 11:58:14.559490 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-58e16a11-cde2-4343-a92c-471f96505547 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042649 Apr 05 11:58:14.560017 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 500/1042] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:14 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:14.560257 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 543/1043] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:14 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:15.428128 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-74c700d0-e647-4109-a2bf-0af296335ae8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:15.429609 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-74c700d0-e647-4109-a2bf-0af296335ae8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:15.438351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-74c700d0-e647-4109-a2bf-0af296335ae8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:15.438804 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-74c700d0-e647-4109-a2bf-0af296335ae8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:15.439571 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-74c700d0-e647-4109-a2bf-0af296335ae8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:15.440007 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-74c700d0-e647-4109-a2bf-0af296335ae8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:15.469598 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-74c700d0-e647-4109-a2bf-0af296335ae8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048206 Apr 05 11:58:15.470153 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 501/1044] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:15 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:15.575385 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-258e95fe-2708-4eca-9f88-6565717289de tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:15.576387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-22dda7c9-f200-4c01-8dac-00a8c9d671d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:15.577024 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-258e95fe-2708-4eca-9f88-6565717289de tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:15.577198 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-22dda7c9-f200-4c01-8dac-00a8c9d671d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:15.587475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-22dda7c9-f200-4c01-8dac-00a8c9d671d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:15.587767 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-258e95fe-2708-4eca-9f88-6565717289de tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:15.588724 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-22dda7c9-f200-4c01-8dac-00a8c9d671d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:15.588976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-258e95fe-2708-4eca-9f88-6565717289de tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:15.589986 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-22dda7c9-f200-4c01-8dac-00a8c9d671d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:15.590224 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-258e95fe-2708-4eca-9f88-6565717289de tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:15.590705 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-22dda7c9-f200-4c01-8dac-00a8c9d671d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:15.590943 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-258e95fe-2708-4eca-9f88-6565717289de tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:15.620446 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-22dda7c9-f200-4c01-8dac-00a8c9d671d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051831 Apr 05 11:58:15.620686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-258e95fe-2708-4eca-9f88-6565717289de tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051799 Apr 05 11:58:15.621048 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 544/1045] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:15 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:15.621513 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 502/1046] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:15 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:16.480818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b47841d0-3bca-4eb1-aff7-93f247d575d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:16.481730 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b47841d0-3bca-4eb1-aff7-93f247d575d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:16.488198 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b47841d0-3bca-4eb1-aff7-93f247d575d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:16.488642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b47841d0-3bca-4eb1-aff7-93f247d575d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:16.489392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b47841d0-3bca-4eb1-aff7-93f247d575d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:16.489791 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b47841d0-3bca-4eb1-aff7-93f247d575d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:16.519488 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b47841d0-3bca-4eb1-aff7-93f247d575d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042679 Apr 05 11:58:16.520047 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 545/1047] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:16 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:16.635239 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bdebb611-d41e-4d54-b191-6925499f7285 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:16.636174 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b0674035-b147-4d87-954a-5d239ced6e43 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:16.636787 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bdebb611-d41e-4d54-b191-6925499f7285 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:16.637329 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b0674035-b147-4d87-954a-5d239ced6e43 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:16.644092 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bdebb611-d41e-4d54-b191-6925499f7285 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:16.644264 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b0674035-b147-4d87-954a-5d239ced6e43 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:16.644565 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bdebb611-d41e-4d54-b191-6925499f7285 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:16.644735 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b0674035-b147-4d87-954a-5d239ced6e43 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:16.645330 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bdebb611-d41e-4d54-b191-6925499f7285 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:16.645471 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b0674035-b147-4d87-954a-5d239ced6e43 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:16.645765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bdebb611-d41e-4d54-b191-6925499f7285 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:16.645926 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b0674035-b147-4d87-954a-5d239ced6e43 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:16.674762 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bdebb611-d41e-4d54-b191-6925499f7285 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046129 Apr 05 11:58:16.675009 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b0674035-b147-4d87-954a-5d239ced6e43 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045562 Apr 05 11:58:16.675312 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 546/1048] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:16 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:16.678645 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 503/1049] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:16 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:17.533602 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-de76eda7-3f93-4ace-b711-ca37e826a16b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:17.535496 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-de76eda7-3f93-4ace-b711-ca37e826a16b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:17.545661 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-de76eda7-3f93-4ace-b711-ca37e826a16b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:17.546382 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-de76eda7-3f93-4ace-b711-ca37e826a16b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:17.547748 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-de76eda7-3f93-4ace-b711-ca37e826a16b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:17.548523 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-de76eda7-3f93-4ace-b711-ca37e826a16b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:17.581839 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-de76eda7-3f93-4ace-b711-ca37e826a16b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054248 Apr 05 11:58:17.582384 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 547/1050] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:17 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:17.688480 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-40cbad1c-f7c9-45d5-a77e-57f7d8c38ecb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:17.689185 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-daccb6e4-22e5-4bbd-918d-eacc9eb7856d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:17.689552 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-daccb6e4-22e5-4bbd-918d-eacc9eb7856d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:17.689647 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-40cbad1c-f7c9-45d5-a77e-57f7d8c38ecb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:17.696008 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-daccb6e4-22e5-4bbd-918d-eacc9eb7856d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:17.696223 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-40cbad1c-f7c9-45d5-a77e-57f7d8c38ecb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:17.696531 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-daccb6e4-22e5-4bbd-918d-eacc9eb7856d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:17.696688 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-40cbad1c-f7c9-45d5-a77e-57f7d8c38ecb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:17.697288 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-daccb6e4-22e5-4bbd-918d-eacc9eb7856d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:17.697432 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-40cbad1c-f7c9-45d5-a77e-57f7d8c38ecb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:17.697726 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-daccb6e4-22e5-4bbd-918d-eacc9eb7856d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:17.697882 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-40cbad1c-f7c9-45d5-a77e-57f7d8c38ecb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:17.726741 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-daccb6e4-22e5-4bbd-918d-eacc9eb7856d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043189 Apr 05 11:58:17.727248 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 504/1051] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:17 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:17.727472 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-40cbad1c-f7c9-45d5-a77e-57f7d8c38ecb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043821 Apr 05 11:58:17.728185 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 548/1052] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:17 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:18.598475 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2ea9b104-cdeb-4982-975b-3a6afc71ea37 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:18.599975 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2ea9b104-cdeb-4982-975b-3a6afc71ea37 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:18.609057 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ea9b104-cdeb-4982-975b-3a6afc71ea37 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:18.609497 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ea9b104-cdeb-4982-975b-3a6afc71ea37 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:18.610244 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ea9b104-cdeb-4982-975b-3a6afc71ea37 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:18.610671 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ea9b104-cdeb-4982-975b-3a6afc71ea37 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:18.640844 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2ea9b104-cdeb-4982-975b-3a6afc71ea37 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049280 Apr 05 11:58:18.641383 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 505/1053] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:18 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:18.742713 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0429df62-5258-4b00-b065-79c23fe1c5bc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:18.743842 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7f328447-2e04-45be-afd1-b47ed37b30fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:18.744542 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0429df62-5258-4b00-b065-79c23fe1c5bc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:18.744709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7f328447-2e04-45be-afd1-b47ed37b30fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:18.754910 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0429df62-5258-4b00-b065-79c23fe1c5bc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:18.755226 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7f328447-2e04-45be-afd1-b47ed37b30fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:18.755676 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0429df62-5258-4b00-b065-79c23fe1c5bc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:18.756178 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7f328447-2e04-45be-afd1-b47ed37b30fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:18.757040 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0429df62-5258-4b00-b065-79c23fe1c5bc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:18.757429 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7f328447-2e04-45be-afd1-b47ed37b30fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:18.757735 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0429df62-5258-4b00-b065-79c23fe1c5bc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:18.758401 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7f328447-2e04-45be-afd1-b47ed37b30fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:18.789241 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0429df62-5258-4b00-b065-79c23fe1c5bc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053096 Apr 05 11:58:18.789598 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7f328447-2e04-45be-afd1-b47ed37b30fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053458 Apr 05 11:58:18.789760 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 506/1054] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:18 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:18.790139 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 549/1055] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:18 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:19.658465 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-84a96b12-268b-438f-96ef-48358977445c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:19.659987 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-84a96b12-268b-438f-96ef-48358977445c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:19.670568 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-84a96b12-268b-438f-96ef-48358977445c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:19.671022 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-84a96b12-268b-438f-96ef-48358977445c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:19.671795 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-84a96b12-268b-438f-96ef-48358977445c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:19.672275 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-84a96b12-268b-438f-96ef-48358977445c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:19.702203 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-84a96b12-268b-438f-96ef-48358977445c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050969 Apr 05 11:58:19.702755 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 507/1056] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:19 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:19.803604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5d92d0bd-a149-4114-ac8b-486a8c9440c1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:19.804298 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-899bde2e-833c-46f1-8a9d-c2ddbd6233d5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:19.804666 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-899bde2e-833c-46f1-8a9d-c2ddbd6233d5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:19.804760 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5d92d0bd-a149-4114-ac8b-486a8c9440c1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:19.812675 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-899bde2e-833c-46f1-8a9d-c2ddbd6233d5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:19.812955 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d92d0bd-a149-4114-ac8b-486a8c9440c1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:19.813107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-899bde2e-833c-46f1-8a9d-c2ddbd6233d5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:19.813407 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d92d0bd-a149-4114-ac8b-486a8c9440c1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:19.813882 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-899bde2e-833c-46f1-8a9d-c2ddbd6233d5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:19.814182 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d92d0bd-a149-4114-ac8b-486a8c9440c1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:19.814338 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-899bde2e-833c-46f1-8a9d-c2ddbd6233d5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:19.814621 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d92d0bd-a149-4114-ac8b-486a8c9440c1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:19.843404 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5d92d0bd-a149-4114-ac8b-486a8c9440c1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045839 Apr 05 11:58:19.843691 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-899bde2e-833c-46f1-8a9d-c2ddbd6233d5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046151 Apr 05 11:58:19.843959 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 508/1057] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:19 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:19.844582 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 550/1058] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:19 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:20.714806 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c77021f1-89c1-4a4a-9e55-00eb6abe85a8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:20.715720 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c77021f1-89c1-4a4a-9e55-00eb6abe85a8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:20.722291 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c77021f1-89c1-4a4a-9e55-00eb6abe85a8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:20.722773 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c77021f1-89c1-4a4a-9e55-00eb6abe85a8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:20.723542 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c77021f1-89c1-4a4a-9e55-00eb6abe85a8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:20.723989 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c77021f1-89c1-4a4a-9e55-00eb6abe85a8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:20.752795 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c77021f1-89c1-4a4a-9e55-00eb6abe85a8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042361 Apr 05 11:58:20.753348 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 509/1059] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:20 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:20.858113 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-37d24001-04bf-4d22-a806-de203bde2d68 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:20.858861 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-71c1ac91-76eb-4b00-81f2-121ab8a3d308 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:20.859246 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-37d24001-04bf-4d22-a806-de203bde2d68 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:20.859494 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-71c1ac91-76eb-4b00-81f2-121ab8a3d308 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:20.865879 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37d24001-04bf-4d22-a806-de203bde2d68 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:20.866355 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37d24001-04bf-4d22-a806-de203bde2d68 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:20.866973 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71c1ac91-76eb-4b00-81f2-121ab8a3d308 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:20.867151 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37d24001-04bf-4d22-a806-de203bde2d68 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:20.867381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71c1ac91-76eb-4b00-81f2-121ab8a3d308 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:20.867535 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37d24001-04bf-4d22-a806-de203bde2d68 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:20.868204 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71c1ac91-76eb-4b00-81f2-121ab8a3d308 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:20.868878 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71c1ac91-76eb-4b00-81f2-121ab8a3d308 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:20.896443 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-37d24001-04bf-4d22-a806-de203bde2d68 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044178 Apr 05 11:58:20.897251 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 510/1060] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:20 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:20.898093 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-71c1ac91-76eb-4b00-81f2-121ab8a3d308 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045885 Apr 05 11:58:20.898639 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 551/1061] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:20 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:21.767035 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bfcf36ea-a67b-403e-bc79-93487317af35 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:21.768182 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bfcf36ea-a67b-403e-bc79-93487317af35 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:21.774505 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bfcf36ea-a67b-403e-bc79-93487317af35 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:21.775366 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bfcf36ea-a67b-403e-bc79-93487317af35 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:21.775747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bfcf36ea-a67b-403e-bc79-93487317af35 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:21.776290 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bfcf36ea-a67b-403e-bc79-93487317af35 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:21.804989 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bfcf36ea-a67b-403e-bc79-93487317af35 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042633 Apr 05 11:58:21.805560 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 511/1062] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:21 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:21.910286 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-eec26a73-449a-440f-a566-c01c6ad76e54 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:21.911023 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-32ac20bf-86b5-4d07-b522-2d2d104654ce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:21.911674 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-eec26a73-449a-440f-a566-c01c6ad76e54 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:21.912198 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-32ac20bf-86b5-4d07-b522-2d2d104654ce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:21.920046 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eec26a73-449a-440f-a566-c01c6ad76e54 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:21.920503 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eec26a73-449a-440f-a566-c01c6ad76e54 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:21.920668 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-32ac20bf-86b5-4d07-b522-2d2d104654ce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:21.921030 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-32ac20bf-86b5-4d07-b522-2d2d104654ce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:21.921286 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eec26a73-449a-440f-a566-c01c6ad76e54 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:21.921715 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eec26a73-449a-440f-a566-c01c6ad76e54 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:21.921871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-32ac20bf-86b5-4d07-b522-2d2d104654ce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:21.922206 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-32ac20bf-86b5-4d07-b522-2d2d104654ce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:21.951113 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-eec26a73-449a-440f-a566-c01c6ad76e54 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046413 Apr 05 11:58:21.951377 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-32ac20bf-86b5-4d07-b522-2d2d104654ce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044902 Apr 05 11:58:21.951680 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 512/1063] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:21 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:58:21.951979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 552/1064] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:21 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:22.818363 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-65a4c7ff-be84-4f85-be7a-5c7efcc0bad1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:22.819312 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-65a4c7ff-be84-4f85-be7a-5c7efcc0bad1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:22.825821 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-65a4c7ff-be84-4f85-be7a-5c7efcc0bad1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:22.826262 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-65a4c7ff-be84-4f85-be7a-5c7efcc0bad1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:22.827046 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-65a4c7ff-be84-4f85-be7a-5c7efcc0bad1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:22.827470 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-65a4c7ff-be84-4f85-be7a-5c7efcc0bad1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:22.859081 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-65a4c7ff-be84-4f85-be7a-5c7efcc0bad1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045397 Apr 05 11:58:22.859644 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 513/1065] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:22 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:22.966987 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-85455a42-7914-4214-9bb3-b95a8dedb1ba tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:22.967657 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f8944ea2-4f67-4586-850c-d9c93035c1b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:22.968048 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-85455a42-7914-4214-9bb3-b95a8dedb1ba tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:22.968185 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f8944ea2-4f67-4586-850c-d9c93035c1b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:22.974502 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f8944ea2-4f67-4586-850c-d9c93035c1b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:22.974691 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85455a42-7914-4214-9bb3-b95a8dedb1ba tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:22.974948 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85455a42-7914-4214-9bb3-b95a8dedb1ba tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:22.975093 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f8944ea2-4f67-4586-850c-d9c93035c1b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:22.975708 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85455a42-7914-4214-9bb3-b95a8dedb1ba tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:22.975848 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f8944ea2-4f67-4586-850c-d9c93035c1b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:22.976172 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85455a42-7914-4214-9bb3-b95a8dedb1ba tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:22.976345 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f8944ea2-4f67-4586-850c-d9c93035c1b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:23.005560 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-85455a42-7914-4214-9bb3-b95a8dedb1ba tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045241 Apr 05 11:58:23.005781 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f8944ea2-4f67-4586-850c-d9c93035c1b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045224 Apr 05 11:58:23.006114 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 553/1067] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:22 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:23.006309 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 514/1067] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:22 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:23.874909 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-719046eb-4552-4ae2-a38f-7ff23edf79a0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:23.876255 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-719046eb-4552-4ae2-a38f-7ff23edf79a0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:23.886487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-719046eb-4552-4ae2-a38f-7ff23edf79a0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:23.887276 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-719046eb-4552-4ae2-a38f-7ff23edf79a0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:23.888536 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-719046eb-4552-4ae2-a38f-7ff23edf79a0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:23.888972 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-719046eb-4552-4ae2-a38f-7ff23edf79a0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:23.920015 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-719046eb-4552-4ae2-a38f-7ff23edf79a0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051573 Apr 05 11:58:23.920597 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 554/1068] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:23 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:24.017717 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-074cf9fe-953e-4625-a5e0-9b15e61f9a62 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:24.018323 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7a95bc4e-6536-413e-a151-dd76f629ef5a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:24.018681 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-074cf9fe-953e-4625-a5e0-9b15e61f9a62 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:24.018781 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7a95bc4e-6536-413e-a151-dd76f629ef5a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:24.025287 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-074cf9fe-953e-4625-a5e0-9b15e61f9a62 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:24.025752 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-074cf9fe-953e-4625-a5e0-9b15e61f9a62 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:24.026023 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a95bc4e-6536-413e-a151-dd76f629ef5a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:24.026432 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a95bc4e-6536-413e-a151-dd76f629ef5a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:24.026585 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-074cf9fe-953e-4625-a5e0-9b15e61f9a62 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:24.026909 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-074cf9fe-953e-4625-a5e0-9b15e61f9a62 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:24.027502 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a95bc4e-6536-413e-a151-dd76f629ef5a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:24.027888 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a95bc4e-6536-413e-a151-dd76f629ef5a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:24.056918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-074cf9fe-953e-4625-a5e0-9b15e61f9a62 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043303 Apr 05 11:58:24.057475 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 515/1069] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:24 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:24.058054 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7a95bc4e-6536-413e-a151-dd76f629ef5a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044156 Apr 05 11:58:24.058601 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 555/1070] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:24 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:24.938134 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e7d31068-bef9-4216-a2ef-1e34cf92103b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:24.939622 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e7d31068-bef9-4216-a2ef-1e34cf92103b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:24.949782 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e7d31068-bef9-4216-a2ef-1e34cf92103b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:24.950498 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e7d31068-bef9-4216-a2ef-1e34cf92103b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:24.951479 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e7d31068-bef9-4216-a2ef-1e34cf92103b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:24.951936 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e7d31068-bef9-4216-a2ef-1e34cf92103b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:24.980512 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e7d31068-bef9-4216-a2ef-1e34cf92103b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049160 Apr 05 11:58:24.981060 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 516/1071] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:24 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:25.073050 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c917b115-a517-47d7-b6d1-6941eb2a93cc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:25.073907 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-dd79e66e-948a-40ad-8b80-f679ed689cbf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:25.074519 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c917b115-a517-47d7-b6d1-6941eb2a93cc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:25.074710 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-dd79e66e-948a-40ad-8b80-f679ed689cbf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:25.085421 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c917b115-a517-47d7-b6d1-6941eb2a93cc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:25.085763 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd79e66e-948a-40ad-8b80-f679ed689cbf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:25.086258 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c917b115-a517-47d7-b6d1-6941eb2a93cc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:25.086502 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd79e66e-948a-40ad-8b80-f679ed689cbf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:25.087543 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c917b115-a517-47d7-b6d1-6941eb2a93cc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:25.088239 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd79e66e-948a-40ad-8b80-f679ed689cbf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:25.088692 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c917b115-a517-47d7-b6d1-6941eb2a93cc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:25.089099 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd79e66e-948a-40ad-8b80-f679ed689cbf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:25.119003 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c917b115-a517-47d7-b6d1-6941eb2a93cc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052762 Apr 05 11:58:25.119240 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-dd79e66e-948a-40ad-8b80-f679ed689cbf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052247 Apr 05 11:58:25.119838 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 556/1072] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:25 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:25.119976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 517/1073] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:25 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:25.995835 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bf85da07-8f77-4d51-8c66-8f56a9951bc9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:25.997103 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bf85da07-8f77-4d51-8c66-8f56a9951bc9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:26.003888 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bf85da07-8f77-4d51-8c66-8f56a9951bc9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:26.004367 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bf85da07-8f77-4d51-8c66-8f56a9951bc9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:26.005123 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bf85da07-8f77-4d51-8c66-8f56a9951bc9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:26.005556 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bf85da07-8f77-4d51-8c66-8f56a9951bc9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:26.034831 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bf85da07-8f77-4d51-8c66-8f56a9951bc9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045667 Apr 05 11:58:26.035366 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 557/1074] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:25 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:26.134167 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b0f4994a-57ad-4c89-a9c2-ddc5e1baf202 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:26.134793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4679bd34-9868-41be-ba86-f1e98b867c40 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:26.135180 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b0f4994a-57ad-4c89-a9c2-ddc5e1baf202 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:26.135279 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4679bd34-9868-41be-ba86-f1e98b867c40 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:26.142778 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b0f4994a-57ad-4c89-a9c2-ddc5e1baf202 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:26.142969 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4679bd34-9868-41be-ba86-f1e98b867c40 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:26.143226 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4679bd34-9868-41be-ba86-f1e98b867c40 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:26.143381 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b0f4994a-57ad-4c89-a9c2-ddc5e1baf202 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:26.143986 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4679bd34-9868-41be-ba86-f1e98b867c40 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:26.144145 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b0f4994a-57ad-4c89-a9c2-ddc5e1baf202 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:26.144445 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4679bd34-9868-41be-ba86-f1e98b867c40 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:26.144588 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b0f4994a-57ad-4c89-a9c2-ddc5e1baf202 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:26.173526 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b0f4994a-57ad-4c89-a9c2-ddc5e1baf202 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045431 Apr 05 11:58:26.174213 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 518/1075] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:26 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:26.174512 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4679bd34-9868-41be-ba86-f1e98b867c40 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046472 Apr 05 11:58:26.175065 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 558/1076] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:26 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:27.051101 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-90a0ae9f-3b6e-47eb-88e6-8bb2f24e1854 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:27.052654 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-90a0ae9f-3b6e-47eb-88e6-8bb2f24e1854 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:27.062972 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-90a0ae9f-3b6e-47eb-88e6-8bb2f24e1854 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:27.063741 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-90a0ae9f-3b6e-47eb-88e6-8bb2f24e1854 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:27.065046 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-90a0ae9f-3b6e-47eb-88e6-8bb2f24e1854 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:27.065760 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-90a0ae9f-3b6e-47eb-88e6-8bb2f24e1854 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:27.098361 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-90a0ae9f-3b6e-47eb-88e6-8bb2f24e1854 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054085 Apr 05 11:58:27.098897 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 519/1077] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:27 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:27.189792 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ccb84607-2e61-4330-8694-27ac8cde093a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:27.190856 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-862971f4-5978-4256-a936-00b007c1b678 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:27.191553 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ccb84607-2e61-4330-8694-27ac8cde093a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:27.191730 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-862971f4-5978-4256-a936-00b007c1b678 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:27.201405 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ccb84607-2e61-4330-8694-27ac8cde093a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:27.201799 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-862971f4-5978-4256-a936-00b007c1b678 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:27.201968 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ccb84607-2e61-4330-8694-27ac8cde093a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:27.202251 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-862971f4-5978-4256-a936-00b007c1b678 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:27.202599 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ccb84607-2e61-4330-8694-27ac8cde093a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:27.203012 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-862971f4-5978-4256-a936-00b007c1b678 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:27.203156 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ccb84607-2e61-4330-8694-27ac8cde093a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:27.203443 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-862971f4-5978-4256-a936-00b007c1b678 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:27.232900 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ccb84607-2e61-4330-8694-27ac8cde093a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049410 Apr 05 11:58:27.233156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-862971f4-5978-4256-a936-00b007c1b678 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049722 Apr 05 11:58:27.233452 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 520/1078] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:27 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:27.233925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 559/1079] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:27 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:28.114198 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-27d95ecd-fbbd-412d-b654-a5b4dfdd9807 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:28.115628 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-27d95ecd-fbbd-412d-b654-a5b4dfdd9807 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:28.124477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-27d95ecd-fbbd-412d-b654-a5b4dfdd9807 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:28.124913 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-27d95ecd-fbbd-412d-b654-a5b4dfdd9807 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:28.125698 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-27d95ecd-fbbd-412d-b654-a5b4dfdd9807 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:28.126136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-27d95ecd-fbbd-412d-b654-a5b4dfdd9807 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:28.156521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-27d95ecd-fbbd-412d-b654-a5b4dfdd9807 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049074 Apr 05 11:58:28.157069 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 521/1080] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:28 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:28.248940 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-859b0e82-a871-40ae-8180-7056f8340ac8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:28.249525 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e63b444c-a698-4349-ad9e-0938e76f2453 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:28.249887 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-859b0e82-a871-40ae-8180-7056f8340ac8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:28.250367 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e63b444c-a698-4349-ad9e-0938e76f2453 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:28.256601 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-859b0e82-a871-40ae-8180-7056f8340ac8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:28.256886 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e63b444c-a698-4349-ad9e-0938e76f2453 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:28.257043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-859b0e82-a871-40ae-8180-7056f8340ac8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:28.257334 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e63b444c-a698-4349-ad9e-0938e76f2453 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:28.257815 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-859b0e82-a871-40ae-8180-7056f8340ac8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:28.258095 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e63b444c-a698-4349-ad9e-0938e76f2453 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:28.258235 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-859b0e82-a871-40ae-8180-7056f8340ac8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:28.258528 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e63b444c-a698-4349-ad9e-0938e76f2453 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:28.286913 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e63b444c-a698-4349-ad9e-0938e76f2453 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042977 Apr 05 11:58:28.287499 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 522/1081] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:28 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:28.287840 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-859b0e82-a871-40ae-8180-7056f8340ac8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045634 Apr 05 11:58:28.288759 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 560/1082] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:28 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:29.168448 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-32dfb690-01b2-4aa6-8c45-8e4f82d8ec6c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:29.169457 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-32dfb690-01b2-4aa6-8c45-8e4f82d8ec6c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:29.175897 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-32dfb690-01b2-4aa6-8c45-8e4f82d8ec6c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:29.176375 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-32dfb690-01b2-4aa6-8c45-8e4f82d8ec6c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:29.177135 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-32dfb690-01b2-4aa6-8c45-8e4f82d8ec6c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:29.177565 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-32dfb690-01b2-4aa6-8c45-8e4f82d8ec6c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:29.206780 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-32dfb690-01b2-4aa6-8c45-8e4f82d8ec6c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042423 Apr 05 11:58:29.207325 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 523/1083] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:29 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:29.302783 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ff27dcc4-f623-48db-8743-e4e40c094830 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:29.303843 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d600df80-f432-4f4f-bf94-4c91885850d0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:29.304520 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ff27dcc4-f623-48db-8743-e4e40c094830 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:29.304721 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d600df80-f432-4f4f-bf94-4c91885850d0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:29.314709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d600df80-f432-4f4f-bf94-4c91885850d0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:29.315142 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff27dcc4-f623-48db-8743-e4e40c094830 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:29.315449 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d600df80-f432-4f4f-bf94-4c91885850d0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:29.315835 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff27dcc4-f623-48db-8743-e4e40c094830 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:29.316743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d600df80-f432-4f4f-bf94-4c91885850d0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:29.316986 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff27dcc4-f623-48db-8743-e4e40c094830 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:29.317473 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d600df80-f432-4f4f-bf94-4c91885850d0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:29.317781 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff27dcc4-f623-48db-8743-e4e40c094830 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:29.350195 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d600df80-f432-4f4f-bf94-4c91885850d0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053738 Apr 05 11:58:29.350755 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 561/1084] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:29 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:29.351204 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ff27dcc4-f623-48db-8743-e4e40c094830 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054799 Apr 05 11:58:29.351881 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 524/1085] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:29 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:30.222224 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c5faa85c-e396-4dba-a357-b4f7589061b8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:30.223499 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c5faa85c-e396-4dba-a357-b4f7589061b8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:30.231737 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c5faa85c-e396-4dba-a357-b4f7589061b8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:30.232383 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c5faa85c-e396-4dba-a357-b4f7589061b8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:30.233376 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c5faa85c-e396-4dba-a357-b4f7589061b8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:30.233950 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c5faa85c-e396-4dba-a357-b4f7589061b8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:30.265895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c5faa85c-e396-4dba-a357-b4f7589061b8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049033 Apr 05 11:58:30.266430 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 562/1086] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:30 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:30.365556 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c81aa357-f2ac-4a1b-b06d-ef2c64d93918 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:30.366685 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8353a8a1-879d-4868-8d8c-bf575c2227cb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:30.368166 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c81aa357-f2ac-4a1b-b06d-ef2c64d93918 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:30.368432 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8353a8a1-879d-4868-8d8c-bf575c2227cb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:30.376460 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c81aa357-f2ac-4a1b-b06d-ef2c64d93918 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:30.376623 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8353a8a1-879d-4868-8d8c-bf575c2227cb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:30.376904 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c81aa357-f2ac-4a1b-b06d-ef2c64d93918 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:30.377074 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8353a8a1-879d-4868-8d8c-bf575c2227cb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:30.377663 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c81aa357-f2ac-4a1b-b06d-ef2c64d93918 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:30.377810 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8353a8a1-879d-4868-8d8c-bf575c2227cb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:30.378090 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c81aa357-f2ac-4a1b-b06d-ef2c64d93918 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:30.378252 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8353a8a1-879d-4868-8d8c-bf575c2227cb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:30.407482 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c81aa357-f2ac-4a1b-b06d-ef2c64d93918 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048604 Apr 05 11:58:30.407710 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8353a8a1-879d-4868-8d8c-bf575c2227cb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047435 Apr 05 11:58:30.408182 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 525/1087] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:30 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:30.408348 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 563/1088] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:30 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:31.281166 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-81d948f0-696a-485d-87b3-26674f2bf637 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:31.282675 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-81d948f0-696a-485d-87b3-26674f2bf637 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:31.292875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-81d948f0-696a-485d-87b3-26674f2bf637 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:31.293610 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-81d948f0-696a-485d-87b3-26674f2bf637 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:31.294854 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-81d948f0-696a-485d-87b3-26674f2bf637 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:31.295580 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-81d948f0-696a-485d-87b3-26674f2bf637 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:31.332275 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-81d948f0-696a-485d-87b3-26674f2bf637 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057611 Apr 05 11:58:31.332886 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 526/1089] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:31 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:31.421780 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d7e1cbe4-3be6-414e-9cb7-a981347231bc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:31.422470 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6b4b0e82-53e6-4a02-9adc-aac382fef215 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:31.422894 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6b4b0e82-53e6-4a02-9adc-aac382fef215 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:31.422991 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d7e1cbe4-3be6-414e-9cb7-a981347231bc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:31.429791 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d7e1cbe4-3be6-414e-9cb7-a981347231bc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:31.429978 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6b4b0e82-53e6-4a02-9adc-aac382fef215 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:31.430258 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6b4b0e82-53e6-4a02-9adc-aac382fef215 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:31.430424 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d7e1cbe4-3be6-414e-9cb7-a981347231bc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:31.431051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d7e1cbe4-3be6-414e-9cb7-a981347231bc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:31.431194 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6b4b0e82-53e6-4a02-9adc-aac382fef215 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:31.431505 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6b4b0e82-53e6-4a02-9adc-aac382fef215 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:31.431654 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d7e1cbe4-3be6-414e-9cb7-a981347231bc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:31.460980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d7e1cbe4-3be6-414e-9cb7-a981347231bc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044467 Apr 05 11:58:31.461569 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 527/1090] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:31 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:31.461734 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6b4b0e82-53e6-4a02-9adc-aac382fef215 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045252 Apr 05 11:58:31.462271 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 564/1091] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:31 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:32.350759 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cbaef329-837f-42e6-838d-69c58e26eae8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:32.352307 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cbaef329-837f-42e6-838d-69c58e26eae8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:32.360372 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cbaef329-837f-42e6-838d-69c58e26eae8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:32.360819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cbaef329-837f-42e6-838d-69c58e26eae8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:32.361574 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cbaef329-837f-42e6-838d-69c58e26eae8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:32.362003 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cbaef329-837f-42e6-838d-69c58e26eae8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:32.390586 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cbaef329-837f-42e6-838d-69c58e26eae8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046615 Apr 05 11:58:32.391116 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 528/1092] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:32 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:32.477495 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-943d6864-c930-4ad8-9d3f-c60f235c071e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:32.478433 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c0a667f1-2af7-4c66-9616-a09ecbe7ad80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:32.479030 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-943d6864-c930-4ad8-9d3f-c60f235c071e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:32.479195 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c0a667f1-2af7-4c66-9616-a09ecbe7ad80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:32.489363 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0a667f1-2af7-4c66-9616-a09ecbe7ad80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:32.489636 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-943d6864-c930-4ad8-9d3f-c60f235c071e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:32.490105 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0a667f1-2af7-4c66-9616-a09ecbe7ad80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:32.490304 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-943d6864-c930-4ad8-9d3f-c60f235c071e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:32.491398 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0a667f1-2af7-4c66-9616-a09ecbe7ad80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:32.491626 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-943d6864-c930-4ad8-9d3f-c60f235c071e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:32.492136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0a667f1-2af7-4c66-9616-a09ecbe7ad80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:32.492364 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-943d6864-c930-4ad8-9d3f-c60f235c071e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:32.523768 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-943d6864-c930-4ad8-9d3f-c60f235c071e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052896 Apr 05 11:58:32.524229 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c0a667f1-2af7-4c66-9616-a09ecbe7ad80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053102 Apr 05 11:58:32.524384 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 565/1093] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:32 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:32.525083 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 529/1094] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:32 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:33.406801 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-440db190-83c2-4270-adc0-2663ec56589c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:33.408369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-440db190-83c2-4270-adc0-2663ec56589c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:33.418310 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-440db190-83c2-4270-adc0-2663ec56589c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:33.419041 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-440db190-83c2-4270-adc0-2663ec56589c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:33.420325 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-440db190-83c2-4270-adc0-2663ec56589c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:33.421035 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-440db190-83c2-4270-adc0-2663ec56589c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:33.455330 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-440db190-83c2-4270-adc0-2663ec56589c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055377 Apr 05 11:58:33.455884 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 566/1095] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:33 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:33.539306 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f7b5873c-b15e-407e-9856-880b4e3b352b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:33.540179 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-133bde51-5b1b-43d7-af53-1867b9c09fa6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:33.540991 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f7b5873c-b15e-407e-9856-880b4e3b352b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:33.541522 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-133bde51-5b1b-43d7-af53-1867b9c09fa6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:33.551410 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f7b5873c-b15e-407e-9856-880b4e3b352b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:33.551910 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-133bde51-5b1b-43d7-af53-1867b9c09fa6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:33.552198 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f7b5873c-b15e-407e-9856-880b4e3b352b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:33.552710 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-133bde51-5b1b-43d7-af53-1867b9c09fa6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:33.553429 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f7b5873c-b15e-407e-9856-880b4e3b352b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:33.553958 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-133bde51-5b1b-43d7-af53-1867b9c09fa6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:33.554198 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f7b5873c-b15e-407e-9856-880b4e3b352b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:33.554678 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-133bde51-5b1b-43d7-af53-1867b9c09fa6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:33.584696 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f7b5873c-b15e-407e-9856-880b4e3b352b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051871 Apr 05 11:58:33.585251 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 530/1096] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:33 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:33.585645 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-133bde51-5b1b-43d7-af53-1867b9c09fa6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052207 Apr 05 11:58:33.586196 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 567/1097] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:33 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:34.469821 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-83e40f45-54cd-4903-9335-666e762dddee tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:34.471016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-83e40f45-54cd-4903-9335-666e762dddee tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:34.479276 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-83e40f45-54cd-4903-9335-666e762dddee tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:34.479875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-83e40f45-54cd-4903-9335-666e762dddee tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:34.480933 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-83e40f45-54cd-4903-9335-666e762dddee tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:34.481701 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-83e40f45-54cd-4903-9335-666e762dddee tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:34.511309 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-83e40f45-54cd-4903-9335-666e762dddee tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046886 Apr 05 11:58:34.511865 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 531/1098] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:34 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:34.601055 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-da2b29ea-c832-465b-8e93-dba764f57bde tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:34.602133 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-30b660ae-c033-49b5-9023-7e5ddee2a9d7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:34.602713 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-da2b29ea-c832-465b-8e93-dba764f57bde tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:34.602864 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-30b660ae-c033-49b5-9023-7e5ddee2a9d7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:34.610777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-da2b29ea-c832-465b-8e93-dba764f57bde tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:34.610965 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-30b660ae-c033-49b5-9023-7e5ddee2a9d7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:34.611363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-30b660ae-c033-49b5-9023-7e5ddee2a9d7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:34.611520 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-da2b29ea-c832-465b-8e93-dba764f57bde tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:34.612172 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-30b660ae-c033-49b5-9023-7e5ddee2a9d7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:34.612333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-da2b29ea-c832-465b-8e93-dba764f57bde tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:34.612585 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-30b660ae-c033-49b5-9023-7e5ddee2a9d7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:34.612752 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-da2b29ea-c832-465b-8e93-dba764f57bde tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:34.641765 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-30b660ae-c033-49b5-9023-7e5ddee2a9d7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046870 Apr 05 11:58:34.641980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-da2b29ea-c832-465b-8e93-dba764f57bde tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046978 Apr 05 11:58:34.642498 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 532/1100] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:34 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:34.642634 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 568/1100] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:34 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:35.525495 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ce233109-32d9-4298-b7f3-5e744e9db62a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:35.526687 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ce233109-32d9-4298-b7f3-5e744e9db62a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:35.533977 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ce233109-32d9-4298-b7f3-5e744e9db62a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:35.534426 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ce233109-32d9-4298-b7f3-5e744e9db62a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:35.535181 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ce233109-32d9-4298-b7f3-5e744e9db62a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:35.535615 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ce233109-32d9-4298-b7f3-5e744e9db62a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:35.565513 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ce233109-32d9-4298-b7f3-5e744e9db62a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045569 Apr 05 11:58:35.566047 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 533/1101] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:35 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:35.655606 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-355a83cd-6948-4302-bd94-bde011f90e3f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:35.656354 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8cf76bb3-7693-4198-b330-44859e15c907 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:35.656769 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-355a83cd-6948-4302-bd94-bde011f90e3f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:35.656949 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8cf76bb3-7693-4198-b330-44859e15c907 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:35.663989 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-355a83cd-6948-4302-bd94-bde011f90e3f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:35.664352 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8cf76bb3-7693-4198-b330-44859e15c907 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:35.664541 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-355a83cd-6948-4302-bd94-bde011f90e3f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:35.664850 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8cf76bb3-7693-4198-b330-44859e15c907 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:35.665349 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-355a83cd-6948-4302-bd94-bde011f90e3f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:35.665734 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8cf76bb3-7693-4198-b330-44859e15c907 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:35.665914 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-355a83cd-6948-4302-bd94-bde011f90e3f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:35.666217 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8cf76bb3-7693-4198-b330-44859e15c907 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:35.698140 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-355a83cd-6948-4302-bd94-bde011f90e3f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047792 Apr 05 11:58:35.698437 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8cf76bb3-7693-4198-b330-44859e15c907 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047986 Apr 05 11:58:35.702193 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 534/1102] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:35 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:35.702362 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 569/1103] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:35 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:36.583365 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-98e05153-59ba-49e5-b6fb-83c7519fd2c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:36.584908 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-98e05153-59ba-49e5-b6fb-83c7519fd2c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:36.593895 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-98e05153-59ba-49e5-b6fb-83c7519fd2c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:36.594340 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-98e05153-59ba-49e5-b6fb-83c7519fd2c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:36.595106 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-98e05153-59ba-49e5-b6fb-83c7519fd2c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:36.595528 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-98e05153-59ba-49e5-b6fb-83c7519fd2c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:36.624308 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-98e05153-59ba-49e5-b6fb-83c7519fd2c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047695 Apr 05 11:58:36.625064 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 535/1104] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:36 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:36.714085 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5f942ac1-b531-4550-9ac4-7fcd4c15003b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:36.715135 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6ab50b17-e11b-41e6-b04a-162611f755e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:36.715780 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5f942ac1-b531-4550-9ac4-7fcd4c15003b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:36.715955 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6ab50b17-e11b-41e6-b04a-162611f755e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:36.726081 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5f942ac1-b531-4550-9ac4-7fcd4c15003b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:36.726379 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6ab50b17-e11b-41e6-b04a-162611f755e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:36.726828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5f942ac1-b531-4550-9ac4-7fcd4c15003b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:36.727178 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6ab50b17-e11b-41e6-b04a-162611f755e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:36.728065 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5f942ac1-b531-4550-9ac4-7fcd4c15003b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:36.728480 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6ab50b17-e11b-41e6-b04a-162611f755e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:36.728868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5f942ac1-b531-4550-9ac4-7fcd4c15003b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:36.729213 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6ab50b17-e11b-41e6-b04a-162611f755e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:36.758583 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5f942ac1-b531-4550-9ac4-7fcd4c15003b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051196 Apr 05 11:58:36.759093 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 536/1105] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:36 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:36.759480 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6ab50b17-e11b-41e6-b04a-162611f755e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052149 Apr 05 11:58:36.760345 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 570/1106] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:36 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:37.636471 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cd2ca533-e688-4eea-b949-4a2b0d03eb45 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:37.637370 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cd2ca533-e688-4eea-b949-4a2b0d03eb45 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:37.643751 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd2ca533-e688-4eea-b949-4a2b0d03eb45 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:37.644247 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd2ca533-e688-4eea-b949-4a2b0d03eb45 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:37.645009 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd2ca533-e688-4eea-b949-4a2b0d03eb45 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:37.645443 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd2ca533-e688-4eea-b949-4a2b0d03eb45 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:37.675253 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cd2ca533-e688-4eea-b949-4a2b0d03eb45 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043289 Apr 05 11:58:37.676000 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 537/1107] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:37 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:37.774724 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-426ba019-8720-4862-9eda-9cd8231ed12d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:37.775669 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f486f47e-c052-4ee7-bd56-67b4adea061d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:37.776317 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-426ba019-8720-4862-9eda-9cd8231ed12d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:37.776477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f486f47e-c052-4ee7-bd56-67b4adea061d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:37.783542 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f486f47e-c052-4ee7-bd56-67b4adea061d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:37.783818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-426ba019-8720-4862-9eda-9cd8231ed12d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:37.783998 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f486f47e-c052-4ee7-bd56-67b4adea061d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:37.784312 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-426ba019-8720-4862-9eda-9cd8231ed12d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:37.784787 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f486f47e-c052-4ee7-bd56-67b4adea061d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:37.785066 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-426ba019-8720-4862-9eda-9cd8231ed12d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:37.785213 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f486f47e-c052-4ee7-bd56-67b4adea061d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:37.785609 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-426ba019-8720-4862-9eda-9cd8231ed12d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:37.814738 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f486f47e-c052-4ee7-bd56-67b4adea061d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046166 Apr 05 11:58:37.815308 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 538/1108] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:37 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:37.816314 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-426ba019-8720-4862-9eda-9cd8231ed12d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047920 Apr 05 11:58:37.817271 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 571/1109] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:37 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:38.691345 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1994fa6b-efba-4f31-a72c-d084e153448d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:38.692895 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1994fa6b-efba-4f31-a72c-d084e153448d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:38.703244 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1994fa6b-efba-4f31-a72c-d084e153448d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:38.703984 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1994fa6b-efba-4f31-a72c-d084e153448d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:38.705342 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1994fa6b-efba-4f31-a72c-d084e153448d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:38.706060 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1994fa6b-efba-4f31-a72c-d084e153448d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:38.739399 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1994fa6b-efba-4f31-a72c-d084e153448d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054943 Apr 05 11:58:38.739951 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 539/1110] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:38 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:38.831551 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c6388e95-7993-4365-bf10-8995d98377d6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:38.832389 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3637a713-90cf-4b72-8be0-ea6c8c94e970 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:38.833158 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c6388e95-7993-4365-bf10-8995d98377d6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:38.833404 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3637a713-90cf-4b72-8be0-ea6c8c94e970 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:38.842751 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c6388e95-7993-4365-bf10-8995d98377d6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:38.842905 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3637a713-90cf-4b72-8be0-ea6c8c94e970 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:38.843197 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c6388e95-7993-4365-bf10-8995d98377d6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:38.843433 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3637a713-90cf-4b72-8be0-ea6c8c94e970 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:38.843985 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c6388e95-7993-4365-bf10-8995d98377d6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:38.844165 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3637a713-90cf-4b72-8be0-ea6c8c94e970 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:38.844450 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c6388e95-7993-4365-bf10-8995d98377d6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:38.844593 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3637a713-90cf-4b72-8be0-ea6c8c94e970 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:38.873666 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3637a713-90cf-4b72-8be0-ea6c8c94e970 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048082 Apr 05 11:58:38.873929 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c6388e95-7993-4365-bf10-8995d98377d6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049349 Apr 05 11:58:38.877598 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 572/1112] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:38 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:38.877752 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 540/1112] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:38 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:39.755150 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-212bd83b-371d-4981-9b8d-9a185b1f1687 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:39.756552 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-212bd83b-371d-4981-9b8d-9a185b1f1687 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:39.765302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-212bd83b-371d-4981-9b8d-9a185b1f1687 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:39.765748 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-212bd83b-371d-4981-9b8d-9a185b1f1687 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:39.766496 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-212bd83b-371d-4981-9b8d-9a185b1f1687 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:39.766922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-212bd83b-371d-4981-9b8d-9a185b1f1687 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:39.795229 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-212bd83b-371d-4981-9b8d-9a185b1f1687 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046875 Apr 05 11:58:39.795777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 573/1113] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:39 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:39.885300 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-647e53aa-7f00-4322-85e1-6c71d81d0355 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:39.885900 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-91ebfe13-f1dc-4b61-9e6a-91624ac77f7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:39.886385 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-647e53aa-7f00-4322-85e1-6c71d81d0355 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:39.886555 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-91ebfe13-f1dc-4b61-9e6a-91624ac77f7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:39.893198 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-647e53aa-7f00-4322-85e1-6c71d81d0355 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:39.893393 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-91ebfe13-f1dc-4b61-9e6a-91624ac77f7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:39.893661 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-647e53aa-7f00-4322-85e1-6c71d81d0355 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:39.893818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-91ebfe13-f1dc-4b61-9e6a-91624ac77f7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:39.894417 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-91ebfe13-f1dc-4b61-9e6a-91624ac77f7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:39.894561 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-647e53aa-7f00-4322-85e1-6c71d81d0355 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:39.894849 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-647e53aa-7f00-4322-85e1-6c71d81d0355 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:39.894998 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-91ebfe13-f1dc-4b61-9e6a-91624ac77f7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:39.924102 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-647e53aa-7f00-4322-85e1-6c71d81d0355 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042785 Apr 05 11:58:39.924442 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-91ebfe13-f1dc-4b61-9e6a-91624ac77f7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042683 Apr 05 11:58:39.924831 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 541/1114] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:39 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:39.928003 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 574/1115] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:39 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:40.812846 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-35375f69-a8a5-4ceb-b6a3-c89bfdefd3c6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:40.814265 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-35375f69-a8a5-4ceb-b6a3-c89bfdefd3c6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:40.824416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-35375f69-a8a5-4ceb-b6a3-c89bfdefd3c6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:40.825164 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-35375f69-a8a5-4ceb-b6a3-c89bfdefd3c6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:40.826420 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-35375f69-a8a5-4ceb-b6a3-c89bfdefd3c6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:40.827163 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-35375f69-a8a5-4ceb-b6a3-c89bfdefd3c6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:40.861589 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-35375f69-a8a5-4ceb-b6a3-c89bfdefd3c6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055815 Apr 05 11:58:40.862145 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 542/1116] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:40 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:40.937214 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-91bb035a-71e0-4086-861a-a38bc5fa2833 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:40.937869 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-64d6bc32-b372-481f-92f2-126907168235 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:40.938225 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-91bb035a-71e0-4086-861a-a38bc5fa2833 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:40.938316 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-64d6bc32-b372-481f-92f2-126907168235 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:40.944767 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-91bb035a-71e0-4086-861a-a38bc5fa2833 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:40.944934 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-64d6bc32-b372-481f-92f2-126907168235 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:40.945204 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-91bb035a-71e0-4086-861a-a38bc5fa2833 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:40.945350 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-64d6bc32-b372-481f-92f2-126907168235 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:40.945967 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-91bb035a-71e0-4086-861a-a38bc5fa2833 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:40.946111 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-64d6bc32-b372-481f-92f2-126907168235 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:40.946393 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-91bb035a-71e0-4086-861a-a38bc5fa2833 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:40.946536 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-64d6bc32-b372-481f-92f2-126907168235 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:40.975551 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-91bb035a-71e0-4086-861a-a38bc5fa2833 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042978 Apr 05 11:58:40.976100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-64d6bc32-b372-481f-92f2-126907168235 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043552 Apr 05 11:58:40.976266 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 543/1117] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:40 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:40.976664 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 575/1118] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:40 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:41.877924 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5d56705a-e97a-4f4b-951f-42c6604d1485 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:41.879389 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5d56705a-e97a-4f4b-951f-42c6604d1485 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:41.889776 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d56705a-e97a-4f4b-951f-42c6604d1485 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:41.890222 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d56705a-e97a-4f4b-951f-42c6604d1485 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:41.890974 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d56705a-e97a-4f4b-951f-42c6604d1485 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:41.891409 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d56705a-e97a-4f4b-951f-42c6604d1485 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:41.920024 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5d56705a-e97a-4f4b-951f-42c6604d1485 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049024 Apr 05 11:58:41.920610 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 544/1119] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:41 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:41.991365 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-763f5c3f-8c53-4bea-863c-10de79a9e7aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:41.992476 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b7b4981f-9983-41a2-a071-ffe019e95d6f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:41.993094 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-763f5c3f-8c53-4bea-863c-10de79a9e7aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:41.993274 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b7b4981f-9983-41a2-a071-ffe019e95d6f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:42.003252 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-763f5c3f-8c53-4bea-863c-10de79a9e7aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:42.003552 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b7b4981f-9983-41a2-a071-ffe019e95d6f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:42.003964 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-763f5c3f-8c53-4bea-863c-10de79a9e7aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:42.004200 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b7b4981f-9983-41a2-a071-ffe019e95d6f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:42.005443 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-763f5c3f-8c53-4bea-863c-10de79a9e7aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:42.005690 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b7b4981f-9983-41a2-a071-ffe019e95d6f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:42.006159 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b7b4981f-9983-41a2-a071-ffe019e95d6f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:42.006422 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-763f5c3f-8c53-4bea-863c-10de79a9e7aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:42.037860 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-763f5c3f-8c53-4bea-863c-10de79a9e7aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052742 Apr 05 11:58:42.038420 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 545/1120] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:41 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:58:42.038564 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b7b4981f-9983-41a2-a071-ffe019e95d6f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053714 Apr 05 11:58:42.039053 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 576/1121] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:41 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:42.935885 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-22c29c52-0b15-4e84-ac7c-8f09dc6eaf40 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:42.937086 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-22c29c52-0b15-4e84-ac7c-8f09dc6eaf40 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:42.943420 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-22c29c52-0b15-4e84-ac7c-8f09dc6eaf40 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:42.943862 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-22c29c52-0b15-4e84-ac7c-8f09dc6eaf40 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:42.944648 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-22c29c52-0b15-4e84-ac7c-8f09dc6eaf40 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:42.945075 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-22c29c52-0b15-4e84-ac7c-8f09dc6eaf40 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:42.973978 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-22c29c52-0b15-4e84-ac7c-8f09dc6eaf40 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044808 Apr 05 11:58:42.974530 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 546/1122] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:42 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:43.053085 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3e5be913-12bf-4833-9363-42a7dfc0e728 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:43.054307 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1f07edbd-41dc-4fc9-ac4d-1f72d11064b6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:43.054912 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3e5be913-12bf-4833-9363-42a7dfc0e728 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:43.055065 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1f07edbd-41dc-4fc9-ac4d-1f72d11064b6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:43.063945 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e5be913-12bf-4833-9363-42a7dfc0e728 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:43.064152 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1f07edbd-41dc-4fc9-ac4d-1f72d11064b6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:43.064430 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e5be913-12bf-4833-9363-42a7dfc0e728 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:43.064586 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1f07edbd-41dc-4fc9-ac4d-1f72d11064b6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:43.065196 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1f07edbd-41dc-4fc9-ac4d-1f72d11064b6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:43.065345 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e5be913-12bf-4833-9363-42a7dfc0e728 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:43.065629 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1f07edbd-41dc-4fc9-ac4d-1f72d11064b6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:43.065793 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e5be913-12bf-4833-9363-42a7dfc0e728 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:43.095111 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1f07edbd-41dc-4fc9-ac4d-1f72d11064b6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048272 Apr 05 11:58:43.095513 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3e5be913-12bf-4833-9363-42a7dfc0e728 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048735 Apr 05 11:58:43.095980 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 577/1123] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:43 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:43.096506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 547/1124] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:43 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:43.990301 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5e589c0a-99d0-42ed-ba34-1c3441fc69ce tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:43.991839 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5e589c0a-99d0-42ed-ba34-1c3441fc69ce tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:44.000838 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5e589c0a-99d0-42ed-ba34-1c3441fc69ce tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:44.001278 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5e589c0a-99d0-42ed-ba34-1c3441fc69ce tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:44.002032 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5e589c0a-99d0-42ed-ba34-1c3441fc69ce tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:44.002459 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5e589c0a-99d0-42ed-ba34-1c3441fc69ce tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:44.032777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5e589c0a-99d0-42ed-ba34-1c3441fc69ce tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049131 Apr 05 11:58:44.033317 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 578/1125] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:43 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:44.109920 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-13580b89-a0b6-457a-847a-ea118efc89f5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:44.110585 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c94b9e13-7115-4a73-a5be-c1841763a7e4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:44.110964 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-13580b89-a0b6-457a-847a-ea118efc89f5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:44.111064 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c94b9e13-7115-4a73-a5be-c1841763a7e4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:44.117256 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13580b89-a0b6-457a-847a-ea118efc89f5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:44.117445 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c94b9e13-7115-4a73-a5be-c1841763a7e4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:44.117707 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13580b89-a0b6-457a-847a-ea118efc89f5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:44.117868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c94b9e13-7115-4a73-a5be-c1841763a7e4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:44.118503 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13580b89-a0b6-457a-847a-ea118efc89f5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:44.118652 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c94b9e13-7115-4a73-a5be-c1841763a7e4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:44.118926 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c94b9e13-7115-4a73-a5be-c1841763a7e4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:44.119077 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13580b89-a0b6-457a-847a-ea118efc89f5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:44.150527 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-13580b89-a0b6-457a-847a-ea118efc89f5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046629 Apr 05 11:58:44.151117 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 548/1126] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:44 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:44.153181 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c94b9e13-7115-4a73-a5be-c1841763a7e4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047867 Apr 05 11:58:44.153749 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 579/1127] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:44 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:45.048683 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-559449bd-347d-4600-bc8f-b76dfcf70150 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:45.049802 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-559449bd-347d-4600-bc8f-b76dfcf70150 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:45.057547 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-559449bd-347d-4600-bc8f-b76dfcf70150 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:45.058107 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-559449bd-347d-4600-bc8f-b76dfcf70150 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:45.059043 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-559449bd-347d-4600-bc8f-b76dfcf70150 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:45.059580 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-559449bd-347d-4600-bc8f-b76dfcf70150 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:45.098606 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-559449bd-347d-4600-bc8f-b76dfcf70150 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056106 Apr 05 11:58:45.099291 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 549/1128] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:45 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:45.168252 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1097e279-2a6a-4561-b82d-e2956684bcd3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:45.169315 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2133189a-7c7c-47be-96f3-1ac7292da5ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:45.169932 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1097e279-2a6a-4561-b82d-e2956684bcd3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:45.170085 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2133189a-7c7c-47be-96f3-1ac7292da5ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:45.180170 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1097e279-2a6a-4561-b82d-e2956684bcd3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:45.180552 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2133189a-7c7c-47be-96f3-1ac7292da5ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:45.180962 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1097e279-2a6a-4561-b82d-e2956684bcd3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:45.181337 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2133189a-7c7c-47be-96f3-1ac7292da5ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:45.182239 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1097e279-2a6a-4561-b82d-e2956684bcd3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:45.182550 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2133189a-7c7c-47be-96f3-1ac7292da5ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:45.182932 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1097e279-2a6a-4561-b82d-e2956684bcd3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:45.183323 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2133189a-7c7c-47be-96f3-1ac7292da5ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:45.214344 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1097e279-2a6a-4561-b82d-e2956684bcd3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052289 Apr 05 11:58:45.214906 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 550/1129] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:45 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:45.215058 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2133189a-7c7c-47be-96f3-1ac7292da5ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054960 Apr 05 11:58:45.215593 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 580/1130] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:45 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:46.116770 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5554cb6a-f51b-4da2-9057-034520692f7c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:46.118258 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5554cb6a-f51b-4da2-9057-034520692f7c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:46.127615 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5554cb6a-f51b-4da2-9057-034520692f7c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:46.128065 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5554cb6a-f51b-4da2-9057-034520692f7c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:46.128868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5554cb6a-f51b-4da2-9057-034520692f7c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:46.129302 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5554cb6a-f51b-4da2-9057-034520692f7c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:46.157785 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5554cb6a-f51b-4da2-9057-034520692f7c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047885 Apr 05 11:58:46.158293 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 551/1131] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:46 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:46.228291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bffab6ec-79b6-4810-a3ff-1987ba698968 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:46.229705 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bffab6ec-79b6-4810-a3ff-1987ba698968 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:46.230266 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f69358a4-08af-4a35-a804-427dd9ab1e90 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:46.231647 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f69358a4-08af-4a35-a804-427dd9ab1e90 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:46.238202 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bffab6ec-79b6-4810-a3ff-1987ba698968 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:46.238642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bffab6ec-79b6-4810-a3ff-1987ba698968 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:46.239302 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f69358a4-08af-4a35-a804-427dd9ab1e90 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:46.239475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bffab6ec-79b6-4810-a3ff-1987ba698968 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:46.239747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f69358a4-08af-4a35-a804-427dd9ab1e90 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:46.239906 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bffab6ec-79b6-4810-a3ff-1987ba698968 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:46.240538 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f69358a4-08af-4a35-a804-427dd9ab1e90 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:46.240968 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f69358a4-08af-4a35-a804-427dd9ab1e90 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:46.269701 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bffab6ec-79b6-4810-a3ff-1987ba698968 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047209 Apr 05 11:58:46.270495 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 581/1132] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:46 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:46.274513 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f69358a4-08af-4a35-a804-427dd9ab1e90 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051091 Apr 05 11:58:46.275075 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 552/1133] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:46 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:47.175447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8002f103-2b46-468a-b9d0-bd0ecd9b6baa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:47.176907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8002f103-2b46-468a-b9d0-bd0ecd9b6baa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:47.186922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8002f103-2b46-468a-b9d0-bd0ecd9b6baa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:47.187656 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8002f103-2b46-468a-b9d0-bd0ecd9b6baa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:47.188970 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8002f103-2b46-468a-b9d0-bd0ecd9b6baa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:47.189628 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8002f103-2b46-468a-b9d0-bd0ecd9b6baa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:47.223892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8002f103-2b46-468a-b9d0-bd0ecd9b6baa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055342 Apr 05 11:58:47.224476 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 582/1134] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:47 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:47.285965 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bceb1ad3-cc75-46e6-9508-b073a8d2c590 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:47.287660 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bceb1ad3-cc75-46e6-9508-b073a8d2c590 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:47.289569 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3b30756b-9b70-44e3-9598-1332167aaae2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:47.291180 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3b30756b-9b70-44e3-9598-1332167aaae2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:47.298189 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bceb1ad3-cc75-46e6-9508-b073a8d2c590 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:47.298639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bceb1ad3-cc75-46e6-9508-b073a8d2c590 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:47.299406 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bceb1ad3-cc75-46e6-9508-b073a8d2c590 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:47.299838 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bceb1ad3-cc75-46e6-9508-b073a8d2c590 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:47.299992 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b30756b-9b70-44e3-9598-1332167aaae2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:47.300409 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b30756b-9b70-44e3-9598-1332167aaae2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:47.301164 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b30756b-9b70-44e3-9598-1332167aaae2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:47.301582 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b30756b-9b70-44e3-9598-1332167aaae2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:47.328401 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bceb1ad3-cc75-46e6-9508-b073a8d2c590 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049218 Apr 05 11:58:47.328970 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 553/1135] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:47 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:47.329732 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3b30756b-9b70-44e3-9598-1332167aaae2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046680 Apr 05 11:58:47.330482 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 583/1136] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:47 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:48.235118 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-79aee129-5f4e-45d2-86cc-c606e6d6550e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:48.236028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-79aee129-5f4e-45d2-86cc-c606e6d6550e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:48.242784 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79aee129-5f4e-45d2-86cc-c606e6d6550e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:48.243232 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79aee129-5f4e-45d2-86cc-c606e6d6550e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:48.243992 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79aee129-5f4e-45d2-86cc-c606e6d6550e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:48.244458 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79aee129-5f4e-45d2-86cc-c606e6d6550e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:48.273405 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-79aee129-5f4e-45d2-86cc-c606e6d6550e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042343 Apr 05 11:58:48.273950 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 554/1137] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:48 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:48.344742 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a0b2ad0f-7b3a-414b-967a-1e37f49ab2fa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:48.345298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-12b30536-56e5-4fc4-9f0d-bbea68992708 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:48.345655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a0b2ad0f-7b3a-414b-967a-1e37f49ab2fa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:48.346248 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-12b30536-56e5-4fc4-9f0d-bbea68992708 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:48.352237 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a0b2ad0f-7b3a-414b-967a-1e37f49ab2fa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:48.352680 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a0b2ad0f-7b3a-414b-967a-1e37f49ab2fa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:48.353067 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-12b30536-56e5-4fc4-9f0d-bbea68992708 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:48.353441 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a0b2ad0f-7b3a-414b-967a-1e37f49ab2fa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:48.353586 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-12b30536-56e5-4fc4-9f0d-bbea68992708 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:48.353856 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a0b2ad0f-7b3a-414b-967a-1e37f49ab2fa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:48.354246 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-12b30536-56e5-4fc4-9f0d-bbea68992708 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:48.354682 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-12b30536-56e5-4fc4-9f0d-bbea68992708 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:48.383845 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a0b2ad0f-7b3a-414b-967a-1e37f49ab2fa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045806 Apr 05 11:58:48.384360 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-12b30536-56e5-4fc4-9f0d-bbea68992708 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045486 Apr 05 11:58:48.384768 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 584/1138] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:48 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:48.384942 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 555/1139] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:48 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:58:49.289671 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6baba81c-54cf-4040-a45a-d5835e234070 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:49.291068 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6baba81c-54cf-4040-a45a-d5835e234070 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:49.300387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6baba81c-54cf-4040-a45a-d5835e234070 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:49.300829 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6baba81c-54cf-4040-a45a-d5835e234070 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:49.301575 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6baba81c-54cf-4040-a45a-d5835e234070 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:49.302006 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6baba81c-54cf-4040-a45a-d5835e234070 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:49.331816 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6baba81c-54cf-4040-a45a-d5835e234070 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048892 Apr 05 11:58:49.332391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 585/1140] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:49 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:49.396317 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-abc5a618-be03-4ad8-84cf-1ea4a4c00cc8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:49.396903 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-56ac81a8-cc3d-418e-a249-d53b787a7fc0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:49.397283 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-abc5a618-be03-4ad8-84cf-1ea4a4c00cc8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:49.397389 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-56ac81a8-cc3d-418e-a249-d53b787a7fc0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:49.403774 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-abc5a618-be03-4ad8-84cf-1ea4a4c00cc8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:49.403948 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-56ac81a8-cc3d-418e-a249-d53b787a7fc0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:49.404256 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-abc5a618-be03-4ad8-84cf-1ea4a4c00cc8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:49.404419 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-56ac81a8-cc3d-418e-a249-d53b787a7fc0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:49.405028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-abc5a618-be03-4ad8-84cf-1ea4a4c00cc8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:49.405172 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-56ac81a8-cc3d-418e-a249-d53b787a7fc0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:49.405459 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-abc5a618-be03-4ad8-84cf-1ea4a4c00cc8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:49.405624 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-56ac81a8-cc3d-418e-a249-d53b787a7fc0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:49.434952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-56ac81a8-cc3d-418e-a249-d53b787a7fc0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042519 Apr 05 11:58:49.435167 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-abc5a618-be03-4ad8-84cf-1ea4a4c00cc8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042729 Apr 05 11:58:49.438830 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 556/1141] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:49 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:49.439013 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 586/1142] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:49 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:50.346042 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b08c0182-63b5-4aaf-a0e2-b94ca665a8c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:50.347181 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b08c0182-63b5-4aaf-a0e2-b94ca665a8c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:50.355148 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b08c0182-63b5-4aaf-a0e2-b94ca665a8c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:50.355741 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b08c0182-63b5-4aaf-a0e2-b94ca665a8c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:50.356730 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b08c0182-63b5-4aaf-a0e2-b94ca665a8c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:50.357284 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b08c0182-63b5-4aaf-a0e2-b94ca665a8c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:50.386591 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b08c0182-63b5-4aaf-a0e2-b94ca665a8c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045766 Apr 05 11:58:50.387135 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 557/1143] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:50 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:50.451133 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ee142173-5fc2-4284-8501-51c83a95261e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:50.452674 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ee142173-5fc2-4284-8501-51c83a95261e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:50.454233 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c9d4b125-122b-45b1-acf4-3ef4e3f8faa6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:50.455771 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c9d4b125-122b-45b1-acf4-3ef4e3f8faa6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:50.463176 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ee142173-5fc2-4284-8501-51c83a95261e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:50.463916 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ee142173-5fc2-4284-8501-51c83a95261e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:50.465243 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ee142173-5fc2-4284-8501-51c83a95261e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:50.465966 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ee142173-5fc2-4284-8501-51c83a95261e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:50.466583 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c9d4b125-122b-45b1-acf4-3ef4e3f8faa6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:50.467333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c9d4b125-122b-45b1-acf4-3ef4e3f8faa6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:50.468629 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c9d4b125-122b-45b1-acf4-3ef4e3f8faa6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:50.469644 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c9d4b125-122b-45b1-acf4-3ef4e3f8faa6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:50.497173 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ee142173-5fc2-4284-8501-51c83a95261e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052884 Apr 05 11:58:50.497750 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 587/1144] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:50 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:50.498580 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c9d4b125-122b-45b1-acf4-3ef4e3f8faa6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050897 Apr 05 11:58:50.499130 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 558/1145] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:50 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:51.398732 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d0cbc9f6-bc93-4401-b9f4-2a7600aaabf4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:51.399626 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d0cbc9f6-bc93-4401-b9f4-2a7600aaabf4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:51.406100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d0cbc9f6-bc93-4401-b9f4-2a7600aaabf4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:51.406543 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d0cbc9f6-bc93-4401-b9f4-2a7600aaabf4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:51.407466 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d0cbc9f6-bc93-4401-b9f4-2a7600aaabf4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:51.407903 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d0cbc9f6-bc93-4401-b9f4-2a7600aaabf4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:51.438793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d0cbc9f6-bc93-4401-b9f4-2a7600aaabf4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044112 Apr 05 11:58:51.439322 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 588/1146] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:51 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:51.513064 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b787e13f-acaf-450c-9e71-d572f168999c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:51.514122 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2a1a97a9-05a5-4229-a96a-4e314ddbd2a2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:51.514840 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b787e13f-acaf-450c-9e71-d572f168999c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:51.515600 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2a1a97a9-05a5-4229-a96a-4e314ddbd2a2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:51.521903 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b787e13f-acaf-450c-9e71-d572f168999c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:51.522349 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b787e13f-acaf-450c-9e71-d572f168999c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:51.522515 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2a1a97a9-05a5-4229-a96a-4e314ddbd2a2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:51.522980 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2a1a97a9-05a5-4229-a96a-4e314ddbd2a2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:51.523138 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b787e13f-acaf-450c-9e71-d572f168999c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:51.523521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b787e13f-acaf-450c-9e71-d572f168999c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:51.523712 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2a1a97a9-05a5-4229-a96a-4e314ddbd2a2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:51.524195 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2a1a97a9-05a5-4229-a96a-4e314ddbd2a2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:51.552018 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b787e13f-acaf-450c-9e71-d572f168999c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045505 Apr 05 11:58:51.552640 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 559/1147] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:51 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:51.552808 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2a1a97a9-05a5-4229-a96a-4e314ddbd2a2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045099 Apr 05 11:58:51.553246 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 589/1148] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:51 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:52.454278 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-11d74fa5-1486-4fdc-a47f-8fd753819b78 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:52.455198 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-11d74fa5-1486-4fdc-a47f-8fd753819b78 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:52.462099 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-11d74fa5-1486-4fdc-a47f-8fd753819b78 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:52.462544 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-11d74fa5-1486-4fdc-a47f-8fd753819b78 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:52.463305 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-11d74fa5-1486-4fdc-a47f-8fd753819b78 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:52.463733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-11d74fa5-1486-4fdc-a47f-8fd753819b78 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:52.493003 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-11d74fa5-1486-4fdc-a47f-8fd753819b78 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045421 Apr 05 11:58:52.493500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 560/1149] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:52 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:52.567823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-11ed8553-a292-49f6-af5a-40b49fd86ca1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:52.568685 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9bf7ed21-bba8-452a-a662-8fac04fdd734 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:52.569380 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-11ed8553-a292-49f6-af5a-40b49fd86ca1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:52.569583 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9bf7ed21-bba8-452a-a662-8fac04fdd734 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:52.579742 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9bf7ed21-bba8-452a-a662-8fac04fdd734 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:52.579923 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-11ed8553-a292-49f6-af5a-40b49fd86ca1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:52.580236 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9bf7ed21-bba8-452a-a662-8fac04fdd734 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:52.580400 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-11ed8553-a292-49f6-af5a-40b49fd86ca1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:52.581006 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-11ed8553-a292-49f6-af5a-40b49fd86ca1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:52.581168 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9bf7ed21-bba8-452a-a662-8fac04fdd734 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:52.581437 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9bf7ed21-bba8-452a-a662-8fac04fdd734 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:52.581596 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-11ed8553-a292-49f6-af5a-40b49fd86ca1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:52.611046 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9bf7ed21-bba8-452a-a662-8fac04fdd734 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049488 Apr 05 11:58:52.611284 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-11ed8553-a292-49f6-af5a-40b49fd86ca1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049916 Apr 05 11:58:52.611605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 561/1150] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:52 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:52.611792 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 590/1151] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:52 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:53.507581 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1586bd9d-2870-4de0-9b50-9df8f5c3bee1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:53.508535 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1586bd9d-2870-4de0-9b50-9df8f5c3bee1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:53.514962 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1586bd9d-2870-4de0-9b50-9df8f5c3bee1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:53.515423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1586bd9d-2870-4de0-9b50-9df8f5c3bee1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:53.516228 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1586bd9d-2870-4de0-9b50-9df8f5c3bee1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:53.516672 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1586bd9d-2870-4de0-9b50-9df8f5c3bee1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:53.546021 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1586bd9d-2870-4de0-9b50-9df8f5c3bee1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042606 Apr 05 11:58:53.546592 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 562/1152] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:53 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:53.626396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3f3e53a1-d0bc-4688-ae46-093b8cf8264c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:53.627033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c6535582-948e-4b9c-92ba-53d0b35f67f0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:53.627419 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3f3e53a1-d0bc-4688-ae46-093b8cf8264c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:53.627537 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c6535582-948e-4b9c-92ba-53d0b35f67f0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:53.633833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f3e53a1-d0bc-4688-ae46-093b8cf8264c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:53.634019 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c6535582-948e-4b9c-92ba-53d0b35f67f0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:53.634283 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f3e53a1-d0bc-4688-ae46-093b8cf8264c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:53.634460 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c6535582-948e-4b9c-92ba-53d0b35f67f0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:53.635050 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f3e53a1-d0bc-4688-ae46-093b8cf8264c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:53.635198 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c6535582-948e-4b9c-92ba-53d0b35f67f0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:53.635475 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f3e53a1-d0bc-4688-ae46-093b8cf8264c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:53.635625 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c6535582-948e-4b9c-92ba-53d0b35f67f0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:53.664731 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3f3e53a1-d0bc-4688-ae46-093b8cf8264c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044536 Apr 05 11:58:53.664951 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c6535582-948e-4b9c-92ba-53d0b35f67f0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044605 Apr 05 11:58:53.665568 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 563/1153] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:53 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:53.665723 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 591/1154] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:53 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:54.562352 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-96a540c5-804f-417b-a4e8-935d73100d4c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:54.563833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-96a540c5-804f-417b-a4e8-935d73100d4c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:54.573953 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-96a540c5-804f-417b-a4e8-935d73100d4c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:54.574686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-96a540c5-804f-417b-a4e8-935d73100d4c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:54.575925 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-96a540c5-804f-417b-a4e8-935d73100d4c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:54.576695 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-96a540c5-804f-417b-a4e8-935d73100d4c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:54.605863 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-96a540c5-804f-417b-a4e8-935d73100d4c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050272 Apr 05 11:58:54.606397 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 564/1155] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:54 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:54.677748 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-57986317-e9aa-45d4-94ac-64ad2738e759 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:54.678494 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b99cd3bd-547e-4846-8b14-9cd7b59ba301 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:54.678899 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-57986317-e9aa-45d4-94ac-64ad2738e759 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:54.680008 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b99cd3bd-547e-4846-8b14-9cd7b59ba301 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:54.684913 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-57986317-e9aa-45d4-94ac-64ad2738e759 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:54.685364 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-57986317-e9aa-45d4-94ac-64ad2738e759 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:54.686131 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-57986317-e9aa-45d4-94ac-64ad2738e759 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:54.686562 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-57986317-e9aa-45d4-94ac-64ad2738e759 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:54.686718 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b99cd3bd-547e-4846-8b14-9cd7b59ba301 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:54.687059 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b99cd3bd-547e-4846-8b14-9cd7b59ba301 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:54.687800 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b99cd3bd-547e-4846-8b14-9cd7b59ba301 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:54.688319 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b99cd3bd-547e-4846-8b14-9cd7b59ba301 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:54.715354 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-57986317-e9aa-45d4-94ac-64ad2738e759 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041525 Apr 05 11:58:54.715934 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 565/1156] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:54 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:54.718003 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b99cd3bd-547e-4846-8b14-9cd7b59ba301 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044176 Apr 05 11:58:54.718566 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 592/1157] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:54 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:55.622299 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8d5ea100-1e1e-4bc6-a3b2-f8cce16d19f1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:55.623774 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8d5ea100-1e1e-4bc6-a3b2-f8cce16d19f1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:55.631175 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8d5ea100-1e1e-4bc6-a3b2-f8cce16d19f1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:55.631622 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8d5ea100-1e1e-4bc6-a3b2-f8cce16d19f1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:55.632418 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8d5ea100-1e1e-4bc6-a3b2-f8cce16d19f1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:55.632855 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8d5ea100-1e1e-4bc6-a3b2-f8cce16d19f1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:55.662064 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8d5ea100-1e1e-4bc6-a3b2-f8cce16d19f1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046678 Apr 05 11:58:55.666148 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 566/1158] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:55 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:55.731066 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2bf15949-adcd-4d24-9bb9-0430cd1beb50 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:55.732599 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2bf15949-adcd-4d24-9bb9-0430cd1beb50 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:55.733477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1b6e14d3-2dbf-4950-bada-1fc50b387f09 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:55.734977 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1b6e14d3-2dbf-4950-bada-1fc50b387f09 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:55.743292 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2bf15949-adcd-4d24-9bb9-0430cd1beb50 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:55.743998 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2bf15949-adcd-4d24-9bb9-0430cd1beb50 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:55.745721 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2bf15949-adcd-4d24-9bb9-0430cd1beb50 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:55.745995 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1b6e14d3-2dbf-4950-bada-1fc50b387f09 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:55.746517 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2bf15949-adcd-4d24-9bb9-0430cd1beb50 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:55.746735 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1b6e14d3-2dbf-4950-bada-1fc50b387f09 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:55.747819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1b6e14d3-2dbf-4950-bada-1fc50b387f09 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:55.748600 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1b6e14d3-2dbf-4950-bada-1fc50b387f09 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:55.777988 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2bf15949-adcd-4d24-9bb9-0430cd1beb50 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053430 Apr 05 11:58:55.778393 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1b6e14d3-2dbf-4950-bada-1fc50b387f09 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051330 Apr 05 11:58:55.778865 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 593/1159] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:55 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:55.782664 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 567/1160] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:55 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:56.677161 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d82dc923-3d6a-493b-9ac9-3870f8e691f9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:56.678051 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d82dc923-3d6a-493b-9ac9-3870f8e691f9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:56.684476 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d82dc923-3d6a-493b-9ac9-3870f8e691f9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:56.684923 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d82dc923-3d6a-493b-9ac9-3870f8e691f9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:56.685681 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d82dc923-3d6a-493b-9ac9-3870f8e691f9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:56.686110 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d82dc923-3d6a-493b-9ac9-3870f8e691f9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:56.715439 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d82dc923-3d6a-493b-9ac9-3870f8e691f9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043944 Apr 05 11:58:56.716000 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 594/1161] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:56 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:56.794412 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9bb8a8fa-c259-4962-9079-3ffe549e962c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:56.795817 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9bb8a8fa-c259-4962-9079-3ffe549e962c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:56.797517 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6ae41537-52b0-4d28-84fc-28f4f82e3ade tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:56.798985 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6ae41537-52b0-4d28-84fc-28f4f82e3ade tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:56.803962 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9bb8a8fa-c259-4962-9079-3ffe549e962c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:56.804441 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9bb8a8fa-c259-4962-9079-3ffe549e962c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:56.805202 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9bb8a8fa-c259-4962-9079-3ffe549e962c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:56.805630 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9bb8a8fa-c259-4962-9079-3ffe549e962c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:56.805831 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6ae41537-52b0-4d28-84fc-28f4f82e3ade tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:56.806298 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6ae41537-52b0-4d28-84fc-28f4f82e3ade tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:56.807055 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6ae41537-52b0-4d28-84fc-28f4f82e3ade tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:56.807487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6ae41537-52b0-4d28-84fc-28f4f82e3ade tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:56.835608 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9bb8a8fa-c259-4962-9079-3ffe549e962c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047713 Apr 05 11:58:56.836787 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 568/1162] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:56 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:56.837247 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6ae41537-52b0-4d28-84fc-28f4f82e3ade tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046059 Apr 05 11:58:56.837821 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 595/1163] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:56 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:57.731577 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b6e2dcfa-5238-4f4c-9164-31103504afbf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:57.733136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b6e2dcfa-5238-4f4c-9164-31103504afbf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:57.741612 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b6e2dcfa-5238-4f4c-9164-31103504afbf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:57.742060 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b6e2dcfa-5238-4f4c-9164-31103504afbf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:57.742860 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b6e2dcfa-5238-4f4c-9164-31103504afbf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:57.743292 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b6e2dcfa-5238-4f4c-9164-31103504afbf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:57.772948 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b6e2dcfa-5238-4f4c-9164-31103504afbf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048325 Apr 05 11:58:57.773431 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 569/1164] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:57 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:57.851044 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8e29cd80-2da2-4e9c-b7b0-a5a204f097da tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:57.852275 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8e29cd80-2da2-4e9c-b7b0-a5a204f097da tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:57.852729 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-25e8a227-9a2b-46db-8775-b52ccc1c030c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:57.854276 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-25e8a227-9a2b-46db-8775-b52ccc1c030c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:57.860763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e29cd80-2da2-4e9c-b7b0-a5a204f097da tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:57.861486 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e29cd80-2da2-4e9c-b7b0-a5a204f097da tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:57.862452 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e29cd80-2da2-4e9c-b7b0-a5a204f097da tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:57.862635 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-25e8a227-9a2b-46db-8775-b52ccc1c030c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:57.862995 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e29cd80-2da2-4e9c-b7b0-a5a204f097da tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:57.863199 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-25e8a227-9a2b-46db-8775-b52ccc1c030c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:57.864121 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-25e8a227-9a2b-46db-8775-b52ccc1c030c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:57.864742 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-25e8a227-9a2b-46db-8775-b52ccc1c030c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:57.897257 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8e29cd80-2da2-4e9c-b7b0-a5a204f097da tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051982 Apr 05 11:58:57.897537 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-25e8a227-9a2b-46db-8775-b52ccc1c030c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049398 Apr 05 11:58:57.897830 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 596/1165] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:57 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:57.898222 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 570/1166] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:57 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:58.786255 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-65d173f7-14d5-4bac-af42-6998ae87df11 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:58.787050 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-65d173f7-14d5-4bac-af42-6998ae87df11 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:58.793350 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-65d173f7-14d5-4bac-af42-6998ae87df11 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:58.793788 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-65d173f7-14d5-4bac-af42-6998ae87df11 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:58.794565 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-65d173f7-14d5-4bac-af42-6998ae87df11 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:58.794965 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-65d173f7-14d5-4bac-af42-6998ae87df11 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:58.823291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-65d173f7-14d5-4bac-af42-6998ae87df11 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041862 Apr 05 11:58:58.823854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 597/1167] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:58 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:58.911673 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-29c5c63b-5001-4f9b-8d9c-6dff89d26f26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:58.912383 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-488b9858-d073-429b-92c7-137ffacf4689 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:58.912778 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-488b9858-d073-429b-92c7-137ffacf4689 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:58.912887 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-29c5c63b-5001-4f9b-8d9c-6dff89d26f26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:58.919296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-29c5c63b-5001-4f9b-8d9c-6dff89d26f26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:58.919505 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-488b9858-d073-429b-92c7-137ffacf4689 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:58.919800 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-29c5c63b-5001-4f9b-8d9c-6dff89d26f26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:58.919949 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-488b9858-d073-429b-92c7-137ffacf4689 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:58.920616 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-29c5c63b-5001-4f9b-8d9c-6dff89d26f26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:58.920776 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-488b9858-d073-429b-92c7-137ffacf4689 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:58.921070 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-29c5c63b-5001-4f9b-8d9c-6dff89d26f26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:58.921205 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-488b9858-d073-429b-92c7-137ffacf4689 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:58.950317 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-488b9858-d073-429b-92c7-137ffacf4689 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044023 Apr 05 11:58:58.950582 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-29c5c63b-5001-4f9b-8d9c-6dff89d26f26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044131 Apr 05 11:58:58.951184 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 598/1168] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:58 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:58.951537 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 571/1169] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:58 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:59.838374 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b957c507-4c34-4a4a-b1ea-442374fd8da1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:59.839847 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b957c507-4c34-4a4a-b1ea-442374fd8da1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:59.851046 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b957c507-4c34-4a4a-b1ea-442374fd8da1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:59.851792 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b957c507-4c34-4a4a-b1ea-442374fd8da1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:59.853091 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b957c507-4c34-4a4a-b1ea-442374fd8da1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:59.853799 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b957c507-4c34-4a4a-b1ea-442374fd8da1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:59.887593 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b957c507-4c34-4a4a-b1ea-442374fd8da1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056323 Apr 05 11:58:59.888172 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 599/1170] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:58:59 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:59.966351 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-42795029-774e-41f7-994f-7fe31e5826be tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:59.967552 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c3fdbb23-b247-4450-b65d-8341e85f5dd0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:58:59.968413 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-42795029-774e-41f7-994f-7fe31e5826be tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:59.968596 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c3fdbb23-b247-4450-b65d-8341e85f5dd0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:58:59.978763 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3fdbb23-b247-4450-b65d-8341e85f5dd0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:59.979015 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-42795029-774e-41f7-994f-7fe31e5826be tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:59.979504 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3fdbb23-b247-4450-b65d-8341e85f5dd0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:59.979804 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-42795029-774e-41f7-994f-7fe31e5826be tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:59.980856 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3fdbb23-b247-4450-b65d-8341e85f5dd0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:59.981084 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-42795029-774e-41f7-994f-7fe31e5826be tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:58:59.981477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3fdbb23-b247-4450-b65d-8341e85f5dd0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:58:59.981654 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-42795029-774e-41f7-994f-7fe31e5826be tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:00.012655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-42795029-774e-41f7-994f-7fe31e5826be tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053038 Apr 05 11:59:00.012915 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c3fdbb23-b247-4450-b65d-8341e85f5dd0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053237 Apr 05 11:59:00.013188 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 600/1171] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:59 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:00.013642 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 572/1172] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:58:59 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:00.903856 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-44f35d4c-25aa-4c46-8821-3b3697313133 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:00.905397 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-44f35d4c-25aa-4c46-8821-3b3697313133 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:00.913343 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-44f35d4c-25aa-4c46-8821-3b3697313133 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:00.913795 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-44f35d4c-25aa-4c46-8821-3b3697313133 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:00.914555 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-44f35d4c-25aa-4c46-8821-3b3697313133 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:00.914987 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-44f35d4c-25aa-4c46-8821-3b3697313133 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:00.944082 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-44f35d4c-25aa-4c46-8821-3b3697313133 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046939 Apr 05 11:59:00.944646 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 601/1173] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:00 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:01.028341 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7aadb6d9-d43f-4ef7-afdd-f4b37823e707 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:01.029357 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-49341b91-2a5b-493b-a396-75b95e94c582 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:01.029945 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7aadb6d9-d43f-4ef7-afdd-f4b37823e707 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:01.030199 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-49341b91-2a5b-493b-a396-75b95e94c582 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:01.038308 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-49341b91-2a5b-493b-a396-75b95e94c582 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:01.038469 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7aadb6d9-d43f-4ef7-afdd-f4b37823e707 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:01.038761 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-49341b91-2a5b-493b-a396-75b95e94c582 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:01.038919 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7aadb6d9-d43f-4ef7-afdd-f4b37823e707 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:01.039527 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7aadb6d9-d43f-4ef7-afdd-f4b37823e707 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:01.039670 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-49341b91-2a5b-493b-a396-75b95e94c582 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:01.039960 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-49341b91-2a5b-493b-a396-75b95e94c582 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:01.040133 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7aadb6d9-d43f-4ef7-afdd-f4b37823e707 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:01.069576 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7aadb6d9-d43f-4ef7-afdd-f4b37823e707 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047729 Apr 05 11:59:01.070003 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-49341b91-2a5b-493b-a396-75b95e94c582 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047857 Apr 05 11:59:01.070411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 602/1174] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:01 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:01.070548 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 573/1175] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:01 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:59:01.959445 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e3b5e0b7-18d8-41f4-bb64-b8e5d36e8c97 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:01.961424 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e3b5e0b7-18d8-41f4-bb64-b8e5d36e8c97 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:01.971753 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e3b5e0b7-18d8-41f4-bb64-b8e5d36e8c97 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:01.972544 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e3b5e0b7-18d8-41f4-bb64-b8e5d36e8c97 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:01.973782 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e3b5e0b7-18d8-41f4-bb64-b8e5d36e8c97 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:01.974495 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e3b5e0b7-18d8-41f4-bb64-b8e5d36e8c97 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:02.008920 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e3b5e0b7-18d8-41f4-bb64-b8e5d36e8c97 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056444 Apr 05 11:59:02.009466 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 603/1176] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:01 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:02.084111 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-09b94774-0e1d-4922-b4b5-ce64b0048b2b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:02.084818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b5f1ed2a-c0e0-4ba1-9fb5-92795dc34575 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:02.085225 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-09b94774-0e1d-4922-b4b5-ce64b0048b2b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:02.085346 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b5f1ed2a-c0e0-4ba1-9fb5-92795dc34575 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:02.092666 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-09b94774-0e1d-4922-b4b5-ce64b0048b2b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:02.093102 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b5f1ed2a-c0e0-4ba1-9fb5-92795dc34575 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:02.093275 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-09b94774-0e1d-4922-b4b5-ce64b0048b2b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:02.093569 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b5f1ed2a-c0e0-4ba1-9fb5-92795dc34575 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:02.094013 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-09b94774-0e1d-4922-b4b5-ce64b0048b2b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:02.094438 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b5f1ed2a-c0e0-4ba1-9fb5-92795dc34575 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:02.094602 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-09b94774-0e1d-4922-b4b5-ce64b0048b2b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:02.094918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b5f1ed2a-c0e0-4ba1-9fb5-92795dc34575 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:02.124764 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b5f1ed2a-c0e0-4ba1-9fb5-92795dc34575 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045727 Apr 05 11:59:02.125316 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 574/1177] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:02 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:02.125470 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-09b94774-0e1d-4922-b4b5-ce64b0048b2b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046281 Apr 05 11:59:02.125845 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 604/1178] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:02 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:03.025301 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f5fbe5a9-cc60-48ad-9b72-dbddcc35aa00 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:03.026779 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f5fbe5a9-cc60-48ad-9b72-dbddcc35aa00 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:03.036951 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f5fbe5a9-cc60-48ad-9b72-dbddcc35aa00 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:03.037689 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f5fbe5a9-cc60-48ad-9b72-dbddcc35aa00 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:03.039432 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f5fbe5a9-cc60-48ad-9b72-dbddcc35aa00 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:03.040144 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f5fbe5a9-cc60-48ad-9b72-dbddcc35aa00 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:03.073444 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f5fbe5a9-cc60-48ad-9b72-dbddcc35aa00 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055196 Apr 05 11:59:03.073994 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 575/1179] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:03 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:03.140954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9a1dbdcd-c871-40c7-af20-afa4649cf0e7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:03.141964 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a91d4dd2-5383-499a-b7ca-67a86375ec7c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:03.142581 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9a1dbdcd-c871-40c7-af20-afa4649cf0e7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:03.142750 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a91d4dd2-5383-499a-b7ca-67a86375ec7c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:03.152863 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a91d4dd2-5383-499a-b7ca-67a86375ec7c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:03.153150 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9a1dbdcd-c871-40c7-af20-afa4649cf0e7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:03.153596 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a91d4dd2-5383-499a-b7ca-67a86375ec7c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:03.153871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9a1dbdcd-c871-40c7-af20-afa4649cf0e7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:03.154838 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a91d4dd2-5383-499a-b7ca-67a86375ec7c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:03.155104 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9a1dbdcd-c871-40c7-af20-afa4649cf0e7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:03.155547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a91d4dd2-5383-499a-b7ca-67a86375ec7c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:03.155819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9a1dbdcd-c871-40c7-af20-afa4649cf0e7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:03.185925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a91d4dd2-5383-499a-b7ca-67a86375ec7c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051467 Apr 05 11:59:03.186181 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9a1dbdcd-c871-40c7-af20-afa4649cf0e7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051552 Apr 05 11:59:03.186540 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 576/1181] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:03 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:03.186849 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 605/1181] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:03 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:04.090168 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-67ab7ef2-2eaa-4e9a-bf03-5b0ed2c812c8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:04.091644 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-67ab7ef2-2eaa-4e9a-bf03-5b0ed2c812c8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:04.099865 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-67ab7ef2-2eaa-4e9a-bf03-5b0ed2c812c8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:04.100391 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-67ab7ef2-2eaa-4e9a-bf03-5b0ed2c812c8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:04.101147 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-67ab7ef2-2eaa-4e9a-bf03-5b0ed2c812c8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:04.101575 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-67ab7ef2-2eaa-4e9a-bf03-5b0ed2c812c8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:04.130096 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-67ab7ef2-2eaa-4e9a-bf03-5b0ed2c812c8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047136 Apr 05 11:59:04.130642 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 577/1182] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:04 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:04.202025 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3238b34b-1258-4b33-abda-d46844fc0d16 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:04.202882 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4f173d9a-2e7b-4859-a32e-b2a3fffca001 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:04.203466 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3238b34b-1258-4b33-abda-d46844fc0d16 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:04.204431 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4f173d9a-2e7b-4859-a32e-b2a3fffca001 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:04.211532 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4f173d9a-2e7b-4859-a32e-b2a3fffca001 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:04.211718 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3238b34b-1258-4b33-abda-d46844fc0d16 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:04.211967 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3238b34b-1258-4b33-abda-d46844fc0d16 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:04.212135 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4f173d9a-2e7b-4859-a32e-b2a3fffca001 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:04.212758 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4f173d9a-2e7b-4859-a32e-b2a3fffca001 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:04.212921 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3238b34b-1258-4b33-abda-d46844fc0d16 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:04.213179 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3238b34b-1258-4b33-abda-d46844fc0d16 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:04.213322 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4f173d9a-2e7b-4859-a32e-b2a3fffca001 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:04.242449 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4f173d9a-2e7b-4859-a32e-b2a3fffca001 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046077 Apr 05 11:59:04.243004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 578/1183] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:04 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:59:04.243581 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3238b34b-1258-4b33-abda-d46844fc0d16 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048367 Apr 05 11:59:04.244156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 606/1184] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:04 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:05.146353 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e016a767-71cb-4eab-b072-4192b35aae6f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:05.147880 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e016a767-71cb-4eab-b072-4192b35aae6f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:05.158059 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e016a767-71cb-4eab-b072-4192b35aae6f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:05.158852 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e016a767-71cb-4eab-b072-4192b35aae6f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:05.160147 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e016a767-71cb-4eab-b072-4192b35aae6f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:05.160888 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e016a767-71cb-4eab-b072-4192b35aae6f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:05.195911 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e016a767-71cb-4eab-b072-4192b35aae6f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056388 Apr 05 11:59:05.196515 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 579/1185] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:05 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:05.258414 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b40c8e33-b178-4cd6-9619-37a3c237ec41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:05.259280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f7e12334-e0a1-4f55-9de0-ff7edb1c6393 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:05.260195 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b40c8e33-b178-4cd6-9619-37a3c237ec41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:05.260607 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f7e12334-e0a1-4f55-9de0-ff7edb1c6393 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:05.269871 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b40c8e33-b178-4cd6-9619-37a3c237ec41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:05.270098 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f7e12334-e0a1-4f55-9de0-ff7edb1c6393 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:05.270321 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b40c8e33-b178-4cd6-9619-37a3c237ec41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:05.270610 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f7e12334-e0a1-4f55-9de0-ff7edb1c6393 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:05.271086 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b40c8e33-b178-4cd6-9619-37a3c237ec41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:05.271355 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f7e12334-e0a1-4f55-9de0-ff7edb1c6393 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:05.271526 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b40c8e33-b178-4cd6-9619-37a3c237ec41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:05.271833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f7e12334-e0a1-4f55-9de0-ff7edb1c6393 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:05.301955 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b40c8e33-b178-4cd6-9619-37a3c237ec41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050039 Apr 05 11:59:05.302531 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 607/1186] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:05 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:05.303003 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f7e12334-e0a1-4f55-9de0-ff7edb1c6393 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050774 Apr 05 11:59:05.303559 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 580/1187] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:05 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:06.213032 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6a98a279-76c7-4876-8fe2-9f7beebfdef2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:06.214527 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6a98a279-76c7-4876-8fe2-9f7beebfdef2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:06.223567 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6a98a279-76c7-4876-8fe2-9f7beebfdef2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:06.224025 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6a98a279-76c7-4876-8fe2-9f7beebfdef2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:06.224825 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6a98a279-76c7-4876-8fe2-9f7beebfdef2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:06.225264 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6a98a279-76c7-4876-8fe2-9f7beebfdef2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:06.254033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6a98a279-76c7-4876-8fe2-9f7beebfdef2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048269 Apr 05 11:59:06.254571 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 608/1188] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:06 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:06.316034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a582ae8b-b99b-4f21-999b-6db5185a1d44 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:06.316706 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-72f0a9d2-aea7-4680-9066-4e7fe8354d6c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:06.317073 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a582ae8b-b99b-4f21-999b-6db5185a1d44 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:06.317174 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-72f0a9d2-aea7-4680-9066-4e7fe8354d6c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:06.323594 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a582ae8b-b99b-4f21-999b-6db5185a1d44 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:06.323780 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-72f0a9d2-aea7-4680-9066-4e7fe8354d6c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:06.324035 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a582ae8b-b99b-4f21-999b-6db5185a1d44 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:06.324223 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-72f0a9d2-aea7-4680-9066-4e7fe8354d6c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:06.324815 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a582ae8b-b99b-4f21-999b-6db5185a1d44 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:06.324960 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-72f0a9d2-aea7-4680-9066-4e7fe8354d6c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:06.325245 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a582ae8b-b99b-4f21-999b-6db5185a1d44 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:06.325418 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-72f0a9d2-aea7-4680-9066-4e7fe8354d6c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:06.354344 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-72f0a9d2-aea7-4680-9066-4e7fe8354d6c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043343 Apr 05 11:59:06.354556 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a582ae8b-b99b-4f21-999b-6db5185a1d44 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043322 Apr 05 11:59:06.355116 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 581/1189] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:06 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:06.355275 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 609/1190] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:06 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:07.269785 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9458b1c0-02be-4ae4-837b-bf37207cd09d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:07.271284 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9458b1c0-02be-4ae4-837b-bf37207cd09d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:07.281576 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9458b1c0-02be-4ae4-837b-bf37207cd09d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:07.282308 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9458b1c0-02be-4ae4-837b-bf37207cd09d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:07.283607 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9458b1c0-02be-4ae4-837b-bf37207cd09d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:07.284372 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9458b1c0-02be-4ae4-837b-bf37207cd09d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:07.320761 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9458b1c0-02be-4ae4-837b-bf37207cd09d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057821 Apr 05 11:59:07.321749 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 582/1191] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:07 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:07.366683 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-779cff92-5055-41b7-a526-eb761fd59421 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:07.367300 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-56c22557-5c6e-47b2-bb7c-2a8161172453 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:07.367620 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-779cff92-5055-41b7-a526-eb761fd59421 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:07.367776 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-56c22557-5c6e-47b2-bb7c-2a8161172453 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:07.374525 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-779cff92-5055-41b7-a526-eb761fd59421 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:07.374889 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56c22557-5c6e-47b2-bb7c-2a8161172453 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:07.375058 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-779cff92-5055-41b7-a526-eb761fd59421 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:07.375346 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56c22557-5c6e-47b2-bb7c-2a8161172453 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:07.375745 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-779cff92-5055-41b7-a526-eb761fd59421 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:07.376119 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56c22557-5c6e-47b2-bb7c-2a8161172453 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:07.376260 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-779cff92-5055-41b7-a526-eb761fd59421 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:07.376586 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56c22557-5c6e-47b2-bb7c-2a8161172453 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:07.406613 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-56c22557-5c6e-47b2-bb7c-2a8161172453 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043727 Apr 05 11:59:07.406887 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-779cff92-5055-41b7-a526-eb761fd59421 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044080 Apr 05 11:59:07.407569 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 583/1192] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:07 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:07.407738 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 610/1193] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:07 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:08.338017 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3f7beb84-5d7c-4328-86d4-326f181a0338 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:08.339503 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3f7beb84-5d7c-4328-86d4-326f181a0338 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:08.348905 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f7beb84-5d7c-4328-86d4-326f181a0338 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:08.349356 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f7beb84-5d7c-4328-86d4-326f181a0338 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:08.350121 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f7beb84-5d7c-4328-86d4-326f181a0338 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:08.350556 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f7beb84-5d7c-4328-86d4-326f181a0338 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:08.380242 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3f7beb84-5d7c-4328-86d4-326f181a0338 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049420 Apr 05 11:59:08.380811 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 584/1194] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:08 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:08.418516 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d9716358-d44b-420f-bfba-26a9989d7190 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:08.419086 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-dc1fa406-a90a-4503-baea-b7f7943077ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:08.419436 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-dc1fa406-a90a-4503-baea-b7f7943077ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:08.419692 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d9716358-d44b-420f-bfba-26a9989d7190 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:08.425682 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dc1fa406-a90a-4503-baea-b7f7943077ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:08.426164 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dc1fa406-a90a-4503-baea-b7f7943077ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:08.426346 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d9716358-d44b-420f-bfba-26a9989d7190 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:08.426771 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d9716358-d44b-420f-bfba-26a9989d7190 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:08.426913 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dc1fa406-a90a-4503-baea-b7f7943077ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:08.427351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dc1fa406-a90a-4503-baea-b7f7943077ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:08.427500 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d9716358-d44b-420f-bfba-26a9989d7190 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:08.427935 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d9716358-d44b-420f-bfba-26a9989d7190 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:08.456726 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-dc1fa406-a90a-4503-baea-b7f7943077ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042120 Apr 05 11:59:08.457300 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 585/1195] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:08 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:08.457459 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d9716358-d44b-420f-bfba-26a9989d7190 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042892 Apr 05 11:59:08.458041 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 611/1196] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:08 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:09.395760 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-36959acd-312b-4f22-8258-001a40614a43 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:09.396705 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-36959acd-312b-4f22-8258-001a40614a43 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:09.403386 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-36959acd-312b-4f22-8258-001a40614a43 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:09.403839 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-36959acd-312b-4f22-8258-001a40614a43 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:09.404639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-36959acd-312b-4f22-8258-001a40614a43 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:09.405071 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-36959acd-312b-4f22-8258-001a40614a43 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:09.433830 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-36959acd-312b-4f22-8258-001a40614a43 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044080 Apr 05 11:59:09.434391 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 586/1197] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:09 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:09.469105 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-62a6c86c-e057-41dc-90e6-0f4854001d47 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:09.469693 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ef555c8a-d202-4f18-8dcb-cc1a88550c78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:09.470028 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-62a6c86c-e057-41dc-90e6-0f4854001d47 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:09.470220 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ef555c8a-d202-4f18-8dcb-cc1a88550c78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:09.477040 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-62a6c86c-e057-41dc-90e6-0f4854001d47 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:09.477286 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef555c8a-d202-4f18-8dcb-cc1a88550c78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:09.477438 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef555c8a-d202-4f18-8dcb-cc1a88550c78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:09.477563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-62a6c86c-e057-41dc-90e6-0f4854001d47 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:09.478231 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-62a6c86c-e057-41dc-90e6-0f4854001d47 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:09.478498 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef555c8a-d202-4f18-8dcb-cc1a88550c78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:09.478641 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-62a6c86c-e057-41dc-90e6-0f4854001d47 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:09.479015 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef555c8a-d202-4f18-8dcb-cc1a88550c78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:09.508491 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-62a6c86c-e057-41dc-90e6-0f4854001d47 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043309 Apr 05 11:59:09.509085 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 612/1198] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:09 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:09.510426 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ef555c8a-d202-4f18-8dcb-cc1a88550c78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044946 Apr 05 11:59:09.511164 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 587/1199] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:09 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:10.450547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-faddc614-238d-4a15-9c8e-d0ff38618cab tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:10.452022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-faddc614-238d-4a15-9c8e-d0ff38618cab tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:10.460343 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-faddc614-238d-4a15-9c8e-d0ff38618cab tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:10.461137 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-faddc614-238d-4a15-9c8e-d0ff38618cab tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:10.461939 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-faddc614-238d-4a15-9c8e-d0ff38618cab tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:10.462396 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-faddc614-238d-4a15-9c8e-d0ff38618cab tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:10.491884 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-faddc614-238d-4a15-9c8e-d0ff38618cab tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048338 Apr 05 11:59:10.492573 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 613/1200] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:10 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:10.521207 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-869275c8-9f44-4a3a-a8e9-cbf8fe304cff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:10.521744 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-79647087-348c-437a-ac8e-06f8c8dc3dcb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:10.522495 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-869275c8-9f44-4a3a-a8e9-cbf8fe304cff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:10.522662 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-79647087-348c-437a-ac8e-06f8c8dc3dcb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:10.529336 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79647087-348c-437a-ac8e-06f8c8dc3dcb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:10.529769 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-869275c8-9f44-4a3a-a8e9-cbf8fe304cff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:10.529930 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79647087-348c-437a-ac8e-06f8c8dc3dcb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:10.530189 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-869275c8-9f44-4a3a-a8e9-cbf8fe304cff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:10.530508 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79647087-348c-437a-ac8e-06f8c8dc3dcb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:10.530954 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79647087-348c-437a-ac8e-06f8c8dc3dcb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:10.531068 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-869275c8-9f44-4a3a-a8e9-cbf8fe304cff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:10.531383 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-869275c8-9f44-4a3a-a8e9-cbf8fe304cff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:10.559900 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-869275c8-9f44-4a3a-a8e9-cbf8fe304cff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042885 Apr 05 11:59:10.560174 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-79647087-348c-437a-ac8e-06f8c8dc3dcb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042176 Apr 05 11:59:10.560840 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 588/1201] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:10 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:10.561082 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 614/1202] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:10 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:11.506697 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-06ddca4a-9177-4f03-ad56-8db0baaa3c79 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:11.507616 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-06ddca4a-9177-4f03-ad56-8db0baaa3c79 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:11.514073 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-06ddca4a-9177-4f03-ad56-8db0baaa3c79 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:11.514522 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-06ddca4a-9177-4f03-ad56-8db0baaa3c79 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:11.515286 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-06ddca4a-9177-4f03-ad56-8db0baaa3c79 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:11.515720 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-06ddca4a-9177-4f03-ad56-8db0baaa3c79 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:11.544377 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-06ddca4a-9177-4f03-ad56-8db0baaa3c79 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042916 Apr 05 11:59:11.544994 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 589/1203] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:11 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:11.570857 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f715b523-2869-406d-b4cb-78f4293bc08f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:11.571076 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a172a4fe-8ace-4b76-b4d9-0ba6a90372db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:11.571802 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f715b523-2869-406d-b4cb-78f4293bc08f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:11.572007 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a172a4fe-8ace-4b76-b4d9-0ba6a90372db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:11.578113 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f715b523-2869-406d-b4cb-78f4293bc08f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:11.578565 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f715b523-2869-406d-b4cb-78f4293bc08f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:11.578712 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a172a4fe-8ace-4b76-b4d9-0ba6a90372db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:11.579033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a172a4fe-8ace-4b76-b4d9-0ba6a90372db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:11.579312 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f715b523-2869-406d-b4cb-78f4293bc08f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:11.579781 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f715b523-2869-406d-b4cb-78f4293bc08f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:11.579943 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a172a4fe-8ace-4b76-b4d9-0ba6a90372db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:11.580249 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a172a4fe-8ace-4b76-b4d9-0ba6a90372db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:11.608628 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f715b523-2869-406d-b4cb-78f4293bc08f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041478 Apr 05 11:59:11.609221 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 590/1204] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:11 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:11.609915 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a172a4fe-8ace-4b76-b4d9-0ba6a90372db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042720 Apr 05 11:59:11.610471 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 615/1205] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:11 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:12.560290 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fc9124f9-e2ed-411b-a050-a71a5df4f31c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:12.561519 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fc9124f9-e2ed-411b-a050-a71a5df4f31c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:12.570145 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fc9124f9-e2ed-411b-a050-a71a5df4f31c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:12.570733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fc9124f9-e2ed-411b-a050-a71a5df4f31c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:12.571731 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fc9124f9-e2ed-411b-a050-a71a5df4f31c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:12.572352 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fc9124f9-e2ed-411b-a050-a71a5df4f31c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:12.603607 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fc9124f9-e2ed-411b-a050-a71a5df4f31c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048733 Apr 05 11:59:12.604165 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 591/1206] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:12 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:12.620578 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c9b50be6-44fb-4621-a410-61f09f3b1f05 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:12.621502 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c9b50be6-44fb-4621-a410-61f09f3b1f05 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:12.621676 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-dfd72e3f-2197-41fa-a243-5a330894c108 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:12.622395 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-dfd72e3f-2197-41fa-a243-5a330894c108 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:12.628406 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9b50be6-44fb-4621-a410-61f09f3b1f05 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:12.628588 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dfd72e3f-2197-41fa-a243-5a330894c108 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:12.628849 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9b50be6-44fb-4621-a410-61f09f3b1f05 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:12.629010 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dfd72e3f-2197-41fa-a243-5a330894c108 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:12.629596 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dfd72e3f-2197-41fa-a243-5a330894c108 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:12.629734 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9b50be6-44fb-4621-a410-61f09f3b1f05 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:12.630016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dfd72e3f-2197-41fa-a243-5a330894c108 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:12.630161 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9b50be6-44fb-4621-a410-61f09f3b1f05 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:12.658513 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c9b50be6-44fb-4621-a410-61f09f3b1f05 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041923 Apr 05 11:59:12.658925 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-dfd72e3f-2197-41fa-a243-5a330894c108 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040902 Apr 05 11:59:12.659066 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 616/1207] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:12 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:12.659452 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 592/1208] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:12 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:59:13.619695 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f9d852fc-8a5e-4bab-8682-848cac939bd1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:13.621236 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f9d852fc-8a5e-4bab-8682-848cac939bd1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:13.631091 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9d852fc-8a5e-4bab-8682-848cac939bd1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:13.631539 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9d852fc-8a5e-4bab-8682-848cac939bd1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:13.632352 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9d852fc-8a5e-4bab-8682-848cac939bd1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:13.632794 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9d852fc-8a5e-4bab-8682-848cac939bd1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:13.661832 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f9d852fc-8a5e-4bab-8682-848cac939bd1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048901 Apr 05 11:59:13.662383 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 617/1209] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:13 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:13.670212 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-70ee65e5-1329-47cd-bf0c-de332fc10b4d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:13.670410 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b668d38d-a3f9-4ecc-a8b5-b9e02410c409 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:13.671241 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-70ee65e5-1329-47cd-bf0c-de332fc10b4d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:13.671399 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b668d38d-a3f9-4ecc-a8b5-b9e02410c409 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:13.677859 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-70ee65e5-1329-47cd-bf0c-de332fc10b4d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:13.678147 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b668d38d-a3f9-4ecc-a8b5-b9e02410c409 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:13.678323 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-70ee65e5-1329-47cd-bf0c-de332fc10b4d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:13.678603 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b668d38d-a3f9-4ecc-a8b5-b9e02410c409 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:13.679049 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-70ee65e5-1329-47cd-bf0c-de332fc10b4d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:13.679379 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b668d38d-a3f9-4ecc-a8b5-b9e02410c409 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:13.679527 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-70ee65e5-1329-47cd-bf0c-de332fc10b4d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:13.679784 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b668d38d-a3f9-4ecc-a8b5-b9e02410c409 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:13.708826 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b668d38d-a3f9-4ecc-a8b5-b9e02410c409 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042361 Apr 05 11:59:13.709063 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-70ee65e5-1329-47cd-bf0c-de332fc10b4d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042537 Apr 05 11:59:13.709580 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 618/1210] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:13 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:13.710117 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 593/1211] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:13 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:14.677877 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5fc2f955-1ec8-4506-8c00-0ff647e09eeb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:14.679004 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5fc2f955-1ec8-4506-8c00-0ff647e09eeb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:14.687152 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5fc2f955-1ec8-4506-8c00-0ff647e09eeb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:14.687708 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5fc2f955-1ec8-4506-8c00-0ff647e09eeb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:14.688693 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5fc2f955-1ec8-4506-8c00-0ff647e09eeb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:14.689232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5fc2f955-1ec8-4506-8c00-0ff647e09eeb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:14.720893 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7dd84769-e811-4795-a7c7-48cad486fe93 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:14.721842 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7dd84769-e811-4795-a7c7-48cad486fe93 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:14.722725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5fc2f955-1ec8-4506-8c00-0ff647e09eeb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051371 Apr 05 11:59:14.723408 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 619/1212] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:14 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:14.727824 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7186d817-2efe-4048-be54-b2d505e54a5d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:14.728409 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7dd84769-e811-4795-a7c7-48cad486fe93 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:14.728731 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7186d817-2efe-4048-be54-b2d505e54a5d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:14.728849 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7dd84769-e811-4795-a7c7-48cad486fe93 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:14.729608 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7dd84769-e811-4795-a7c7-48cad486fe93 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:14.730036 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7dd84769-e811-4795-a7c7-48cad486fe93 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:14.734626 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7186d817-2efe-4048-be54-b2d505e54a5d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:14.735074 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7186d817-2efe-4048-be54-b2d505e54a5d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:14.735838 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7186d817-2efe-4048-be54-b2d505e54a5d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:14.736305 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7186d817-2efe-4048-be54-b2d505e54a5d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:14.759356 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7dd84769-e811-4795-a7c7-48cad486fe93 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042541 Apr 05 11:59:14.759842 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 594/1213] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:14 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:14.765133 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7186d817-2efe-4048-be54-b2d505e54a5d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040835 Apr 05 11:59:14.765686 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 620/1214] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:14 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:15.738999 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4008d674-4c14-4eb7-8f31-aa9ea05d9c40 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:15.740357 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4008d674-4c14-4eb7-8f31-aa9ea05d9c40 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:15.748164 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4008d674-4c14-4eb7-8f31-aa9ea05d9c40 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:15.748633 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4008d674-4c14-4eb7-8f31-aa9ea05d9c40 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:15.749516 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4008d674-4c14-4eb7-8f31-aa9ea05d9c40 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:15.750019 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4008d674-4c14-4eb7-8f31-aa9ea05d9c40 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:15.771992 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-68a649b0-31dd-4eb6-94ae-871827e4aa74 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:15.772937 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-68a649b0-31dd-4eb6-94ae-871827e4aa74 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:15.779469 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-68a649b0-31dd-4eb6-94ae-871827e4aa74 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:15.779918 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-68a649b0-31dd-4eb6-94ae-871827e4aa74 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:15.780709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-68a649b0-31dd-4eb6-94ae-871827e4aa74 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:15.781119 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-68a649b0-31dd-4eb6-94ae-871827e4aa74 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:15.782431 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4008d674-4c14-4eb7-8f31-aa9ea05d9c40 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050236 Apr 05 11:59:15.786735 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 595/1215] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:15 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:15.787771 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-75e7bebf-a665-4b79-a49b-824d40077fa2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:15.788686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-75e7bebf-a665-4b79-a49b-824d40077fa2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:15.794563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-75e7bebf-a665-4b79-a49b-824d40077fa2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:15.795027 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-75e7bebf-a665-4b79-a49b-824d40077fa2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:15.795778 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-75e7bebf-a665-4b79-a49b-824d40077fa2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:15.796237 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-75e7bebf-a665-4b79-a49b-824d40077fa2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:15.809953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-68a649b0-31dd-4eb6-94ae-871827e4aa74 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042498 Apr 05 11:59:15.813942 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 621/1216] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:15 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:15.825354 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-75e7bebf-a665-4b79-a49b-824d40077fa2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041345 Apr 05 11:59:15.826088 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 596/1217] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:15 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:16.799324 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b96e53b3-b309-4641-ae3a-0d783b6e05c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:16.800718 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b96e53b3-b309-4641-ae3a-0d783b6e05c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:16.811302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b96e53b3-b309-4641-ae3a-0d783b6e05c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:16.812028 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b96e53b3-b309-4641-ae3a-0d783b6e05c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:16.813327 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b96e53b3-b309-4641-ae3a-0d783b6e05c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:16.814041 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b96e53b3-b309-4641-ae3a-0d783b6e05c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:16.822862 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-204568f9-a4ff-43e6-a153-95fa8ad06ebe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:16.823782 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-204568f9-a4ff-43e6-a153-95fa8ad06ebe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:16.830317 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-204568f9-a4ff-43e6-a153-95fa8ad06ebe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:16.830760 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-204568f9-a4ff-43e6-a153-95fa8ad06ebe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:16.831513 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-204568f9-a4ff-43e6-a153-95fa8ad06ebe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:16.832039 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-204568f9-a4ff-43e6-a153-95fa8ad06ebe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:16.845912 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b96e53b3-b309-4641-ae3a-0d783b6e05c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053931 Apr 05 11:59:16.846477 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 622/1218] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:16 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:16.851192 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-46ad6206-0e32-4c63-9bb8-c44c0aad0aab tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:16.852106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-46ad6206-0e32-4c63-9bb8-c44c0aad0aab tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:16.857744 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-46ad6206-0e32-4c63-9bb8-c44c0aad0aab tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:16.858184 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-46ad6206-0e32-4c63-9bb8-c44c0aad0aab tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:16.858932 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-46ad6206-0e32-4c63-9bb8-c44c0aad0aab tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:16.859356 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-46ad6206-0e32-4c63-9bb8-c44c0aad0aab tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:16.861770 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-204568f9-a4ff-43e6-a153-95fa8ad06ebe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042777 Apr 05 11:59:16.862320 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 597/1219] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:16 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:16.887558 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-46ad6206-0e32-4c63-9bb8-c44c0aad0aab tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040088 Apr 05 11:59:16.888088 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 623/1220] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:16 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:17.862443 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8288ea22-d4eb-4bdb-96af-2916781f4143 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:17.863995 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8288ea22-d4eb-4bdb-96af-2916781f4143 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:17.871217 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8288ea22-d4eb-4bdb-96af-2916781f4143 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:17.871658 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8288ea22-d4eb-4bdb-96af-2916781f4143 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:17.872433 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8288ea22-d4eb-4bdb-96af-2916781f4143 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:17.872858 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8288ea22-d4eb-4bdb-96af-2916781f4143 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:17.873365 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4f50cb07-5f7c-45d6-b399-866016710c1a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:17.874295 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4f50cb07-5f7c-45d6-b399-866016710c1a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:17.880903 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f50cb07-5f7c-45d6-b399-866016710c1a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:17.881343 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f50cb07-5f7c-45d6-b399-866016710c1a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:17.882095 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f50cb07-5f7c-45d6-b399-866016710c1a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:17.882524 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f50cb07-5f7c-45d6-b399-866016710c1a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:17.903106 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8288ea22-d4eb-4bdb-96af-2916781f4143 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047438 Apr 05 11:59:17.906929 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 598/1221] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:17 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:17.908253 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-02aefcbc-1af0-4a8e-bfdd-c8342fbcf91c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:17.909165 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-02aefcbc-1af0-4a8e-bfdd-c8342fbcf91c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:17.912050 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4f50cb07-5f7c-45d6-b399-866016710c1a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042475 Apr 05 11:59:17.912643 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 624/1222] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:17 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:17.914728 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02aefcbc-1af0-4a8e-bfdd-c8342fbcf91c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:17.915174 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02aefcbc-1af0-4a8e-bfdd-c8342fbcf91c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:17.915944 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02aefcbc-1af0-4a8e-bfdd-c8342fbcf91c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:17.916409 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02aefcbc-1af0-4a8e-bfdd-c8342fbcf91c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:17.944638 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-02aefcbc-1af0-4a8e-bfdd-c8342fbcf91c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039916 Apr 05 11:59:17.945172 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 599/1223] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:17 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:18.919063 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e7d4c30d-9c17-4f95-bb42-231cfc5291e8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:18.920850 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e7d4c30d-9c17-4f95-bb42-231cfc5291e8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:18.928290 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-220cc2c3-4027-438e-a85b-0c678c689fa3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:18.929788 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-220cc2c3-4027-438e-a85b-0c678c689fa3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:18.931892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e7d4c30d-9c17-4f95-bb42-231cfc5291e8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:18.932764 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e7d4c30d-9c17-4f95-bb42-231cfc5291e8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:18.934049 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e7d4c30d-9c17-4f95-bb42-231cfc5291e8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:18.934814 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e7d4c30d-9c17-4f95-bb42-231cfc5291e8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:18.939562 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-220cc2c3-4027-438e-a85b-0c678c689fa3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:18.940466 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-220cc2c3-4027-438e-a85b-0c678c689fa3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:18.941625 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-220cc2c3-4027-438e-a85b-0c678c689fa3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:18.942349 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-220cc2c3-4027-438e-a85b-0c678c689fa3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:18.967985 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e7d4c30d-9c17-4f95-bb42-231cfc5291e8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055746 Apr 05 11:59:18.968608 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 625/1224] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:18 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:18.973055 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-220cc2c3-4027-438e-a85b-0c678c689fa3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051454 Apr 05 11:59:18.973804 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 600/1225] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:18 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:18.976767 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2a3d4854-6e55-455a-b98e-a837d049bdf4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:18.977671 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2a3d4854-6e55-455a-b98e-a837d049bdf4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:18.983246 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2a3d4854-6e55-455a-b98e-a837d049bdf4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:18.983693 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2a3d4854-6e55-455a-b98e-a837d049bdf4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:18.984477 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2a3d4854-6e55-455a-b98e-a837d049bdf4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:18.985007 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2a3d4854-6e55-455a-b98e-a837d049bdf4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:19.012709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2a3d4854-6e55-455a-b98e-a837d049bdf4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039756 Apr 05 11:59:19.013252 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 626/1226] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:18 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:19.984154 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-31ace302-898c-4c93-8b05-80ec06d70851 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:19.985737 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-31ace302-898c-4c93-8b05-80ec06d70851 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:19.988818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6f7ced0f-d883-4153-a70e-9c9ed1d0aa1d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:19.990244 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6f7ced0f-d883-4153-a70e-9c9ed1d0aa1d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:19.994228 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-31ace302-898c-4c93-8b05-80ec06d70851 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:19.994675 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-31ace302-898c-4c93-8b05-80ec06d70851 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:19.995467 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-31ace302-898c-4c93-8b05-80ec06d70851 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:19.995901 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-31ace302-898c-4c93-8b05-80ec06d70851 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:19.996725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f7ced0f-d883-4153-a70e-9c9ed1d0aa1d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:19.997168 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f7ced0f-d883-4153-a70e-9c9ed1d0aa1d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:19.997922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f7ced0f-d883-4153-a70e-9c9ed1d0aa1d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:19.998349 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f7ced0f-d883-4153-a70e-9c9ed1d0aa1d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:20.025609 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-31ace302-898c-4c93-8b05-80ec06d70851 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048269 Apr 05 11:59:20.026209 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 601/1227] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:19 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:20.027591 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6f7ced0f-d883-4153-a70e-9c9ed1d0aa1d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045111 Apr 05 11:59:20.031539 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 627/1228] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:19 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:20.031691 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7cc8a566-a97c-4988-bb2d-1c2062903585 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:20.032102 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7cc8a566-a97c-4988-bb2d-1c2062903585 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:20.037900 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7cc8a566-a97c-4988-bb2d-1c2062903585 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:20.038352 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7cc8a566-a97c-4988-bb2d-1c2062903585 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:20.039115 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7cc8a566-a97c-4988-bb2d-1c2062903585 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:20.039551 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7cc8a566-a97c-4988-bb2d-1c2062903585 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:20.067137 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7cc8a566-a97c-4988-bb2d-1c2062903585 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039964 Apr 05 11:59:20.067691 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 602/1229] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:20 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:21.040430 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f72a5c0f-f9a5-4403-afcd-a0bc60791666 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:21.041119 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7ed8a2bc-5cbe-4aca-9df2-2de6820b31a8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:21.041501 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f72a5c0f-f9a5-4403-afcd-a0bc60791666 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:21.042088 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7ed8a2bc-5cbe-4aca-9df2-2de6820b31a8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:21.048102 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f72a5c0f-f9a5-4403-afcd-a0bc60791666 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:21.048592 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f72a5c0f-f9a5-4403-afcd-a0bc60791666 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:21.048742 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7ed8a2bc-5cbe-4aca-9df2-2de6820b31a8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:21.049154 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7ed8a2bc-5cbe-4aca-9df2-2de6820b31a8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:21.049313 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f72a5c0f-f9a5-4403-afcd-a0bc60791666 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:21.049776 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f72a5c0f-f9a5-4403-afcd-a0bc60791666 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:21.049927 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7ed8a2bc-5cbe-4aca-9df2-2de6820b31a8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:21.050350 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7ed8a2bc-5cbe-4aca-9df2-2de6820b31a8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:21.079211 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f72a5c0f-f9a5-4403-afcd-a0bc60791666 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043999 Apr 05 11:59:21.079435 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7ed8a2bc-5cbe-4aca-9df2-2de6820b31a8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042934 Apr 05 11:59:21.079954 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 628/1230] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:21 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:21.082470 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 603/1231] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:21 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:21.084587 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d477994c-1760-4c28-b7a2-ef46a7693de8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:21.085504 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d477994c-1760-4c28-b7a2-ef46a7693de8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:21.091980 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d477994c-1760-4c28-b7a2-ef46a7693de8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:21.092431 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d477994c-1760-4c28-b7a2-ef46a7693de8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:21.093197 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d477994c-1760-4c28-b7a2-ef46a7693de8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:21.093624 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d477994c-1760-4c28-b7a2-ef46a7693de8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:21.121684 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d477994c-1760-4c28-b7a2-ef46a7693de8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040848 Apr 05 11:59:21.122226 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 629/1232] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:21 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:22.095665 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-27516633-491d-4b3b-825e-632ec46899a7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:22.096633 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-84c0a195-b43f-4c82-ae58-6d60549c70a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:22.097239 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-27516633-491d-4b3b-825e-632ec46899a7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:22.097435 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-84c0a195-b43f-4c82-ae58-6d60549c70a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:22.104829 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-27516633-491d-4b3b-825e-632ec46899a7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:22.105279 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-27516633-491d-4b3b-825e-632ec46899a7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:22.105433 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84c0a195-b43f-4c82-ae58-6d60549c70a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:22.105839 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84c0a195-b43f-4c82-ae58-6d60549c70a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:22.105993 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-27516633-491d-4b3b-825e-632ec46899a7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:22.106450 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-27516633-491d-4b3b-825e-632ec46899a7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:22.106615 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84c0a195-b43f-4c82-ae58-6d60549c70a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:22.107014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84c0a195-b43f-4c82-ae58-6d60549c70a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:22.135995 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-27516633-491d-4b3b-825e-632ec46899a7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047437 Apr 05 11:59:22.136488 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-84c0a195-b43f-4c82-ae58-6d60549c70a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047925 Apr 05 11:59:22.139999 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 604/1233] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:22 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:22.140168 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 630/1234] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:22 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:22.141409 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bb500ed8-07c6-4bf3-8e5c-de73bf0af8aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:22.142303 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bb500ed8-07c6-4bf3-8e5c-de73bf0af8aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:22.148342 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bb500ed8-07c6-4bf3-8e5c-de73bf0af8aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:22.148802 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bb500ed8-07c6-4bf3-8e5c-de73bf0af8aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:22.149562 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bb500ed8-07c6-4bf3-8e5c-de73bf0af8aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:22.149998 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bb500ed8-07c6-4bf3-8e5c-de73bf0af8aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:22.177914 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bb500ed8-07c6-4bf3-8e5c-de73bf0af8aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040051 Apr 05 11:59:22.178579 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 605/1235] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:22 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:23.150588 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3b040065-f45d-437f-84d0-124bac60f5be tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:23.151269 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-792681ff-6f1c-44f6-861b-da25810b9b13 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:23.151636 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3b040065-f45d-437f-84d0-124bac60f5be tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:23.151729 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-792681ff-6f1c-44f6-861b-da25810b9b13 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:23.158187 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b040065-f45d-437f-84d0-124bac60f5be tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:23.158642 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b040065-f45d-437f-84d0-124bac60f5be tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:23.159010 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-792681ff-6f1c-44f6-861b-da25810b9b13 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:23.159425 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b040065-f45d-437f-84d0-124bac60f5be tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:23.159568 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-792681ff-6f1c-44f6-861b-da25810b9b13 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:23.159864 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b040065-f45d-437f-84d0-124bac60f5be tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:23.160224 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-792681ff-6f1c-44f6-861b-da25810b9b13 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:23.160640 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-792681ff-6f1c-44f6-861b-da25810b9b13 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:23.189388 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3b040065-f45d-437f-84d0-124bac60f5be tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043658 Apr 05 11:59:23.189943 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 606/1236] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:23 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:23.190210 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-792681ff-6f1c-44f6-861b-da25810b9b13 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044715 Apr 05 11:59:23.191068 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 631/1237] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:23 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:23.197889 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-752194ea-4e3c-45d7-8397-52390c2e3e77 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:23.198805 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-752194ea-4e3c-45d7-8397-52390c2e3e77 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:23.205289 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-752194ea-4e3c-45d7-8397-52390c2e3e77 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:23.205715 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-752194ea-4e3c-45d7-8397-52390c2e3e77 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:23.206484 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-752194ea-4e3c-45d7-8397-52390c2e3e77 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:23.206919 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-752194ea-4e3c-45d7-8397-52390c2e3e77 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:23.235136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-752194ea-4e3c-45d7-8397-52390c2e3e77 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044235 Apr 05 11:59:23.235666 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 607/1238] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:23 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:24.201423 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d120f014-b2d3-4408-81cc-41b61eadc31e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:24.201993 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-16f97aa0-09b4-485c-b07f-eb0b0ef8e7ca tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:24.202371 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d120f014-b2d3-4408-81cc-41b61eadc31e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:24.202857 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-16f97aa0-09b4-485c-b07f-eb0b0ef8e7ca tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:24.209154 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d120f014-b2d3-4408-81cc-41b61eadc31e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:24.209331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-16f97aa0-09b4-485c-b07f-eb0b0ef8e7ca tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:24.209638 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d120f014-b2d3-4408-81cc-41b61eadc31e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:24.209793 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-16f97aa0-09b4-485c-b07f-eb0b0ef8e7ca tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:24.210413 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d120f014-b2d3-4408-81cc-41b61eadc31e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:24.210557 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-16f97aa0-09b4-485c-b07f-eb0b0ef8e7ca tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:24.210849 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-16f97aa0-09b4-485c-b07f-eb0b0ef8e7ca tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:24.211146 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d120f014-b2d3-4408-81cc-41b61eadc31e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:24.240019 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-16f97aa0-09b4-485c-b07f-eb0b0ef8e7ca tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042155 Apr 05 11:59:24.240277 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d120f014-b2d3-4408-81cc-41b61eadc31e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042580 Apr 05 11:59:24.240641 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 632/1239] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:24 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:24.241771 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 608/1240] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:24 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:24.246499 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a4b20109-f2fa-49ab-b1f9-7f8f387759c2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:24.247541 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a4b20109-f2fa-49ab-b1f9-7f8f387759c2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:24.254198 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a4b20109-f2fa-49ab-b1f9-7f8f387759c2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:24.254636 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a4b20109-f2fa-49ab-b1f9-7f8f387759c2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:24.255385 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a4b20109-f2fa-49ab-b1f9-7f8f387759c2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:24.255812 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a4b20109-f2fa-49ab-b1f9-7f8f387759c2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:24.283562 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a4b20109-f2fa-49ab-b1f9-7f8f387759c2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040794 Apr 05 11:59:24.284102 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 633/1241] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:24 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:24.609871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:59:24.610188 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Tue Apr 5 11:59:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:59:25.256138 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f5319edc-8b67-470f-9fed-cdb546a60ebb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:25.257607 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f5319edc-8b67-470f-9fed-cdb546a60ebb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:25.258245 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a74687e4-4b01-4610-8068-e446b6566e93 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:25.259797 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a74687e4-4b01-4610-8068-e446b6566e93 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:25.268252 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f5319edc-8b67-470f-9fed-cdb546a60ebb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:25.268993 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f5319edc-8b67-470f-9fed-cdb546a60ebb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:25.270290 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f5319edc-8b67-470f-9fed-cdb546a60ebb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:25.270514 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a74687e4-4b01-4610-8068-e446b6566e93 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:25.270959 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f5319edc-8b67-470f-9fed-cdb546a60ebb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:25.271199 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a74687e4-4b01-4610-8068-e446b6566e93 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:25.272268 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a74687e4-4b01-4610-8068-e446b6566e93 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:25.273072 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a74687e4-4b01-4610-8068-e446b6566e93 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:25.300870 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f5319edc-8b67-470f-9fed-cdb546a60ebb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051484 Apr 05 11:59:25.301416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 609/1242] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:25 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:25.301892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a74687e4-4b01-4610-8068-e446b6566e93 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050307 Apr 05 11:59:25.305789 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 634/1243] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:25 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:25.306265 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2f3a2467-edb1-465d-b8a2-41e90b7302b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:25.307159 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2f3a2467-edb1-465d-b8a2-41e90b7302b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:25.312911 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2f3a2467-edb1-465d-b8a2-41e90b7302b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:25.313354 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2f3a2467-edb1-465d-b8a2-41e90b7302b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:25.314105 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2f3a2467-edb1-465d-b8a2-41e90b7302b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:25.314526 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2f3a2467-edb1-465d-b8a2-41e90b7302b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:25.342160 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2f3a2467-edb1-465d-b8a2-41e90b7302b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039754 Apr 05 11:59:25.342681 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 610/1244] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:25 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:26.316585 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2904a3be-10b3-47df-b44b-e1b7e5020e02 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:26.317450 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d2c1c901-b8ee-43aa-b812-562364e94d9c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:26.318077 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2904a3be-10b3-47df-b44b-e1b7e5020e02 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:26.318497 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d2c1c901-b8ee-43aa-b812-562364e94d9c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:26.325510 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2904a3be-10b3-47df-b44b-e1b7e5020e02 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:26.325856 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d2c1c901-b8ee-43aa-b812-562364e94d9c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:26.326018 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2904a3be-10b3-47df-b44b-e1b7e5020e02 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:26.326272 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d2c1c901-b8ee-43aa-b812-562364e94d9c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:26.326706 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2904a3be-10b3-47df-b44b-e1b7e5020e02 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:26.327061 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d2c1c901-b8ee-43aa-b812-562364e94d9c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:26.327203 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2904a3be-10b3-47df-b44b-e1b7e5020e02 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:26.327490 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d2c1c901-b8ee-43aa-b812-562364e94d9c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:26.356523 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d2c1c901-b8ee-43aa-b812-562364e94d9c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046524 Apr 05 11:59:26.356953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2904a3be-10b3-47df-b44b-e1b7e5020e02 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047195 Apr 05 11:59:26.357118 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 611/1245] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:26 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:26.360043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 635/1246] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:26 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:26.363867 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b11913db-a5d4-4cf2-95f7-858f38f572ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:26.364789 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b11913db-a5d4-4cf2-95f7-858f38f572ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:26.370572 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b11913db-a5d4-4cf2-95f7-858f38f572ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:26.371011 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b11913db-a5d4-4cf2-95f7-858f38f572ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:26.371729 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b11913db-a5d4-4cf2-95f7-858f38f572ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:26.372182 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b11913db-a5d4-4cf2-95f7-858f38f572ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:26.399781 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b11913db-a5d4-4cf2-95f7-858f38f572ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041800 Apr 05 11:59:26.400351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 612/1247] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:26 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:27.372917 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d2629f81-54d7-4448-b96a-455b72fe4185 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:27.373868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6171a1d7-1582-4b0e-a9f3-bb7ba6792c80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:27.374441 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6171a1d7-1582-4b0e-a9f3-bb7ba6792c80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:27.374612 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d2629f81-54d7-4448-b96a-455b72fe4185 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:27.384242 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6171a1d7-1582-4b0e-a9f3-bb7ba6792c80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:27.384436 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d2629f81-54d7-4448-b96a-455b72fe4185 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:27.384640 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6171a1d7-1582-4b0e-a9f3-bb7ba6792c80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:27.384751 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d2629f81-54d7-4448-b96a-455b72fe4185 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:27.385421 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6171a1d7-1582-4b0e-a9f3-bb7ba6792c80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:27.385574 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d2629f81-54d7-4448-b96a-455b72fe4185 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:27.385849 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6171a1d7-1582-4b0e-a9f3-bb7ba6792c80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:27.386008 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d2629f81-54d7-4448-b96a-455b72fe4185 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:27.415108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6171a1d7-1582-4b0e-a9f3-bb7ba6792c80 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048946 Apr 05 11:59:27.415369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d2629f81-54d7-4448-b96a-455b72fe4185 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049270 Apr 05 11:59:27.415908 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 613/1248] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:27 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:27.419473 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 636/1249] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:27 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:27.420445 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a51c8f33-992e-4c62-97f3-cbafb33069a4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:27.421342 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a51c8f33-992e-4c62-97f3-cbafb33069a4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:27.427065 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a51c8f33-992e-4c62-97f3-cbafb33069a4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:27.427509 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a51c8f33-992e-4c62-97f3-cbafb33069a4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:27.428291 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a51c8f33-992e-4c62-97f3-cbafb33069a4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:27.428722 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a51c8f33-992e-4c62-97f3-cbafb33069a4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:27.456784 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a51c8f33-992e-4c62-97f3-cbafb33069a4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040082 Apr 05 11:59:27.457340 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 614/1250] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:27 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:28.431271 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-564f1f6c-69e7-48da-87c1-c52a759420c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:28.432212 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-564f1f6c-69e7-48da-87c1-c52a759420c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:28.432373 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6e3f2560-4d4f-41e7-9357-e6dc883cd208 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:28.433306 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6e3f2560-4d4f-41e7-9357-e6dc883cd208 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:28.438878 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-564f1f6c-69e7-48da-87c1-c52a759420c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:28.439291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-564f1f6c-69e7-48da-87c1-c52a759420c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:28.439733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6e3f2560-4d4f-41e7-9357-e6dc883cd208 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:28.440103 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-564f1f6c-69e7-48da-87c1-c52a759420c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:28.440261 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6e3f2560-4d4f-41e7-9357-e6dc883cd208 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:28.440539 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-564f1f6c-69e7-48da-87c1-c52a759420c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:28.440994 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6e3f2560-4d4f-41e7-9357-e6dc883cd208 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:28.441430 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6e3f2560-4d4f-41e7-9357-e6dc883cd208 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:28.472980 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-564f1f6c-69e7-48da-87c1-c52a759420c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048537 Apr 05 11:59:28.473550 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 637/1251] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:28 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:28.476387 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6e3f2560-4d4f-41e7-9357-e6dc883cd208 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051882 Apr 05 11:59:28.476951 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 615/1252] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:28 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:28.480839 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-759895c6-f91a-4ff5-a3c1-ce3f276e40ea tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:28.482256 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-759895c6-f91a-4ff5-a3c1-ce3f276e40ea tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:28.489592 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-759895c6-f91a-4ff5-a3c1-ce3f276e40ea tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:28.490043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-759895c6-f91a-4ff5-a3c1-ce3f276e40ea tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:28.490878 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-759895c6-f91a-4ff5-a3c1-ce3f276e40ea tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:28.491253 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-759895c6-f91a-4ff5-a3c1-ce3f276e40ea tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:28.519295 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-759895c6-f91a-4ff5-a3c1-ce3f276e40ea tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044798 Apr 05 11:59:28.519859 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 638/1253] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:28 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:29.485192 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5e29ccd8-059f-4095-b573-739bbad79554 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:29.486215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5e29ccd8-059f-4095-b573-739bbad79554 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:29.491153 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-400b6bf0-bae1-4f29-9678-639e96c1e222 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:29.493481 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-400b6bf0-bae1-4f29-9678-639e96c1e222 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:29.493594 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5e29ccd8-059f-4095-b573-739bbad79554 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:29.494059 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5e29ccd8-059f-4095-b573-739bbad79554 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:29.494822 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5e29ccd8-059f-4095-b573-739bbad79554 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:29.495255 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5e29ccd8-059f-4095-b573-739bbad79554 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:29.499317 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-400b6bf0-bae1-4f29-9678-639e96c1e222 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:29.499758 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-400b6bf0-bae1-4f29-9678-639e96c1e222 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:29.500570 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-400b6bf0-bae1-4f29-9678-639e96c1e222 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:29.501000 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-400b6bf0-bae1-4f29-9678-639e96c1e222 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:29.524433 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5e29ccd8-059f-4095-b573-739bbad79554 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043210 Apr 05 11:59:29.524977 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 616/1254] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:29 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:29.530720 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a15c3075-8145-4c62-a657-0e918c07d5a9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:29.531336 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-400b6bf0-bae1-4f29-9678-639e96c1e222 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046770 Apr 05 11:59:29.531618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a15c3075-8145-4c62-a657-0e918c07d5a9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:29.531900 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 639/1255] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:29 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 11:59:29.537440 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a15c3075-8145-4c62-a657-0e918c07d5a9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:29.537915 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a15c3075-8145-4c62-a657-0e918c07d5a9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:29.538644 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a15c3075-8145-4c62-a657-0e918c07d5a9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:29.539082 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a15c3075-8145-4c62-a657-0e918c07d5a9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:29.567582 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a15c3075-8145-4c62-a657-0e918c07d5a9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040532 Apr 05 11:59:29.568164 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 617/1256] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:29 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:59:30.541057 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bd663775-2448-41c0-872e-78d4295db5e7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:30.542556 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bd663775-2448-41c0-872e-78d4295db5e7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:30.547669 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2fe1c853-196b-4c9d-95ea-77e281af94ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:30.549298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2fe1c853-196b-4c9d-95ea-77e281af94ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:30.553165 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bd663775-2448-41c0-872e-78d4295db5e7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:30.553896 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bd663775-2448-41c0-872e-78d4295db5e7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:30.555145 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bd663775-2448-41c0-872e-78d4295db5e7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:30.555743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bd663775-2448-41c0-872e-78d4295db5e7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:30.558499 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2fe1c853-196b-4c9d-95ea-77e281af94ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:30.558946 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2fe1c853-196b-4c9d-95ea-77e281af94ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:30.559709 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2fe1c853-196b-4c9d-95ea-77e281af94ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:30.560185 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2fe1c853-196b-4c9d-95ea-77e281af94ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:30.584827 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bd663775-2448-41c0-872e-78d4295db5e7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050751 Apr 05 11:59:30.585397 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 640/1257] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:30 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:30.589422 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2fe1c853-196b-4c9d-95ea-77e281af94ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048524 Apr 05 11:59:30.589954 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-408b8ef3-81e5-411a-b6b0-7433f260af73 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:30.590455 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 618/1258] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:30 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:30.591208 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-408b8ef3-81e5-411a-b6b0-7433f260af73 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:30.597317 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-408b8ef3-81e5-411a-b6b0-7433f260af73 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:30.597764 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-408b8ef3-81e5-411a-b6b0-7433f260af73 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:30.598525 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-408b8ef3-81e5-411a-b6b0-7433f260af73 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:30.598936 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-408b8ef3-81e5-411a-b6b0-7433f260af73 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:30.626070 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-408b8ef3-81e5-411a-b6b0-7433f260af73 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039752 Apr 05 11:59:30.626617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 641/1259] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:30 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:31.600587 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-30cc9216-150d-4390-995b-fefa71913a11 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:31.602052 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-30cc9216-150d-4390-995b-fefa71913a11 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:31.604528 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-36878b31-a8c6-4336-9ae6-4e65fce5ef7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:31.605435 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-36878b31-a8c6-4336-9ae6-4e65fce5ef7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:31.608912 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-30cc9216-150d-4390-995b-fefa71913a11 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:31.609363 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-30cc9216-150d-4390-995b-fefa71913a11 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:31.610126 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-30cc9216-150d-4390-995b-fefa71913a11 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:31.610521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-30cc9216-150d-4390-995b-fefa71913a11 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:31.611800 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-36878b31-a8c6-4336-9ae6-4e65fce5ef7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:31.612264 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-36878b31-a8c6-4336-9ae6-4e65fce5ef7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:31.613034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-36878b31-a8c6-4336-9ae6-4e65fce5ef7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:31.613463 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-36878b31-a8c6-4336-9ae6-4e65fce5ef7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:31.638936 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-30cc9216-150d-4390-995b-fefa71913a11 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044985 Apr 05 11:59:31.639500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 619/1260] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:31 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:59:31.643993 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8420c9f2-3b5c-4ab4-bdb7-67ae86859978 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:31.644903 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8420c9f2-3b5c-4ab4-bdb7-67ae86859978 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:31.645200 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-36878b31-a8c6-4336-9ae6-4e65fce5ef7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046349 Apr 05 11:59:31.645747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 642/1261] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:31 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:31.650482 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8420c9f2-3b5c-4ab4-bdb7-67ae86859978 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:31.650924 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8420c9f2-3b5c-4ab4-bdb7-67ae86859978 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:31.651684 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8420c9f2-3b5c-4ab4-bdb7-67ae86859978 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:31.652142 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8420c9f2-3b5c-4ab4-bdb7-67ae86859978 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:31.680021 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8420c9f2-3b5c-4ab4-bdb7-67ae86859978 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039563 Apr 05 11:59:31.680623 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 620/1262] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:31 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:32.654973 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a9598d3f-4070-48f1-92c8-de14503c092d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:32.656509 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a9598d3f-4070-48f1-92c8-de14503c092d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:32.661054 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f569904b-4039-456a-82ba-6138b2d4b909 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:32.662605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f569904b-4039-456a-82ba-6138b2d4b909 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:32.667258 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a9598d3f-4070-48f1-92c8-de14503c092d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:32.667996 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a9598d3f-4070-48f1-92c8-de14503c092d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:32.669289 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a9598d3f-4070-48f1-92c8-de14503c092d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:32.670187 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a9598d3f-4070-48f1-92c8-de14503c092d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:32.673048 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f569904b-4039-456a-82ba-6138b2d4b909 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:32.673757 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f569904b-4039-456a-82ba-6138b2d4b909 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:32.675032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f569904b-4039-456a-82ba-6138b2d4b909 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:32.675801 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f569904b-4039-456a-82ba-6138b2d4b909 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:32.705907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a9598d3f-4070-48f1-92c8-de14503c092d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057683 Apr 05 11:59:32.706452 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 643/1263] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:32 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:32.707773 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f569904b-4039-456a-82ba-6138b2d4b909 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053482 Apr 05 11:59:32.711248 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fe586d41-e120-4d80-817b-92a9ff83cfaa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:32.711771 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 621/1264] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:32 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:32.712377 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fe586d41-e120-4d80-817b-92a9ff83cfaa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:32.718554 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fe586d41-e120-4d80-817b-92a9ff83cfaa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:32.718994 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fe586d41-e120-4d80-817b-92a9ff83cfaa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:32.719741 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fe586d41-e120-4d80-817b-92a9ff83cfaa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:32.720204 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fe586d41-e120-4d80-817b-92a9ff83cfaa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:32.747776 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fe586d41-e120-4d80-817b-92a9ff83cfaa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040252 Apr 05 11:59:32.748281 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 644/1265] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:32 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:33.722856 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2b034aa6-e36a-426b-8737-271941d974eb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:33.723747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-16b8b32f-a0e4-42e1-ab6e-bd25b94004eb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:33.724399 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2b034aa6-e36a-426b-8737-271941d974eb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:33.725093 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-16b8b32f-a0e4-42e1-ab6e-bd25b94004eb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:33.735133 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2b034aa6-e36a-426b-8737-271941d974eb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:33.735424 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-16b8b32f-a0e4-42e1-ab6e-bd25b94004eb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:33.735878 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2b034aa6-e36a-426b-8737-271941d974eb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:33.736179 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-16b8b32f-a0e4-42e1-ab6e-bd25b94004eb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:33.737266 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2b034aa6-e36a-426b-8737-271941d974eb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:33.737533 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-16b8b32f-a0e4-42e1-ab6e-bd25b94004eb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:33.738036 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2b034aa6-e36a-426b-8737-271941d974eb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:33.738297 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-16b8b32f-a0e4-42e1-ab6e-bd25b94004eb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:33.769540 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-16b8b32f-a0e4-42e1-ab6e-bd25b94004eb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052530 Apr 05 11:59:33.769960 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 645/1266] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:33 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:33.770438 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2b034aa6-e36a-426b-8737-271941d974eb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054454 Apr 05 11:59:33.774415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 622/1267] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:33 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:33.774546 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c3c935e1-80cc-431a-8bcf-38ddf3728618 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:33.775502 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c3c935e1-80cc-431a-8bcf-38ddf3728618 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:33.781513 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c3c935e1-80cc-431a-8bcf-38ddf3728618 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:33.781965 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c3c935e1-80cc-431a-8bcf-38ddf3728618 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:33.782727 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c3c935e1-80cc-431a-8bcf-38ddf3728618 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:33.783153 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c3c935e1-80cc-431a-8bcf-38ddf3728618 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:33.810826 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c3c935e1-80cc-431a-8bcf-38ddf3728618 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039958 Apr 05 11:59:33.811370 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 646/1268] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:33 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:34.173999 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:59:34.174293 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Tue Apr 5 11:59:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:59:34.785908 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2eebcc0b-e4e4-481e-80c1-caa04dee888e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:34.786783 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3f5087ba-914c-40e6-99ac-c8298ff1f216 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:34.787380 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2eebcc0b-e4e4-481e-80c1-caa04dee888e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:34.787750 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3f5087ba-914c-40e6-99ac-c8298ff1f216 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:34.795372 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2eebcc0b-e4e4-481e-80c1-caa04dee888e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:34.795545 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f5087ba-914c-40e6-99ac-c8298ff1f216 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:34.795825 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2eebcc0b-e4e4-481e-80c1-caa04dee888e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:34.795989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f5087ba-914c-40e6-99ac-c8298ff1f216 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:34.796710 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2eebcc0b-e4e4-481e-80c1-caa04dee888e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:34.796877 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f5087ba-914c-40e6-99ac-c8298ff1f216 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:34.797150 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2eebcc0b-e4e4-481e-80c1-caa04dee888e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:34.797301 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f5087ba-914c-40e6-99ac-c8298ff1f216 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:34.826115 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2eebcc0b-e4e4-481e-80c1-caa04dee888e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047139 Apr 05 11:59:34.826931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 623/1269] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:34 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:34.827563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3f5087ba-914c-40e6-99ac-c8298ff1f216 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048019 Apr 05 11:59:34.831280 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 647/1270] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:34 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:34.831508 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-66978955-b4bd-4332-ad05-f71a10f229b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:34.832433 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-66978955-b4bd-4332-ad05-f71a10f229b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:34.838155 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66978955-b4bd-4332-ad05-f71a10f229b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:34.838610 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66978955-b4bd-4332-ad05-f71a10f229b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:34.839365 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66978955-b4bd-4332-ad05-f71a10f229b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:34.839798 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66978955-b4bd-4332-ad05-f71a10f229b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:34.868284 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-66978955-b4bd-4332-ad05-f71a10f229b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040309 Apr 05 11:59:34.868850 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 624/1271] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:34 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:35.840376 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-992c7c62-7860-4176-b8e5-7c60de6ab197 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:35.841650 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-786849f3-804b-4946-89b3-7af4c73d6c6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:35.842109 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-992c7c62-7860-4176-b8e5-7c60de6ab197 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:35.842655 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-786849f3-804b-4946-89b3-7af4c73d6c6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:35.848586 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-992c7c62-7860-4176-b8e5-7c60de6ab197 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:35.849086 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-992c7c62-7860-4176-b8e5-7c60de6ab197 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:35.849384 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-786849f3-804b-4946-89b3-7af4c73d6c6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:35.849862 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-786849f3-804b-4946-89b3-7af4c73d6c6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:35.850107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-992c7c62-7860-4176-b8e5-7c60de6ab197 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:35.850591 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-992c7c62-7860-4176-b8e5-7c60de6ab197 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:35.850740 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-786849f3-804b-4946-89b3-7af4c73d6c6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:35.851075 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-786849f3-804b-4946-89b3-7af4c73d6c6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:35.880832 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-992c7c62-7860-4176-b8e5-7c60de6ab197 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045766 Apr 05 11:59:35.881108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-786849f3-804b-4946-89b3-7af4c73d6c6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044502 Apr 05 11:59:35.881392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 648/1272] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:35 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:35.881539 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 625/1273] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:35 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:35.886216 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1a16c99b-44c1-441d-a232-32e9dec9e5b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:35.887119 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1a16c99b-44c1-441d-a232-32e9dec9e5b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:35.893254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a16c99b-44c1-441d-a232-32e9dec9e5b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:35.893705 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a16c99b-44c1-441d-a232-32e9dec9e5b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:35.894458 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a16c99b-44c1-441d-a232-32e9dec9e5b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:35.894898 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a16c99b-44c1-441d-a232-32e9dec9e5b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:35.923711 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1a16c99b-44c1-441d-a232-32e9dec9e5b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041231 Apr 05 11:59:35.924291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 649/1274] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:35 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:36.892840 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ec2e7fd9-b798-4016-b107-42f1338ef7b2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:36.893432 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b7829efc-3b0c-42b2-9099-7b8412f66aad tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:36.893794 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ec2e7fd9-b798-4016-b107-42f1338ef7b2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:36.893903 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b7829efc-3b0c-42b2-9099-7b8412f66aad tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:36.900493 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec2e7fd9-b798-4016-b107-42f1338ef7b2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:36.900745 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b7829efc-3b0c-42b2-9099-7b8412f66aad tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:36.900909 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec2e7fd9-b798-4016-b107-42f1338ef7b2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:36.901194 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b7829efc-3b0c-42b2-9099-7b8412f66aad tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:36.901687 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec2e7fd9-b798-4016-b107-42f1338ef7b2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:36.901958 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b7829efc-3b0c-42b2-9099-7b8412f66aad tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:36.902122 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec2e7fd9-b798-4016-b107-42f1338ef7b2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:36.902391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b7829efc-3b0c-42b2-9099-7b8412f66aad tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:36.932582 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ec2e7fd9-b798-4016-b107-42f1338ef7b2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043596 Apr 05 11:59:36.932880 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b7829efc-3b0c-42b2-9099-7b8412f66aad tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043679 Apr 05 11:59:36.933182 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 650/1275] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:36 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:36.933411 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 626/1276] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:36 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:36.939098 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cf2423ee-75e3-4d02-a00a-1263d648894d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:36.940016 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cf2423ee-75e3-4d02-a00a-1263d648894d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:36.946639 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cf2423ee-75e3-4d02-a00a-1263d648894d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:36.947180 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cf2423ee-75e3-4d02-a00a-1263d648894d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:36.947977 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cf2423ee-75e3-4d02-a00a-1263d648894d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:36.948487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cf2423ee-75e3-4d02-a00a-1263d648894d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:36.976032 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cf2423ee-75e3-4d02-a00a-1263d648894d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040985 Apr 05 11:59:36.976576 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 651/1277] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:36 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:37.067609 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:59:37.067850 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Tue Apr 5 11:59:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:59:37.948037 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e8a4127a-0594-49c6-a699-ac38be28edf9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:37.949204 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-643c6c09-490e-47af-9c46-29c96975d977 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:37.949965 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e8a4127a-0594-49c6-a699-ac38be28edf9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:37.950733 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-643c6c09-490e-47af-9c46-29c96975d977 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:37.960142 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e8a4127a-0594-49c6-a699-ac38be28edf9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:37.960913 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e8a4127a-0594-49c6-a699-ac38be28edf9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:37.961439 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-643c6c09-490e-47af-9c46-29c96975d977 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:37.962176 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e8a4127a-0594-49c6-a699-ac38be28edf9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:37.962413 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-643c6c09-490e-47af-9c46-29c96975d977 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:37.962863 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e8a4127a-0594-49c6-a699-ac38be28edf9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:37.963428 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-643c6c09-490e-47af-9c46-29c96975d977 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:37.963846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-643c6c09-490e-47af-9c46-29c96975d977 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:37.993937 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e8a4127a-0594-49c6-a699-ac38be28edf9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052466 Apr 05 11:59:37.994773 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-643c6c09-490e-47af-9c46-29c96975d977 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052311 Apr 05 11:59:37.995354 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 627/1278] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:37 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:37.995613 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 652/1279] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:37 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:38.000511 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5a0fbcef-8ead-4b0d-a203-d149d2d87b62 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:38.001708 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5a0fbcef-8ead-4b0d-a203-d149d2d87b62 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:38.007585 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5a0fbcef-8ead-4b0d-a203-d149d2d87b62 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:38.008055 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5a0fbcef-8ead-4b0d-a203-d149d2d87b62 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:38.008848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5a0fbcef-8ead-4b0d-a203-d149d2d87b62 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:38.009279 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5a0fbcef-8ead-4b0d-a203-d149d2d87b62 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:38.037102 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5a0fbcef-8ead-4b0d-a203-d149d2d87b62 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040386 Apr 05 11:59:38.037650 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 628/1280] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:37 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:39.006451 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-002194dd-697f-4e40-9b53-c3471b8b3d10 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:39.007193 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-34ba8596-859b-41b5-8880-0dc4e024f43d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:39.007591 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-002194dd-697f-4e40-9b53-c3471b8b3d10 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:39.007690 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-34ba8596-859b-41b5-8880-0dc4e024f43d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:39.014646 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34ba8596-859b-41b5-8880-0dc4e024f43d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:39.014921 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-002194dd-697f-4e40-9b53-c3471b8b3d10 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:39.015074 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34ba8596-859b-41b5-8880-0dc4e024f43d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:39.015225 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-002194dd-697f-4e40-9b53-c3471b8b3d10 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:39.015896 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34ba8596-859b-41b5-8880-0dc4e024f43d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:39.016060 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-002194dd-697f-4e40-9b53-c3471b8b3d10 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:39.016344 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34ba8596-859b-41b5-8880-0dc4e024f43d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:39.016461 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-002194dd-697f-4e40-9b53-c3471b8b3d10 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:39.048343 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-002194dd-697f-4e40-9b53-c3471b8b3d10 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045980 Apr 05 11:59:39.048934 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 629/1281] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:39 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:39.051535 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-34ba8596-859b-41b5-8880-0dc4e024f43d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049227 Apr 05 11:59:39.053548 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-85fcd8be-cc59-4b03-99d7-010cb95bd36a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:39.054443 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-85fcd8be-cc59-4b03-99d7-010cb95bd36a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:39.055391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 653/1282] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:39 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:39.060820 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85fcd8be-cc59-4b03-99d7-010cb95bd36a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:39.061263 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85fcd8be-cc59-4b03-99d7-010cb95bd36a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:39.062042 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85fcd8be-cc59-4b03-99d7-010cb95bd36a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:39.062468 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85fcd8be-cc59-4b03-99d7-010cb95bd36a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:39.090901 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-85fcd8be-cc59-4b03-99d7-010cb95bd36a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040961 Apr 05 11:59:39.091472 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 630/1283] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:39 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:40.064452 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-da9363e5-ab81-4d9b-a329-4297522ee3cc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:40.065932 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-da9363e5-ab81-4d9b-a329-4297522ee3cc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:40.067075 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ef72ff37-1ad4-49f1-a0f2-c30bc54f4141 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:40.068597 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ef72ff37-1ad4-49f1-a0f2-c30bc54f4141 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:40.075951 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-da9363e5-ab81-4d9b-a329-4297522ee3cc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:40.076427 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-da9363e5-ab81-4d9b-a329-4297522ee3cc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:40.077191 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-da9363e5-ab81-4d9b-a329-4297522ee3cc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:40.077600 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef72ff37-1ad4-49f1-a0f2-c30bc54f4141 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:40.077746 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-da9363e5-ab81-4d9b-a329-4297522ee3cc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:40.078051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef72ff37-1ad4-49f1-a0f2-c30bc54f4141 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:40.078823 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef72ff37-1ad4-49f1-a0f2-c30bc54f4141 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:40.079259 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef72ff37-1ad4-49f1-a0f2-c30bc54f4141 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:40.107199 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-da9363e5-ab81-4d9b-a329-4297522ee3cc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049450 Apr 05 11:59:40.107755 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 654/1284] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:40 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:40.108356 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ef72ff37-1ad4-49f1-a0f2-c30bc54f4141 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048003 Apr 05 11:59:40.112324 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 631/1285] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:40 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:40.112497 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2aecd6e3-3fc3-44e3-be62-7894f6ba89d6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:40.113607 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2aecd6e3-3fc3-44e3-be62-7894f6ba89d6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:40.122236 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2aecd6e3-3fc3-44e3-be62-7894f6ba89d6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:40.122709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2aecd6e3-3fc3-44e3-be62-7894f6ba89d6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:40.123451 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2aecd6e3-3fc3-44e3-be62-7894f6ba89d6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:40.123885 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2aecd6e3-3fc3-44e3-be62-7894f6ba89d6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:40.152645 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2aecd6e3-3fc3-44e3-be62-7894f6ba89d6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043869 Apr 05 11:59:40.153214 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 655/1286] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:40 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:41.122740 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-67c7b638-6c2b-45e4-9918-2fee191a4098 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:41.123350 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9c89ccb7-edcd-48de-98e1-3f6d5ddcd50e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:41.123752 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-67c7b638-6c2b-45e4-9918-2fee191a4098 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:41.124326 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9c89ccb7-edcd-48de-98e1-3f6d5ddcd50e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:41.130470 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-67c7b638-6c2b-45e4-9918-2fee191a4098 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:41.130753 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9c89ccb7-edcd-48de-98e1-3f6d5ddcd50e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:41.130930 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-67c7b638-6c2b-45e4-9918-2fee191a4098 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:41.131201 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9c89ccb7-edcd-48de-98e1-3f6d5ddcd50e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:41.131670 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-67c7b638-6c2b-45e4-9918-2fee191a4098 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:41.131958 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9c89ccb7-edcd-48de-98e1-3f6d5ddcd50e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:41.132122 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-67c7b638-6c2b-45e4-9918-2fee191a4098 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:41.132391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9c89ccb7-edcd-48de-98e1-3f6d5ddcd50e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:41.161305 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-67c7b638-6c2b-45e4-9918-2fee191a4098 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044677 Apr 05 11:59:41.161518 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9c89ccb7-edcd-48de-98e1-3f6d5ddcd50e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043758 Apr 05 11:59:41.161764 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 632/1287] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:41 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:41.165340 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 656/1288] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:41 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:41.168684 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8000f8db-3b1d-4c35-9b17-656137b3b171 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:41.169590 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8000f8db-3b1d-4c35-9b17-656137b3b171 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:41.175745 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8000f8db-3b1d-4c35-9b17-656137b3b171 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:41.176223 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8000f8db-3b1d-4c35-9b17-656137b3b171 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:41.176992 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8000f8db-3b1d-4c35-9b17-656137b3b171 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:41.177425 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8000f8db-3b1d-4c35-9b17-656137b3b171 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:41.205702 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8000f8db-3b1d-4c35-9b17-656137b3b171 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042975 Apr 05 11:59:41.206247 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 633/1289] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:41 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:41.669025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:59:41.669290 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Tue Apr 5 11:59:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:59:42.177155 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-551402fc-6dc6-41c3-820b-859b4b7901f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:42.178017 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c374fdd7-5039-4f2f-ae39-a9ae8f36e9bc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:42.178619 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-551402fc-6dc6-41c3-820b-859b4b7901f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:42.178799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c374fdd7-5039-4f2f-ae39-a9ae8f36e9bc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:42.188999 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-551402fc-6dc6-41c3-820b-859b4b7901f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:42.189286 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c374fdd7-5039-4f2f-ae39-a9ae8f36e9bc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:42.189737 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-551402fc-6dc6-41c3-820b-859b4b7901f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:42.189977 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c374fdd7-5039-4f2f-ae39-a9ae8f36e9bc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:42.191019 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c374fdd7-5039-4f2f-ae39-a9ae8f36e9bc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:42.191410 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-551402fc-6dc6-41c3-820b-859b4b7901f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:42.191720 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c374fdd7-5039-4f2f-ae39-a9ae8f36e9bc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:42.191969 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-551402fc-6dc6-41c3-820b-859b4b7901f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:42.224775 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c374fdd7-5039-4f2f-ae39-a9ae8f36e9bc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054221 Apr 05 11:59:42.225457 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-551402fc-6dc6-41c3-820b-859b4b7901f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055126 Apr 05 11:59:42.225691 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 634/1290] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:42 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:42.229175 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 657/1291] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:42 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:42.230590 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6f76db77-5a97-4d29-85f1-c5346d5b38d8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:42.231594 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6f76db77-5a97-4d29-85f1-c5346d5b38d8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:42.237647 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6f76db77-5a97-4d29-85f1-c5346d5b38d8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:42.238085 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6f76db77-5a97-4d29-85f1-c5346d5b38d8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:42.238847 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6f76db77-5a97-4d29-85f1-c5346d5b38d8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:42.239280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6f76db77-5a97-4d29-85f1-c5346d5b38d8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:42.267646 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6f76db77-5a97-4d29-85f1-c5346d5b38d8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040885 Apr 05 11:59:42.268213 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 635/1292] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:42 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:43.240802 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2806170d-d2ca-424a-a3e7-4903dab72e64 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:43.241706 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0003b564-ec5b-4406-a080-a08edbb9d653 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:43.242352 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2806170d-d2ca-424a-a3e7-4903dab72e64 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:43.242500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0003b564-ec5b-4406-a080-a08edbb9d653 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:43.250889 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2806170d-d2ca-424a-a3e7-4903dab72e64 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:43.251064 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0003b564-ec5b-4406-a080-a08edbb9d653 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:43.251333 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2806170d-d2ca-424a-a3e7-4903dab72e64 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:43.251492 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0003b564-ec5b-4406-a080-a08edbb9d653 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:43.252105 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2806170d-d2ca-424a-a3e7-4903dab72e64 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:43.252249 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0003b564-ec5b-4406-a080-a08edbb9d653 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:43.252556 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2806170d-d2ca-424a-a3e7-4903dab72e64 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:43.252728 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0003b564-ec5b-4406-a080-a08edbb9d653 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:43.281884 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2806170d-d2ca-424a-a3e7-4903dab72e64 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047691 Apr 05 11:59:43.282416 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 658/1293] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:43 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:43.283412 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0003b564-ec5b-4406-a080-a08edbb9d653 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049070 Apr 05 11:59:43.284164 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 636/1294] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:43 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:59:43.286888 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9279b43d-7a26-49db-ae17-f41bfbb57fa1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:43.287788 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9279b43d-7a26-49db-ae17-f41bfbb57fa1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:43.293801 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9279b43d-7a26-49db-ae17-f41bfbb57fa1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:43.294245 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9279b43d-7a26-49db-ae17-f41bfbb57fa1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:43.294994 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9279b43d-7a26-49db-ae17-f41bfbb57fa1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:43.295418 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9279b43d-7a26-49db-ae17-f41bfbb57fa1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:43.322705 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9279b43d-7a26-49db-ae17-f41bfbb57fa1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039308 Apr 05 11:59:43.323236 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 659/1295] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:43 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:44.255892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:59:44.257161 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Tue Apr 5 11:59:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:59:44.295077 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-741254fa-6ac0-4dbb-a157-ce942c1d7eff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:44.295894 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-471495ef-c339-43d1-a931-6f8f7189a703 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:44.296041 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-741254fa-6ac0-4dbb-a157-ce942c1d7eff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:44.296839 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-471495ef-c339-43d1-a931-6f8f7189a703 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:44.302729 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-741254fa-6ac0-4dbb-a157-ce942c1d7eff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:44.303168 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-741254fa-6ac0-4dbb-a157-ce942c1d7eff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:44.303445 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-471495ef-c339-43d1-a931-6f8f7189a703 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:44.303890 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-471495ef-c339-43d1-a931-6f8f7189a703 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:44.304049 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-741254fa-6ac0-4dbb-a157-ce942c1d7eff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:44.304380 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-741254fa-6ac0-4dbb-a157-ce942c1d7eff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:44.304667 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-471495ef-c339-43d1-a931-6f8f7189a703 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:44.305099 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-471495ef-c339-43d1-a931-6f8f7189a703 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:44.333454 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-741254fa-6ac0-4dbb-a157-ce942c1d7eff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043213 Apr 05 11:59:44.333996 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 637/1296] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:44 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:44.334643 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-471495ef-c339-43d1-a931-6f8f7189a703 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043085 Apr 05 11:59:44.335194 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 660/1297] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:44 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:44.341326 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cae1817e-0de1-4b11-8a68-0c95c1f8a1c6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:44.342226 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cae1817e-0de1-4b11-8a68-0c95c1f8a1c6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:44.349634 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cae1817e-0de1-4b11-8a68-0c95c1f8a1c6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:44.350275 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cae1817e-0de1-4b11-8a68-0c95c1f8a1c6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:44.351084 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cae1817e-0de1-4b11-8a68-0c95c1f8a1c6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:44.351553 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cae1817e-0de1-4b11-8a68-0c95c1f8a1c6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:44.380561 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cae1817e-0de1-4b11-8a68-0c95c1f8a1c6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045536 Apr 05 11:59:44.381109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 638/1298] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:44 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:45.350014 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9977a484-bfcb-42ad-bf0b-c77ef3b7ecfa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:45.351107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-71238378-4204-413a-b50b-fa4f6ad8d5da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:45.351705 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9977a484-bfcb-42ad-bf0b-c77ef3b7ecfa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:45.351858 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-71238378-4204-413a-b50b-fa4f6ad8d5da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:45.360477 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71238378-4204-413a-b50b-fa4f6ad8d5da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:45.360767 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9977a484-bfcb-42ad-bf0b-c77ef3b7ecfa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:45.360899 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71238378-4204-413a-b50b-fa4f6ad8d5da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:45.361235 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9977a484-bfcb-42ad-bf0b-c77ef3b7ecfa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:45.361693 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71238378-4204-413a-b50b-fa4f6ad8d5da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:45.361997 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9977a484-bfcb-42ad-bf0b-c77ef3b7ecfa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:45.362132 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71238378-4204-413a-b50b-fa4f6ad8d5da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:45.362435 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9977a484-bfcb-42ad-bf0b-c77ef3b7ecfa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:45.392780 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9977a484-bfcb-42ad-bf0b-c77ef3b7ecfa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049726 Apr 05 11:59:45.393351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 639/1299] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:45 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:45.393681 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-71238378-4204-413a-b50b-fa4f6ad8d5da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050695 Apr 05 11:59:45.394613 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 661/1300] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:45 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:45.402320 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7bbb6377-3c96-417d-a9f8-a2dafa9d7980 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:45.403693 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7bbb6377-3c96-417d-a9f8-a2dafa9d7980 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:45.410902 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7bbb6377-3c96-417d-a9f8-a2dafa9d7980 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:45.411513 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7bbb6377-3c96-417d-a9f8-a2dafa9d7980 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:45.412671 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7bbb6377-3c96-417d-a9f8-a2dafa9d7980 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:45.413293 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7bbb6377-3c96-417d-a9f8-a2dafa9d7980 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:45.444089 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7bbb6377-3c96-417d-a9f8-a2dafa9d7980 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049709 Apr 05 11:59:45.444659 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 640/1301] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:45 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:46.408803 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3571f242-ab4c-40a1-ba18-fee38359c80c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:46.409757 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c8fa11a1-9b36-4f07-96e9-db972c96bd2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:46.410518 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c8fa11a1-9b36-4f07-96e9-db972c96bd2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:46.411137 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3571f242-ab4c-40a1-ba18-fee38359c80c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:46.421298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c8fa11a1-9b36-4f07-96e9-db972c96bd2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:46.421489 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3571f242-ab4c-40a1-ba18-fee38359c80c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:46.421747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c8fa11a1-9b36-4f07-96e9-db972c96bd2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:46.421901 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3571f242-ab4c-40a1-ba18-fee38359c80c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:46.422520 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c8fa11a1-9b36-4f07-96e9-db972c96bd2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:46.422663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3571f242-ab4c-40a1-ba18-fee38359c80c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:46.422954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c8fa11a1-9b36-4f07-96e9-db972c96bd2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:46.423108 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3571f242-ab4c-40a1-ba18-fee38359c80c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:46.453017 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c8fa11a1-9b36-4f07-96e9-db972c96bd2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050426 Apr 05 11:59:46.453583 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 641/1302] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:46 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:46.455407 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3571f242-ab4c-40a1-ba18-fee38359c80c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053297 Apr 05 11:59:46.456154 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 662/1303] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:46 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:46.458403 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9bd9e7b2-437c-488a-989d-247c8205dd6c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:46.459332 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9bd9e7b2-437c-488a-989d-247c8205dd6c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:46.465245 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9bd9e7b2-437c-488a-989d-247c8205dd6c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:46.465687 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9bd9e7b2-437c-488a-989d-247c8205dd6c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:46.466450 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9bd9e7b2-437c-488a-989d-247c8205dd6c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:46.466879 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9bd9e7b2-437c-488a-989d-247c8205dd6c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:46.494778 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9bd9e7b2-437c-488a-989d-247c8205dd6c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040205 Apr 05 11:59:46.495522 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 642/1304] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:46 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:47.470298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7c7e095c-a31d-4cbb-9dff-350bb46651f9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:47.470971 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-515d1af4-dd09-41e9-8116-c659043f1b1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:47.471335 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7c7e095c-a31d-4cbb-9dff-350bb46651f9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:47.471435 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-515d1af4-dd09-41e9-8116-c659043f1b1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:47.477850 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7c7e095c-a31d-4cbb-9dff-350bb46651f9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:47.478022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-515d1af4-dd09-41e9-8116-c659043f1b1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:47.478299 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7c7e095c-a31d-4cbb-9dff-350bb46651f9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:47.478442 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-515d1af4-dd09-41e9-8116-c659043f1b1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:47.479068 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7c7e095c-a31d-4cbb-9dff-350bb46651f9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:47.479225 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-515d1af4-dd09-41e9-8116-c659043f1b1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:47.479509 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7c7e095c-a31d-4cbb-9dff-350bb46651f9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:47.479663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-515d1af4-dd09-41e9-8116-c659043f1b1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:47.508643 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7c7e095c-a31d-4cbb-9dff-350bb46651f9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044220 Apr 05 11:59:47.508852 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-515d1af4-dd09-41e9-8116-c659043f1b1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044431 Apr 05 11:59:47.512509 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 643/1305] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:47 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:47.512657 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 663/1306] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:47 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:47.513936 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-64916cdb-93f9-45db-abd9-a7cce396cb7a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:47.514837 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-64916cdb-93f9-45db-abd9-a7cce396cb7a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:47.520440 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64916cdb-93f9-45db-abd9-a7cce396cb7a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:47.520884 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64916cdb-93f9-45db-abd9-a7cce396cb7a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:47.521641 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64916cdb-93f9-45db-abd9-a7cce396cb7a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:47.522071 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64916cdb-93f9-45db-abd9-a7cce396cb7a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:47.549959 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-64916cdb-93f9-45db-abd9-a7cce396cb7a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039790 Apr 05 11:59:47.550500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 644/1307] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:47 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:48.522096 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8d7d678f-62b0-4b01-b73c-e02e4f92e75f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:48.522691 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f562f33e-24aa-4b16-8c2d-c141ae0884f6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:48.523138 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8d7d678f-62b0-4b01-b73c-e02e4f92e75f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:48.523254 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f562f33e-24aa-4b16-8c2d-c141ae0884f6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:48.530898 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8d7d678f-62b0-4b01-b73c-e02e4f92e75f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:48.531101 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f562f33e-24aa-4b16-8c2d-c141ae0884f6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:48.531425 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8d7d678f-62b0-4b01-b73c-e02e4f92e75f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:48.531613 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f562f33e-24aa-4b16-8c2d-c141ae0884f6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:48.532374 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8d7d678f-62b0-4b01-b73c-e02e4f92e75f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:48.532545 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f562f33e-24aa-4b16-8c2d-c141ae0884f6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:48.532879 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8d7d678f-62b0-4b01-b73c-e02e4f92e75f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:48.533048 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f562f33e-24aa-4b16-8c2d-c141ae0884f6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:48.564601 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f562f33e-24aa-4b16-8c2d-c141ae0884f6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047047 Apr 05 11:59:48.565165 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 645/1308] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:48 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:48.565747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8d7d678f-62b0-4b01-b73c-e02e4f92e75f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048332 Apr 05 11:59:48.568898 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 664/1309] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:48 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:48.569652 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-72dc9824-839f-43da-91f8-65f00ea56e75 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:48.570601 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-72dc9824-839f-43da-91f8-65f00ea56e75 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:48.576516 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-72dc9824-839f-43da-91f8-65f00ea56e75 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:48.576963 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-72dc9824-839f-43da-91f8-65f00ea56e75 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:48.577846 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-72dc9824-839f-43da-91f8-65f00ea56e75 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:48.578282 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-72dc9824-839f-43da-91f8-65f00ea56e75 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:48.605939 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-72dc9824-839f-43da-91f8-65f00ea56e75 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039806 Apr 05 11:59:48.606477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 646/1310] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:48 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:49.581082 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-efa67380-ac89-4f23-99c8-8caca6dd90fd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:49.582097 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-84b12e01-2a05-4e8a-8b21-9484a1aef7c3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:49.582709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-84b12e01-2a05-4e8a-8b21-9484a1aef7c3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:49.582893 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-efa67380-ac89-4f23-99c8-8caca6dd90fd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:49.593191 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84b12e01-2a05-4e8a-8b21-9484a1aef7c3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:49.593490 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-efa67380-ac89-4f23-99c8-8caca6dd90fd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:49.594311 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84b12e01-2a05-4e8a-8b21-9484a1aef7c3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:49.594598 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-efa67380-ac89-4f23-99c8-8caca6dd90fd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:49.595358 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84b12e01-2a05-4e8a-8b21-9484a1aef7c3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:49.595505 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-efa67380-ac89-4f23-99c8-8caca6dd90fd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:49.595836 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84b12e01-2a05-4e8a-8b21-9484a1aef7c3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:49.595963 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-efa67380-ac89-4f23-99c8-8caca6dd90fd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:49.624499 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-84b12e01-2a05-4e8a-8b21-9484a1aef7c3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050142 Apr 05 11:59:49.625059 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 665/1311] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:49 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:49.625514 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-efa67380-ac89-4f23-99c8-8caca6dd90fd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050944 Apr 05 11:59:49.629506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 647/1312] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:49 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:49.629662 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cfca0433-1cda-48b4-90de-e8bea977fd6a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:49.630435 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cfca0433-1cda-48b4-90de-e8bea977fd6a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:49.636112 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cfca0433-1cda-48b4-90de-e8bea977fd6a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:49.636581 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cfca0433-1cda-48b4-90de-e8bea977fd6a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:49.637333 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cfca0433-1cda-48b4-90de-e8bea977fd6a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:49.637758 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cfca0433-1cda-48b4-90de-e8bea977fd6a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:49.664811 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cfca0433-1cda-48b4-90de-e8bea977fd6a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038802 Apr 05 11:59:49.665345 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 666/1313] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:49 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:50.640777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1beb852c-fb2e-4dc0-8931-e2103257c85d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:50.641611 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-84f791e7-fcc2-49d9-8ddc-6dcb6869b29a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:50.642190 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1beb852c-fb2e-4dc0-8931-e2103257c85d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:50.642446 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-84f791e7-fcc2-49d9-8ddc-6dcb6869b29a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:50.648585 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84f791e7-fcc2-49d9-8ddc-6dcb6869b29a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:50.648751 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1beb852c-fb2e-4dc0-8931-e2103257c85d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:50.649064 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84f791e7-fcc2-49d9-8ddc-6dcb6869b29a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:50.649219 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1beb852c-fb2e-4dc0-8931-e2103257c85d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:50.649833 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84f791e7-fcc2-49d9-8ddc-6dcb6869b29a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:50.649976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1beb852c-fb2e-4dc0-8931-e2103257c85d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:50.650266 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84f791e7-fcc2-49d9-8ddc-6dcb6869b29a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:50.650422 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1beb852c-fb2e-4dc0-8931-e2103257c85d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:50.679891 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-84f791e7-fcc2-49d9-8ddc-6dcb6869b29a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045188 Apr 05 11:59:50.680171 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1beb852c-fb2e-4dc0-8931-e2103257c85d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045938 Apr 05 11:59:50.683651 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 667/1315] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:50 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:50.683794 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 648/1315] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:50 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:50.685595 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b8978696-40e9-45fd-8572-ea6e3fac147c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:50.686511 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b8978696-40e9-45fd-8572-ea6e3fac147c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:50.692615 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b8978696-40e9-45fd-8572-ea6e3fac147c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:50.693063 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b8978696-40e9-45fd-8572-ea6e3fac147c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:50.693892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b8978696-40e9-45fd-8572-ea6e3fac147c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:50.694333 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b8978696-40e9-45fd-8572-ea6e3fac147c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:50.724848 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b8978696-40e9-45fd-8572-ea6e3fac147c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042946 Apr 05 11:59:50.725420 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 668/1316] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:50 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:51.693200 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ae84aa04-4b2f-47e1-b32a-05406e73eb6f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:51.693719 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fc9860a2-7d5a-4fbc-8bc8-dde9200186b6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:51.694098 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ae84aa04-4b2f-47e1-b32a-05406e73eb6f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:51.694202 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fc9860a2-7d5a-4fbc-8bc8-dde9200186b6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:51.700717 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae84aa04-4b2f-47e1-b32a-05406e73eb6f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:51.700906 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc9860a2-7d5a-4fbc-8bc8-dde9200186b6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:51.701159 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc9860a2-7d5a-4fbc-8bc8-dde9200186b6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:51.701302 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae84aa04-4b2f-47e1-b32a-05406e73eb6f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:51.701891 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae84aa04-4b2f-47e1-b32a-05406e73eb6f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:51.702046 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc9860a2-7d5a-4fbc-8bc8-dde9200186b6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:51.702327 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae84aa04-4b2f-47e1-b32a-05406e73eb6f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:51.702454 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc9860a2-7d5a-4fbc-8bc8-dde9200186b6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:51.732127 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fc9860a2-7d5a-4fbc-8bc8-dde9200186b6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043279 Apr 05 11:59:51.732700 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 669/1317] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:51 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:51.733023 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ae84aa04-4b2f-47e1-b32a-05406e73eb6f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044488 Apr 05 11:59:51.733752 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 649/1318] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:51 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:51.739567 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-673b8d2d-ef73-48eb-a798-52c9fa257fc8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:51.740516 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-673b8d2d-ef73-48eb-a798-52c9fa257fc8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:51.746646 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-673b8d2d-ef73-48eb-a798-52c9fa257fc8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:51.747084 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-673b8d2d-ef73-48eb-a798-52c9fa257fc8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:51.747842 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-673b8d2d-ef73-48eb-a798-52c9fa257fc8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:51.748304 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-673b8d2d-ef73-48eb-a798-52c9fa257fc8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:51.776302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-673b8d2d-ef73-48eb-a798-52c9fa257fc8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042520 Apr 05 11:59:51.777058 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 670/1319] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:51 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:52.743699 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-59f022de-aa64-4b47-8a70-f444fa428918 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:52.744665 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-59f022de-aa64-4b47-8a70-f444fa428918 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:52.744813 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b22b57f0-342c-4555-9c3b-05f3a740f859 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:52.745703 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b22b57f0-342c-4555-9c3b-05f3a740f859 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:52.751401 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-59f022de-aa64-4b47-8a70-f444fa428918 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:52.751933 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-59f022de-aa64-4b47-8a70-f444fa428918 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:52.752339 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b22b57f0-342c-4555-9c3b-05f3a740f859 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:52.752733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-59f022de-aa64-4b47-8a70-f444fa428918 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:52.752883 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b22b57f0-342c-4555-9c3b-05f3a740f859 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:52.753168 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-59f022de-aa64-4b47-8a70-f444fa428918 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:52.753599 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b22b57f0-342c-4555-9c3b-05f3a740f859 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:52.754036 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b22b57f0-342c-4555-9c3b-05f3a740f859 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:52.782037 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-59f022de-aa64-4b47-8a70-f444fa428918 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042246 Apr 05 11:59:52.782543 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 650/1320] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:52 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:52.783605 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b22b57f0-342c-4555-9c3b-05f3a740f859 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042734 Apr 05 11:59:52.784366 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 671/1321] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:52 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:52.787315 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-55d812bf-d874-43ef-b52f-b3040ba329dc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:52.788256 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-55d812bf-d874-43ef-b52f-b3040ba329dc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:52.794169 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-55d812bf-d874-43ef-b52f-b3040ba329dc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:52.794609 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-55d812bf-d874-43ef-b52f-b3040ba329dc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:52.795372 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-55d812bf-d874-43ef-b52f-b3040ba329dc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:52.795798 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-55d812bf-d874-43ef-b52f-b3040ba329dc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:52.824375 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-55d812bf-d874-43ef-b52f-b3040ba329dc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040634 Apr 05 11:59:52.824871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 651/1322] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:52 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:53.798177 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0cb63869-0927-4c71-b7fe-47bcc003f070 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:53.799278 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ffa8898a-1b15-4862-8fe0-96a0c0273c2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:53.799663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0cb63869-0927-4c71-b7fe-47bcc003f070 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:53.800352 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ffa8898a-1b15-4862-8fe0-96a0c0273c2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:53.806115 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0cb63869-0927-4c71-b7fe-47bcc003f070 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:53.806557 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0cb63869-0927-4c71-b7fe-47bcc003f070 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:53.806844 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ffa8898a-1b15-4862-8fe0-96a0c0273c2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:53.807318 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0cb63869-0927-4c71-b7fe-47bcc003f070 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:53.807422 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ffa8898a-1b15-4862-8fe0-96a0c0273c2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:53.808058 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0cb63869-0927-4c71-b7fe-47bcc003f070 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:53.808226 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ffa8898a-1b15-4862-8fe0-96a0c0273c2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:53.808675 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ffa8898a-1b15-4862-8fe0-96a0c0273c2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:53.836848 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0cb63869-0927-4c71-b7fe-47bcc003f070 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046172 Apr 05 11:59:53.837406 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ffa8898a-1b15-4862-8fe0-96a0c0273c2e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044802 Apr 05 11:59:53.837566 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 672/1323] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:53 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:53.841160 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 652/1324] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:53 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:53.842045 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a03e7cb5-afb6-4291-a19a-d51b49523575 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:53.842935 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a03e7cb5-afb6-4291-a19a-d51b49523575 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:53.849306 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a03e7cb5-afb6-4291-a19a-d51b49523575 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:53.849757 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a03e7cb5-afb6-4291-a19a-d51b49523575 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:53.850511 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a03e7cb5-afb6-4291-a19a-d51b49523575 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:53.850942 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a03e7cb5-afb6-4291-a19a-d51b49523575 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:53.879159 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a03e7cb5-afb6-4291-a19a-d51b49523575 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040671 Apr 05 11:59:53.879722 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 673/1325] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:53 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:54.853567 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2e4197f2-eec4-45f0-872a-b612ef8de5a0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:54.854698 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e09f666c-20e4-4ae3-8aa6-186a0ccacfa2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:54.855284 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e09f666c-20e4-4ae3-8aa6-186a0ccacfa2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:54.855429 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2e4197f2-eec4-45f0-872a-b612ef8de5a0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:54.865917 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e09f666c-20e4-4ae3-8aa6-186a0ccacfa2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:54.866280 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2e4197f2-eec4-45f0-872a-b612ef8de5a0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:54.866777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2e4197f2-eec4-45f0-872a-b612ef8de5a0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:54.867016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e09f666c-20e4-4ae3-8aa6-186a0ccacfa2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:54.868049 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2e4197f2-eec4-45f0-872a-b612ef8de5a0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:54.868324 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e09f666c-20e4-4ae3-8aa6-186a0ccacfa2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:54.868761 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2e4197f2-eec4-45f0-872a-b612ef8de5a0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:54.868944 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e09f666c-20e4-4ae3-8aa6-186a0ccacfa2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:54.901860 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2e4197f2-eec4-45f0-872a-b612ef8de5a0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054967 Apr 05 11:59:54.902125 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e09f666c-20e4-4ae3-8aa6-186a0ccacfa2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055105 Apr 05 11:59:54.902419 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 674/1326] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:54 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:54.902575 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 653/1327] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:54 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:54.907191 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-18bee147-c935-4240-b56e-c2bcef134ac0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:54.908094 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-18bee147-c935-4240-b56e-c2bcef134ac0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:54.913708 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-18bee147-c935-4240-b56e-c2bcef134ac0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:54.914146 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-18bee147-c935-4240-b56e-c2bcef134ac0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:54.914915 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-18bee147-c935-4240-b56e-c2bcef134ac0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:54.915339 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-18bee147-c935-4240-b56e-c2bcef134ac0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:54.943772 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-18bee147-c935-4240-b56e-c2bcef134ac0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040052 Apr 05 11:59:54.944372 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 675/1328] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:54 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:55.917933 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b3cb60f2-82b3-4bea-a7ce-c90afb60079d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:55.918976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5997ff1a-5d80-44b6-be89-00b43c6973bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:55.919578 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b3cb60f2-82b3-4bea-a7ce-c90afb60079d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:55.919730 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5997ff1a-5d80-44b6-be89-00b43c6973bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:55.927922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b3cb60f2-82b3-4bea-a7ce-c90afb60079d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:55.928199 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5997ff1a-5d80-44b6-be89-00b43c6973bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:55.928394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b3cb60f2-82b3-4bea-a7ce-c90afb60079d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:55.928564 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5997ff1a-5d80-44b6-be89-00b43c6973bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:55.929154 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b3cb60f2-82b3-4bea-a7ce-c90afb60079d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:55.929297 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5997ff1a-5d80-44b6-be89-00b43c6973bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:55.929580 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b3cb60f2-82b3-4bea-a7ce-c90afb60079d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:55.929860 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5997ff1a-5d80-44b6-be89-00b43c6973bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:55.958674 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5997ff1a-5d80-44b6-be89-00b43c6973bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047458 Apr 05 11:59:55.958894 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b3cb60f2-82b3-4bea-a7ce-c90afb60079d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047617 Apr 05 11:59:55.963337 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 676/1329] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:55 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:55.963478 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 654/1330] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:55 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:55.963915 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0e24722c-43f5-4213-b1f2-5cef2b3228d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:55.964865 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0e24722c-43f5-4213-b1f2-5cef2b3228d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:55.971183 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0e24722c-43f5-4213-b1f2-5cef2b3228d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:55.971624 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0e24722c-43f5-4213-b1f2-5cef2b3228d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:55.972408 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0e24722c-43f5-4213-b1f2-5cef2b3228d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:55.972832 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0e24722c-43f5-4213-b1f2-5cef2b3228d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:56.000930 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0e24722c-43f5-4213-b1f2-5cef2b3228d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040620 Apr 05 11:59:56.001475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 677/1331] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:55 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:56.973823 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-777f8915-227f-49bb-a468-b10c4fd2a652 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:56.974775 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-777f8915-227f-49bb-a468-b10c4fd2a652 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:56.977425 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-224d68bc-d3dc-4756-8f9f-b23a8d600d85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:56.978523 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-224d68bc-d3dc-4756-8f9f-b23a8d600d85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:56.981649 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-777f8915-227f-49bb-a468-b10c4fd2a652 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:56.982096 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-777f8915-227f-49bb-a468-b10c4fd2a652 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:56.982846 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-777f8915-227f-49bb-a468-b10c4fd2a652 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:56.983275 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-777f8915-227f-49bb-a468-b10c4fd2a652 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:56.985157 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-224d68bc-d3dc-4756-8f9f-b23a8d600d85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:56.985596 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-224d68bc-d3dc-4756-8f9f-b23a8d600d85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:56.986354 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-224d68bc-d3dc-4756-8f9f-b23a8d600d85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:56.986782 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-224d68bc-d3dc-4756-8f9f-b23a8d600d85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:57.012595 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-777f8915-227f-49bb-a468-b10c4fd2a652 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044908 Apr 05 11:59:57.013155 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 655/1332] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:56 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:57.017786 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-63ab095c-4d74-4d03-bb34-9507748ca953 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:57.018690 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-63ab095c-4d74-4d03-bb34-9507748ca953 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:57.023469 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-224d68bc-d3dc-4756-8f9f-b23a8d600d85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050933 Apr 05 11:59:57.024343 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 678/1333] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:56 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 11:59:57.024469 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63ab095c-4d74-4d03-bb34-9507748ca953 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:57.024787 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63ab095c-4d74-4d03-bb34-9507748ca953 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:57.025548 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63ab095c-4d74-4d03-bb34-9507748ca953 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:57.025982 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63ab095c-4d74-4d03-bb34-9507748ca953 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:57.054169 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-63ab095c-4d74-4d03-bb34-9507748ca953 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040008 Apr 05 11:59:57.054712 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 656/1334] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:57 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:58.026873 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7896d031-2b11-4831-b155-46dd77a7a2ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:58.028002 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7896d031-2b11-4831-b155-46dd77a7a2ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:58.034821 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7896d031-2b11-4831-b155-46dd77a7a2ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:58.035199 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-eaa0ed85-7aea-41fd-813d-6d478b1f119b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:58.035658 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7896d031-2b11-4831-b155-46dd77a7a2ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:58.036036 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7896d031-2b11-4831-b155-46dd77a7a2ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:58.036215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-eaa0ed85-7aea-41fd-813d-6d478b1f119b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:58.036493 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7896d031-2b11-4831-b155-46dd77a7a2ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:58.042531 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eaa0ed85-7aea-41fd-813d-6d478b1f119b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:58.042971 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eaa0ed85-7aea-41fd-813d-6d478b1f119b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:58.043728 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eaa0ed85-7aea-41fd-813d-6d478b1f119b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:58.044166 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eaa0ed85-7aea-41fd-813d-6d478b1f119b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:58.065671 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7896d031-2b11-4831-b155-46dd77a7a2ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044987 Apr 05 11:59:58.066392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 679/1335] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:58 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:58.070739 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-004923e9-dc72-404a-929f-26394446c28c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:58.071657 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-004923e9-dc72-404a-929f-26394446c28c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:58.072969 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-eaa0ed85-7aea-41fd-813d-6d478b1f119b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041821 Apr 05 11:59:58.073540 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 657/1336] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:58 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:58.077268 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-004923e9-dc72-404a-929f-26394446c28c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:58.077705 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-004923e9-dc72-404a-929f-26394446c28c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:58.078455 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-004923e9-dc72-404a-929f-26394446c28c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:58.078880 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-004923e9-dc72-404a-929f-26394446c28c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:58.107621 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-004923e9-dc72-404a-929f-26394446c28c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040413 Apr 05 11:59:58.108156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 680/1337] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:58 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:59.077732 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3c4c1d35-34e7-404b-8fd9-5b43387ac68d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:59.078652 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3c4c1d35-34e7-404b-8fd9-5b43387ac68d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:59.084805 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f1264cca-0b16-49a2-ab59-b7971a064add tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:59.085498 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3c4c1d35-34e7-404b-8fd9-5b43387ac68d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:59.085765 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f1264cca-0b16-49a2-ab59-b7971a064add tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:59.085925 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3c4c1d35-34e7-404b-8fd9-5b43387ac68d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:59.086697 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3c4c1d35-34e7-404b-8fd9-5b43387ac68d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:59.087131 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3c4c1d35-34e7-404b-8fd9-5b43387ac68d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:59.092284 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f1264cca-0b16-49a2-ab59-b7971a064add tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:59.092723 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f1264cca-0b16-49a2-ab59-b7971a064add tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:59.093500 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f1264cca-0b16-49a2-ab59-b7971a064add tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:59.093925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f1264cca-0b16-49a2-ab59-b7971a064add tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:59.115867 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3c4c1d35-34e7-404b-8fd9-5b43387ac68d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042145 Apr 05 11:59:59.116462 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 658/1338] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:59 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:59.120954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-889193a7-518b-48ae-842f-1c99cc3fb179 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:59:59.121864 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-889193a7-518b-48ae-842f-1c99cc3fb179 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:59:59.123317 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f1264cca-0b16-49a2-ab59-b7971a064add tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042292 Apr 05 11:59:59.123869 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 681/1339] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 11:59:59 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:59.127486 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-889193a7-518b-48ae-842f-1c99cc3fb179 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:59.127943 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-889193a7-518b-48ae-842f-1c99cc3fb179 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:59.128747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-889193a7-518b-48ae-842f-1c99cc3fb179 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:59:59.129251 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-889193a7-518b-48ae-842f-1c99cc3fb179 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:59:59.157261 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-889193a7-518b-48ae-842f-1c99cc3fb179 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039814 Apr 05 11:59:59.157784 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 659/1340] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 11:59:59 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:00.132043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-653e8ce9-5325-44b2-a352-4827a3f570d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:00.132986 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-653e8ce9-5325-44b2-a352-4827a3f570d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:00.136117 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-022850f0-6c6d-49f4-9c43-f214473922c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:00.137192 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-022850f0-6c6d-49f4-9c43-f214473922c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:00.140406 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-653e8ce9-5325-44b2-a352-4827a3f570d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:00.140900 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-653e8ce9-5325-44b2-a352-4827a3f570d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:00.141739 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-653e8ce9-5325-44b2-a352-4827a3f570d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:00.142217 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-653e8ce9-5325-44b2-a352-4827a3f570d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:00.144247 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-022850f0-6c6d-49f4-9c43-f214473922c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:00.144749 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-022850f0-6c6d-49f4-9c43-f214473922c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:00.145590 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-022850f0-6c6d-49f4-9c43-f214473922c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:00.146072 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-022850f0-6c6d-49f4-9c43-f214473922c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:00.173235 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-653e8ce9-5325-44b2-a352-4827a3f570d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047610 Apr 05 12:00:00.173799 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 682/1341] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:00 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:00.176936 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-022850f0-6c6d-49f4-9c43-f214473922c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045110 Apr 05 12:00:00.177501 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 660/1342] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:00 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:00.178286 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-270980ef-6483-4204-93b2-f5a0daa3f286 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:00.179224 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-270980ef-6483-4204-93b2-f5a0daa3f286 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:00.184872 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-270980ef-6483-4204-93b2-f5a0daa3f286 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:00.185309 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-270980ef-6483-4204-93b2-f5a0daa3f286 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:00.186053 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-270980ef-6483-4204-93b2-f5a0daa3f286 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:00.186473 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-270980ef-6483-4204-93b2-f5a0daa3f286 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:00.213785 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-270980ef-6483-4204-93b2-f5a0daa3f286 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039040 Apr 05 12:00:00.214323 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 683/1343] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:00 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:01.189925 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-310bf17e-50be-4ed1-a777-0c34d92be058 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:01.191315 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-310bf17e-50be-4ed1-a777-0c34d92be058 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:01.192559 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4cc92c8e-9920-4490-aa28-02b2a935c3f1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:01.194184 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4cc92c8e-9920-4490-aa28-02b2a935c3f1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:01.202117 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-310bf17e-50be-4ed1-a777-0c34d92be058 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:01.202855 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-310bf17e-50be-4ed1-a777-0c34d92be058 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:01.204244 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-310bf17e-50be-4ed1-a777-0c34d92be058 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:01.204695 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cc92c8e-9920-4490-aa28-02b2a935c3f1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:01.204942 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-310bf17e-50be-4ed1-a777-0c34d92be058 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:01.205443 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cc92c8e-9920-4490-aa28-02b2a935c3f1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:01.206692 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cc92c8e-9920-4490-aa28-02b2a935c3f1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:01.207416 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cc92c8e-9920-4490-aa28-02b2a935c3f1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:01.237291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4cc92c8e-9920-4490-aa28-02b2a935c3f1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051286 Apr 05 12:00:01.237724 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-310bf17e-50be-4ed1-a777-0c34d92be058 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054955 Apr 05 12:00:01.237889 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 684/1344] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:01 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:01.241679 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 661/1345] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:01 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:01.245072 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a4b382df-3f40-4f33-a38a-d346587c5c65 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:01.245973 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a4b382df-3f40-4f33-a38a-d346587c5c65 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:01.251793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a4b382df-3f40-4f33-a38a-d346587c5c65 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:01.252301 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a4b382df-3f40-4f33-a38a-d346587c5c65 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:01.253053 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a4b382df-3f40-4f33-a38a-d346587c5c65 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:01.253482 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a4b382df-3f40-4f33-a38a-d346587c5c65 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:01.280952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a4b382df-3f40-4f33-a38a-d346587c5c65 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042087 Apr 05 12:00:01.281490 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 685/1346] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:01 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:02.253218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a6ba8db7-a677-4ede-88c5-3e2b99086469 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:02.254124 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3ab39c23-2226-4337-b653-395ab8736f4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:02.254752 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a6ba8db7-a677-4ede-88c5-3e2b99086469 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:02.254923 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3ab39c23-2226-4337-b653-395ab8736f4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:02.261994 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3ab39c23-2226-4337-b653-395ab8736f4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:02.262183 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a6ba8db7-a677-4ede-88c5-3e2b99086469 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:02.262417 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3ab39c23-2226-4337-b653-395ab8736f4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:02.262547 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a6ba8db7-a677-4ede-88c5-3e2b99086469 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:02.263279 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a6ba8db7-a677-4ede-88c5-3e2b99086469 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:02.263426 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3ab39c23-2226-4337-b653-395ab8736f4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:02.263706 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3ab39c23-2226-4337-b653-395ab8736f4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:02.263868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a6ba8db7-a677-4ede-88c5-3e2b99086469 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:02.292912 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3ab39c23-2226-4337-b653-395ab8736f4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046213 Apr 05 12:00:02.293136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a6ba8db7-a677-4ede-88c5-3e2b99086469 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046345 Apr 05 12:00:02.293480 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 686/1347] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:02 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:02.293861 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 662/1348] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:02 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:02.297982 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4a8faad9-b5fe-453c-a1cc-b46213f88e26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:02.298855 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4a8faad9-b5fe-453c-a1cc-b46213f88e26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:02.304414 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a8faad9-b5fe-453c-a1cc-b46213f88e26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:02.304856 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a8faad9-b5fe-453c-a1cc-b46213f88e26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:02.305611 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a8faad9-b5fe-453c-a1cc-b46213f88e26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:02.306032 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a8faad9-b5fe-453c-a1cc-b46213f88e26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:02.333655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4a8faad9-b5fe-453c-a1cc-b46213f88e26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039234 Apr 05 12:00:02.334181 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 687/1349] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:02 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:03.308997 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cccb1978-d608-4453-b762-9a2dc4515235 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:03.310477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cccb1978-d608-4453-b762-9a2dc4515235 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:03.312159 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a1f1f72d-d7c6-4484-a87d-d94eeb43b592 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:03.313673 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a1f1f72d-d7c6-4484-a87d-d94eeb43b592 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:03.321105 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cccb1978-d608-4453-b762-9a2dc4515235 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:03.321849 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cccb1978-d608-4453-b762-9a2dc4515235 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:03.323093 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cccb1978-d608-4453-b762-9a2dc4515235 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:03.323809 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cccb1978-d608-4453-b762-9a2dc4515235 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:03.324033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a1f1f72d-d7c6-4484-a87d-d94eeb43b592 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:03.324815 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a1f1f72d-d7c6-4484-a87d-d94eeb43b592 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:03.326018 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a1f1f72d-d7c6-4484-a87d-d94eeb43b592 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:03.326781 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a1f1f72d-d7c6-4484-a87d-d94eeb43b592 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:03.357543 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cccb1978-d608-4453-b762-9a2dc4515235 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055326 Apr 05 12:00:03.358069 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 663/1350] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:03 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:03.358382 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a1f1f72d-d7c6-4484-a87d-d94eeb43b592 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052732 Apr 05 12:00:03.361981 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 688/1351] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:03 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:03.365550 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-20cb7ca5-dd0b-4f9e-8c63-b2347f756c30 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:03.366551 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-20cb7ca5-dd0b-4f9e-8c63-b2347f756c30 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:03.372467 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-20cb7ca5-dd0b-4f9e-8c63-b2347f756c30 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:03.372907 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-20cb7ca5-dd0b-4f9e-8c63-b2347f756c30 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:03.373658 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-20cb7ca5-dd0b-4f9e-8c63-b2347f756c30 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:03.374089 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-20cb7ca5-dd0b-4f9e-8c63-b2347f756c30 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:03.401746 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-20cb7ca5-dd0b-4f9e-8c63-b2347f756c30 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042694 Apr 05 12:00:03.402258 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 664/1352] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:03 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:04.373758 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1c28ca7f-85b1-4d72-b228-bdbbc22b58fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:04.374640 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b3ef7b24-1ec8-49d2-9d08-1464ec062f1f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:04.375256 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b3ef7b24-1ec8-49d2-9d08-1464ec062f1f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:04.375427 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1c28ca7f-85b1-4d72-b228-bdbbc22b58fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:04.384315 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1c28ca7f-85b1-4d72-b228-bdbbc22b58fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:04.384464 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b3ef7b24-1ec8-49d2-9d08-1464ec062f1f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:04.384752 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b3ef7b24-1ec8-49d2-9d08-1464ec062f1f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:04.384908 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1c28ca7f-85b1-4d72-b228-bdbbc22b58fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:04.385512 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1c28ca7f-85b1-4d72-b228-bdbbc22b58fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:04.385654 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b3ef7b24-1ec8-49d2-9d08-1464ec062f1f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:04.385910 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b3ef7b24-1ec8-49d2-9d08-1464ec062f1f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:04.386058 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1c28ca7f-85b1-4d72-b228-bdbbc22b58fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:04.415341 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b3ef7b24-1ec8-49d2-9d08-1464ec062f1f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048282 Apr 05 12:00:04.415574 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1c28ca7f-85b1-4d72-b228-bdbbc22b58fb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048602 Apr 05 12:00:04.415948 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 665/1353] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:04 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:04.416113 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 689/1354] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:04 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:04.420495 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-106c45a6-dff5-4884-921d-fd9d1fc2823c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:04.421412 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-106c45a6-dff5-4884-921d-fd9d1fc2823c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:04.427144 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-106c45a6-dff5-4884-921d-fd9d1fc2823c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:04.427579 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-106c45a6-dff5-4884-921d-fd9d1fc2823c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:04.428354 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-106c45a6-dff5-4884-921d-fd9d1fc2823c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:04.428790 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-106c45a6-dff5-4884-921d-fd9d1fc2823c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:04.456206 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-106c45a6-dff5-4884-921d-fd9d1fc2823c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039203 Apr 05 12:00:04.456751 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 666/1355] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:04 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:05.431389 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cfd021d1-077d-44e0-9433-508786c3cdaa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:05.432300 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8255f36d-31d2-4535-a3a9-2fecf5394e8d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:05.432949 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cfd021d1-077d-44e0-9433-508786c3cdaa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:05.433116 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8255f36d-31d2-4535-a3a9-2fecf5394e8d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:05.442952 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8255f36d-31d2-4535-a3a9-2fecf5394e8d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:05.443266 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cfd021d1-077d-44e0-9433-508786c3cdaa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:05.443658 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8255f36d-31d2-4535-a3a9-2fecf5394e8d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:05.443858 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cfd021d1-077d-44e0-9433-508786c3cdaa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:05.444826 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8255f36d-31d2-4535-a3a9-2fecf5394e8d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:05.444982 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cfd021d1-077d-44e0-9433-508786c3cdaa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:05.445226 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8255f36d-31d2-4535-a3a9-2fecf5394e8d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:05.445335 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cfd021d1-077d-44e0-9433-508786c3cdaa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:05.474763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cfd021d1-077d-44e0-9433-508786c3cdaa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050316 Apr 05 12:00:05.475333 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 690/1356] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:05 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:05.475490 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8255f36d-31d2-4535-a3a9-2fecf5394e8d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050874 Apr 05 12:00:05.479179 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 667/1357] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:05 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:05.479950 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8223625a-ca5a-472c-ab34-ffacc4af3c05 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:05.480881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8223625a-ca5a-472c-ab34-ffacc4af3c05 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:05.486925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8223625a-ca5a-472c-ab34-ffacc4af3c05 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:05.487380 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8223625a-ca5a-472c-ab34-ffacc4af3c05 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:05.488183 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8223625a-ca5a-472c-ab34-ffacc4af3c05 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:05.488625 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8223625a-ca5a-472c-ab34-ffacc4af3c05 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:05.516700 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8223625a-ca5a-472c-ab34-ffacc4af3c05 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040250 Apr 05 12:00:05.517262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 691/1358] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:05 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:06.488399 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2b87e56e-7aee-434b-a5b5-718b26cea175 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:06.489237 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2874604b-53b9-4e0d-aa1d-673758fc9836 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:06.489687 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2b87e56e-7aee-434b-a5b5-718b26cea175 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:06.489802 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2874604b-53b9-4e0d-aa1d-673758fc9836 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:06.496238 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2874604b-53b9-4e0d-aa1d-673758fc9836 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:06.496578 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2b87e56e-7aee-434b-a5b5-718b26cea175 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:06.496738 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2874604b-53b9-4e0d-aa1d-673758fc9836 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:06.497023 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2b87e56e-7aee-434b-a5b5-718b26cea175 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:06.497450 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2874604b-53b9-4e0d-aa1d-673758fc9836 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:06.497790 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2b87e56e-7aee-434b-a5b5-718b26cea175 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:06.497951 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2874604b-53b9-4e0d-aa1d-673758fc9836 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:06.498214 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2b87e56e-7aee-434b-a5b5-718b26cea175 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:06.527330 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2874604b-53b9-4e0d-aa1d-673758fc9836 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043879 Apr 05 12:00:06.527592 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2b87e56e-7aee-434b-a5b5-718b26cea175 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044117 Apr 05 12:00:06.527874 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 668/1359] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:06 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:06.531319 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 692/1360] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:06 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:06.532737 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8dd00848-f51f-4835-93f8-b1b4d3c5e174 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:06.533690 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8dd00848-f51f-4835-93f8-b1b4d3c5e174 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:06.539448 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8dd00848-f51f-4835-93f8-b1b4d3c5e174 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:06.539897 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8dd00848-f51f-4835-93f8-b1b4d3c5e174 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:06.540692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8dd00848-f51f-4835-93f8-b1b4d3c5e174 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:06.541140 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8dd00848-f51f-4835-93f8-b1b4d3c5e174 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:06.569424 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8dd00848-f51f-4835-93f8-b1b4d3c5e174 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040399 Apr 05 12:00:06.569969 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 669/1361] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:06 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:07.540194 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b67f5728-9e03-4023-a26a-87edd07d5e06 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:07.540766 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ae7bc2db-063f-45a0-bf16-fc677248c4f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:07.541156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b67f5728-9e03-4023-a26a-87edd07d5e06 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:07.541382 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ae7bc2db-063f-45a0-bf16-fc677248c4f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:07.547738 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b67f5728-9e03-4023-a26a-87edd07d5e06 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:07.547941 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae7bc2db-063f-45a0-bf16-fc677248c4f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:07.548222 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b67f5728-9e03-4023-a26a-87edd07d5e06 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:07.548478 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae7bc2db-063f-45a0-bf16-fc677248c4f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:07.548987 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b67f5728-9e03-4023-a26a-87edd07d5e06 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:07.549245 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae7bc2db-063f-45a0-bf16-fc677248c4f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:07.549388 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b67f5728-9e03-4023-a26a-87edd07d5e06 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:07.549685 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae7bc2db-063f-45a0-bf16-fc677248c4f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:07.579011 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b67f5728-9e03-4023-a26a-87edd07d5e06 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042822 Apr 05 12:00:07.579264 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ae7bc2db-063f-45a0-bf16-fc677248c4f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042622 Apr 05 12:00:07.579747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 693/1363] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:07 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:07.579895 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 670/1363] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:07 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:07.584261 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5d1f6529-f97b-4617-a124-702c89c265ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:07.585196 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5d1f6529-f97b-4617-a124-702c89c265ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:07.591338 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d1f6529-f97b-4617-a124-702c89c265ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:07.591797 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d1f6529-f97b-4617-a124-702c89c265ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:07.592596 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d1f6529-f97b-4617-a124-702c89c265ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:07.593010 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d1f6529-f97b-4617-a124-702c89c265ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:07.622292 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5d1f6529-f97b-4617-a124-702c89c265ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041729 Apr 05 12:00:07.622848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 671/1364] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:07 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:08.592902 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-56198cfe-7929-4dbb-b996-853cb4ba5ef3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:08.594027 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-56198cfe-7929-4dbb-b996-853cb4ba5ef3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:08.594329 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3e1d1bfc-a9b9-4f56-927e-30fa4121b2af tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:08.595370 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3e1d1bfc-a9b9-4f56-927e-30fa4121b2af tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:08.601423 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-56198cfe-7929-4dbb-b996-853cb4ba5ef3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:08.601901 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-56198cfe-7929-4dbb-b996-853cb4ba5ef3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:08.602747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-56198cfe-7929-4dbb-b996-853cb4ba5ef3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:08.603212 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e1d1bfc-a9b9-4f56-927e-30fa4121b2af tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:08.603333 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-56198cfe-7929-4dbb-b996-853cb4ba5ef3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:08.603707 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e1d1bfc-a9b9-4f56-927e-30fa4121b2af tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:08.604584 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e1d1bfc-a9b9-4f56-927e-30fa4121b2af tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:08.605058 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e1d1bfc-a9b9-4f56-927e-30fa4121b2af tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:08.635789 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3e1d1bfc-a9b9-4f56-927e-30fa4121b2af tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045730 Apr 05 12:00:08.636008 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-56198cfe-7929-4dbb-b996-853cb4ba5ef3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047530 Apr 05 12:00:08.636583 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 672/1366] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:08 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:08.636716 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 694/1366] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:08 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:08.641043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-44d869c2-5f28-445a-856a-0cf5e6414812 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:08.641977 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-44d869c2-5f28-445a-856a-0cf5e6414812 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:08.650193 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-44d869c2-5f28-445a-856a-0cf5e6414812 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:08.650641 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-44d869c2-5f28-445a-856a-0cf5e6414812 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:08.651399 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-44d869c2-5f28-445a-856a-0cf5e6414812 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:08.651837 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-44d869c2-5f28-445a-856a-0cf5e6414812 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:08.679494 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-44d869c2-5f28-445a-856a-0cf5e6414812 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042056 Apr 05 12:00:08.680090 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 695/1367] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:08 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:09.652976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1d188a7c-51b7-4d31-98d5-26ac34b8577e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:09.654316 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1d188a7c-51b7-4d31-98d5-26ac34b8577e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:09.654830 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7f2083fc-0363-4bf0-8dbe-e07049da3c98 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:09.656365 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7f2083fc-0363-4bf0-8dbe-e07049da3c98 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:09.665252 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1d188a7c-51b7-4d31-98d5-26ac34b8577e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:09.665806 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1d188a7c-51b7-4d31-98d5-26ac34b8577e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:09.665955 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7f2083fc-0363-4bf0-8dbe-e07049da3c98 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:09.666339 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7f2083fc-0363-4bf0-8dbe-e07049da3c98 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:09.666592 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1d188a7c-51b7-4d31-98d5-26ac34b8577e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:09.667012 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1d188a7c-51b7-4d31-98d5-26ac34b8577e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:09.667168 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7f2083fc-0363-4bf0-8dbe-e07049da3c98 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:09.667520 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7f2083fc-0363-4bf0-8dbe-e07049da3c98 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:09.696394 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1d188a7c-51b7-4d31-98d5-26ac34b8577e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050228 Apr 05 12:00:09.696968 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 673/1368] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:09 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:09.697718 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7f2083fc-0363-4bf0-8dbe-e07049da3c98 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049546 Apr 05 12:00:09.698550 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 696/1369] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:09 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:09.701480 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a3ef76cb-0c01-4187-8e80-d9ea77926e37 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:09.702396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a3ef76cb-0c01-4187-8e80-d9ea77926e37 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:09.708554 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a3ef76cb-0c01-4187-8e80-d9ea77926e37 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:09.709006 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a3ef76cb-0c01-4187-8e80-d9ea77926e37 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:09.709781 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a3ef76cb-0c01-4187-8e80-d9ea77926e37 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:09.710218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a3ef76cb-0c01-4187-8e80-d9ea77926e37 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:09.738472 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a3ef76cb-0c01-4187-8e80-d9ea77926e37 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040534 Apr 05 12:00:09.739021 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 674/1370] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:09 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:10.712608 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c8974d79-e323-46c8-a2ae-ee73d2a1c65a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:10.713271 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-481a2267-6c48-4ed0-9cf8-dc7f63d3af88 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:10.713684 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c8974d79-e323-46c8-a2ae-ee73d2a1c65a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:10.714215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-481a2267-6c48-4ed0-9cf8-dc7f63d3af88 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:10.720220 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c8974d79-e323-46c8-a2ae-ee73d2a1c65a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:10.720743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c8974d79-e323-46c8-a2ae-ee73d2a1c65a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:10.720892 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-481a2267-6c48-4ed0-9cf8-dc7f63d3af88 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:10.721224 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-481a2267-6c48-4ed0-9cf8-dc7f63d3af88 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:10.721498 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c8974d79-e323-46c8-a2ae-ee73d2a1c65a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:10.721922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c8974d79-e323-46c8-a2ae-ee73d2a1c65a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:10.722034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-481a2267-6c48-4ed0-9cf8-dc7f63d3af88 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:10.722409 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-481a2267-6c48-4ed0-9cf8-dc7f63d3af88 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:10.751647 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-481a2267-6c48-4ed0-9cf8-dc7f63d3af88 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044454 Apr 05 12:00:10.751865 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c8974d79-e323-46c8-a2ae-ee73d2a1c65a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045800 Apr 05 12:00:10.752272 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 675/1371] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:10 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:10.752566 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 697/1372] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:10 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:10.759352 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cfb0aae1-d04c-4e7a-987e-a36ff6901207 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:10.760315 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cfb0aae1-d04c-4e7a-987e-a36ff6901207 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:10.766105 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cfb0aae1-d04c-4e7a-987e-a36ff6901207 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:10.766549 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cfb0aae1-d04c-4e7a-987e-a36ff6901207 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:10.767298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cfb0aae1-d04c-4e7a-987e-a36ff6901207 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:10.767726 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cfb0aae1-d04c-4e7a-987e-a36ff6901207 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:10.795853 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cfb0aae1-d04c-4e7a-987e-a36ff6901207 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040413 Apr 05 12:00:10.796435 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 676/1373] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:10 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:11.766643 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e369c3ab-2376-4557-a4d3-a5d96d8e8181 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:11.767553 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fe5a32b2-c32c-4f62-a8cd-2addea53f371 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:11.768179 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e369c3ab-2376-4557-a4d3-a5d96d8e8181 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:11.768695 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fe5a32b2-c32c-4f62-a8cd-2addea53f371 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:11.777278 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e369c3ab-2376-4557-a4d3-a5d96d8e8181 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:11.777685 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe5a32b2-c32c-4f62-a8cd-2addea53f371 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:11.777845 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e369c3ab-2376-4557-a4d3-a5d96d8e8181 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:11.778136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe5a32b2-c32c-4f62-a8cd-2addea53f371 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:11.778459 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e369c3ab-2376-4557-a4d3-a5d96d8e8181 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:11.778881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e369c3ab-2376-4557-a4d3-a5d96d8e8181 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:11.779036 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe5a32b2-c32c-4f62-a8cd-2addea53f371 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:11.779323 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe5a32b2-c32c-4f62-a8cd-2addea53f371 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:11.807814 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fe5a32b2-c32c-4f62-a8cd-2addea53f371 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047062 Apr 05 12:00:11.808042 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e369c3ab-2376-4557-a4d3-a5d96d8e8181 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048150 Apr 05 12:00:11.808396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 677/1374] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:11 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:11.811909 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 698/1375] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:11 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:11.815393 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-50c9ea49-607b-4426-a032-1eeedf1e1e48 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:11.816339 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-50c9ea49-607b-4426-a032-1eeedf1e1e48 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:11.822304 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-50c9ea49-607b-4426-a032-1eeedf1e1e48 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:11.822748 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-50c9ea49-607b-4426-a032-1eeedf1e1e48 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:11.823479 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-50c9ea49-607b-4426-a032-1eeedf1e1e48 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:11.823906 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-50c9ea49-607b-4426-a032-1eeedf1e1e48 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:11.851972 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-50c9ea49-607b-4426-a032-1eeedf1e1e48 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042628 Apr 05 12:00:11.852556 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 678/1376] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:11 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:12.819122 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b709f11d-f4ea-4832-b3a2-896a0cc28617 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:12.819758 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-df628bfb-f026-49e7-acbe-fa3b80325092 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:12.820183 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b709f11d-f4ea-4832-b3a2-896a0cc28617 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:12.820269 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-df628bfb-f026-49e7-acbe-fa3b80325092 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:12.826764 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b709f11d-f4ea-4832-b3a2-896a0cc28617 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:12.826919 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-df628bfb-f026-49e7-acbe-fa3b80325092 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:12.827211 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b709f11d-f4ea-4832-b3a2-896a0cc28617 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:12.827355 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-df628bfb-f026-49e7-acbe-fa3b80325092 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:12.827977 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b709f11d-f4ea-4832-b3a2-896a0cc28617 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:12.828142 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-df628bfb-f026-49e7-acbe-fa3b80325092 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:12.828441 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b709f11d-f4ea-4832-b3a2-896a0cc28617 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:12.828604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-df628bfb-f026-49e7-acbe-fa3b80325092 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:12.857835 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-df628bfb-f026-49e7-acbe-fa3b80325092 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042533 Apr 05 12:00:12.858457 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 679/1377] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:12 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:12.859722 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b709f11d-f4ea-4832-b3a2-896a0cc28617 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044491 Apr 05 12:00:12.863233 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 699/1378] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:12 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:12.863385 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4e83a9b4-3881-48b4-988b-b4c17203fa53 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:12.864345 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4e83a9b4-3881-48b4-988b-b4c17203fa53 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:12.871179 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4e83a9b4-3881-48b4-988b-b4c17203fa53 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:12.871611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4e83a9b4-3881-48b4-988b-b4c17203fa53 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:12.872445 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4e83a9b4-3881-48b4-988b-b4c17203fa53 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:12.872878 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4e83a9b4-3881-48b4-988b-b4c17203fa53 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:12.901355 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4e83a9b4-3881-48b4-988b-b4c17203fa53 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041884 Apr 05 12:00:12.901926 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 680/1379] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:12 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:13.870996 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-14273620-0444-445d-8e26-7073a9340e11 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:13.871935 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-14273620-0444-445d-8e26-7073a9340e11 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:13.873591 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-56e781ad-6b46-4faf-a096-e9c26d591d0a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:13.874537 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-56e781ad-6b46-4faf-a096-e9c26d591d0a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:13.878726 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14273620-0444-445d-8e26-7073a9340e11 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:13.879188 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14273620-0444-445d-8e26-7073a9340e11 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:13.879947 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14273620-0444-445d-8e26-7073a9340e11 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:13.880407 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14273620-0444-445d-8e26-7073a9340e11 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:13.881050 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56e781ad-6b46-4faf-a096-e9c26d591d0a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:13.881497 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56e781ad-6b46-4faf-a096-e9c26d591d0a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:13.882293 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56e781ad-6b46-4faf-a096-e9c26d591d0a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:13.882728 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56e781ad-6b46-4faf-a096-e9c26d591d0a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:13.912967 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-56e781ad-6b46-4faf-a096-e9c26d591d0a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043333 Apr 05 12:00:13.913360 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-14273620-0444-445d-8e26-7073a9340e11 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047481 Apr 05 12:00:13.913509 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 681/1380] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:13 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:13.914141 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 700/1381] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:13 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:13.918230 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4c311cc3-5062-4fa3-bf6c-b296e2b5f0e6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:13.919124 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4c311cc3-5062-4fa3-bf6c-b296e2b5f0e6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:13.925151 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c311cc3-5062-4fa3-bf6c-b296e2b5f0e6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:13.925595 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c311cc3-5062-4fa3-bf6c-b296e2b5f0e6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:13.926362 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c311cc3-5062-4fa3-bf6c-b296e2b5f0e6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:13.926790 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c311cc3-5062-4fa3-bf6c-b296e2b5f0e6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:13.954325 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4c311cc3-5062-4fa3-bf6c-b296e2b5f0e6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039845 Apr 05 12:00:13.954866 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 682/1382] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:13 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:14.925640 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4b05de4d-cac0-4ae9-9456-5581b4c3dcd2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:14.926582 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4b05de4d-cac0-4ae9-9456-5581b4c3dcd2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:14.926776 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-af7a9fad-157e-4658-93db-5831f447a233 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:14.927932 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-af7a9fad-157e-4658-93db-5831f447a233 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:14.933944 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4b05de4d-cac0-4ae9-9456-5581b4c3dcd2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:14.934450 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4b05de4d-cac0-4ae9-9456-5581b4c3dcd2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:14.934972 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-af7a9fad-157e-4658-93db-5831f447a233 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:14.935413 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4b05de4d-cac0-4ae9-9456-5581b4c3dcd2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:14.935556 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-af7a9fad-157e-4658-93db-5831f447a233 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:14.935939 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4b05de4d-cac0-4ae9-9456-5581b4c3dcd2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:14.936207 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-af7a9fad-157e-4658-93db-5831f447a233 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:14.936634 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-af7a9fad-157e-4658-93db-5831f447a233 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:14.966595 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4b05de4d-cac0-4ae9-9456-5581b4c3dcd2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045721 Apr 05 12:00:14.966918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-af7a9fad-157e-4658-93db-5831f447a233 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045247 Apr 05 12:00:14.970560 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 701/1383] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:14 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:14.970699 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 683/1384] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:14 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:14.972021 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-904a5653-4284-4505-a0a4-67e52616fed5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:14.972968 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-904a5653-4284-4505-a0a4-67e52616fed5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:14.979522 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-904a5653-4284-4505-a0a4-67e52616fed5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:14.979959 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-904a5653-4284-4505-a0a4-67e52616fed5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:14.980746 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-904a5653-4284-4505-a0a4-67e52616fed5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:14.981171 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-904a5653-4284-4505-a0a4-67e52616fed5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:15.008512 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-904a5653-4284-4505-a0a4-67e52616fed5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040076 Apr 05 12:00:15.009043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 702/1385] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:14 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:15.983074 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-db39c374-f32f-44d2-b7ee-3a7f6d0b3945 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:15.984256 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0b6f6f56-d7e6-41dd-8367-c99e05a8a4b0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:15.985010 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-db39c374-f32f-44d2-b7ee-3a7f6d0b3945 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:15.985735 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0b6f6f56-d7e6-41dd-8367-c99e05a8a4b0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:15.995072 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-db39c374-f32f-44d2-b7ee-3a7f6d0b3945 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:15.995521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-db39c374-f32f-44d2-b7ee-3a7f6d0b3945 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:15.995685 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0b6f6f56-d7e6-41dd-8367-c99e05a8a4b0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:15.996061 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0b6f6f56-d7e6-41dd-8367-c99e05a8a4b0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:15.996331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-db39c374-f32f-44d2-b7ee-3a7f6d0b3945 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:15.996763 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-db39c374-f32f-44d2-b7ee-3a7f6d0b3945 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:15.996918 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0b6f6f56-d7e6-41dd-8367-c99e05a8a4b0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:15.997259 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0b6f6f56-d7e6-41dd-8367-c99e05a8a4b0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:16.025694 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-db39c374-f32f-44d2-b7ee-3a7f6d0b3945 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049091 Apr 05 12:00:16.029803 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 684/1386] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:15 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:16.029955 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0b6f6f56-d7e6-41dd-8367-c99e05a8a4b0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049942 Apr 05 12:00:16.029955 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 703/1387] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:15 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:16.031429 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ee4030cd-37a9-46af-a0bc-237dfbbbdb84 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:16.032362 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ee4030cd-37a9-46af-a0bc-237dfbbbdb84 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:16.038188 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee4030cd-37a9-46af-a0bc-237dfbbbdb84 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:16.038638 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee4030cd-37a9-46af-a0bc-237dfbbbdb84 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:16.039398 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee4030cd-37a9-46af-a0bc-237dfbbbdb84 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:16.039833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee4030cd-37a9-46af-a0bc-237dfbbbdb84 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:16.067426 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ee4030cd-37a9-46af-a0bc-237dfbbbdb84 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040178 Apr 05 12:00:16.067965 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 685/1388] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:16 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:17.042060 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-18005dd4-ad96-4772-8dc6-a590ee25ef50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:17.043010 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a9f085c4-b5d4-4969-b6e0-44fbfb5f62be tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:17.043641 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a9f085c4-b5d4-4969-b6e0-44fbfb5f62be tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:17.043815 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-18005dd4-ad96-4772-8dc6-a590ee25ef50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:17.053942 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a9f085c4-b5d4-4969-b6e0-44fbfb5f62be tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:17.054234 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-18005dd4-ad96-4772-8dc6-a590ee25ef50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:17.054679 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a9f085c4-b5d4-4969-b6e0-44fbfb5f62be tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:17.054948 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-18005dd4-ad96-4772-8dc6-a590ee25ef50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:17.055920 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a9f085c4-b5d4-4969-b6e0-44fbfb5f62be tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:17.056206 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-18005dd4-ad96-4772-8dc6-a590ee25ef50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:17.056694 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-18005dd4-ad96-4772-8dc6-a590ee25ef50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:17.057074 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a9f085c4-b5d4-4969-b6e0-44fbfb5f62be tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:17.086183 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-18005dd4-ad96-4772-8dc6-a590ee25ef50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051020 Apr 05 12:00:17.086690 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a9f085c4-b5d4-4969-b6e0-44fbfb5f62be tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051368 Apr 05 12:00:17.086837 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 704/1389] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:17 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:17.087497 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 686/1390] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:17 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:17.091277 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4bd4e847-d826-4c92-97d8-ccb91d5b57fb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:17.092225 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4bd4e847-d826-4c92-97d8-ccb91d5b57fb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:17.097845 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4bd4e847-d826-4c92-97d8-ccb91d5b57fb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:17.098285 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4bd4e847-d826-4c92-97d8-ccb91d5b57fb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:17.099398 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4bd4e847-d826-4c92-97d8-ccb91d5b57fb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:17.099824 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4bd4e847-d826-4c92-97d8-ccb91d5b57fb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:17.130724 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4bd4e847-d826-4c92-97d8-ccb91d5b57fb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042761 Apr 05 12:00:17.131264 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 705/1391] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:17 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:18.102218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-58ec955f-9345-478d-8a8e-399e08c6709d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:18.103041 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d6326bd5-911e-43be-afa7-6ae698c0523b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:18.103665 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d6326bd5-911e-43be-afa7-6ae698c0523b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:18.103828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-58ec955f-9345-478d-8a8e-399e08c6709d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:18.110562 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d6326bd5-911e-43be-afa7-6ae698c0523b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:18.110738 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-58ec955f-9345-478d-8a8e-399e08c6709d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:18.111010 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d6326bd5-911e-43be-afa7-6ae698c0523b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:18.111164 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-58ec955f-9345-478d-8a8e-399e08c6709d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:18.111785 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-58ec955f-9345-478d-8a8e-399e08c6709d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:18.111919 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d6326bd5-911e-43be-afa7-6ae698c0523b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:18.112257 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-58ec955f-9345-478d-8a8e-399e08c6709d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:18.112392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d6326bd5-911e-43be-afa7-6ae698c0523b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:18.143100 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-58ec955f-9345-478d-8a8e-399e08c6709d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047912 Apr 05 12:00:18.146923 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 687/1392] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:18 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:18.147084 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d6326bd5-911e-43be-afa7-6ae698c0523b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049651 Apr 05 12:00:18.147084 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 706/1393] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:18 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:18.148903 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-dd0063d9-0f8e-46cb-9164-90c1b72668ca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:18.149827 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-dd0063d9-0f8e-46cb-9164-90c1b72668ca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:18.155964 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd0063d9-0f8e-46cb-9164-90c1b72668ca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:18.156474 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd0063d9-0f8e-46cb-9164-90c1b72668ca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:18.157233 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd0063d9-0f8e-46cb-9164-90c1b72668ca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:18.157670 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd0063d9-0f8e-46cb-9164-90c1b72668ca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:18.185432 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-dd0063d9-0f8e-46cb-9164-90c1b72668ca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040354 Apr 05 12:00:18.186014 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 688/1394] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:18 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:19.157892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-101aef74-4469-46ca-826b-8e9d92e8a6f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:19.158997 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-101aef74-4469-46ca-826b-8e9d92e8a6f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:19.159299 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d411c183-37fe-4549-b5e0-02e6820e12ff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:19.160618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d411c183-37fe-4549-b5e0-02e6820e12ff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:19.167837 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-101aef74-4469-46ca-826b-8e9d92e8a6f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:19.168488 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-101aef74-4469-46ca-826b-8e9d92e8a6f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:19.168834 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d411c183-37fe-4549-b5e0-02e6820e12ff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:19.169438 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d411c183-37fe-4549-b5e0-02e6820e12ff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:19.169588 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-101aef74-4469-46ca-826b-8e9d92e8a6f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:19.170082 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-101aef74-4469-46ca-826b-8e9d92e8a6f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:19.170450 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d411c183-37fe-4549-b5e0-02e6820e12ff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:19.171030 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d411c183-37fe-4549-b5e0-02e6820e12ff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:19.202371 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-101aef74-4469-46ca-826b-8e9d92e8a6f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049929 Apr 05 12:00:19.202692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d411c183-37fe-4549-b5e0-02e6820e12ff tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048527 Apr 05 12:00:19.206534 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 707/1396] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:19 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:19.206674 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 689/1396] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:19 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:19.207808 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e1045150-3b40-463b-b283-82c9cc3444f1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:19.208821 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e1045150-3b40-463b-b283-82c9cc3444f1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:19.214702 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e1045150-3b40-463b-b283-82c9cc3444f1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:19.215155 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e1045150-3b40-463b-b283-82c9cc3444f1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:19.215910 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e1045150-3b40-463b-b283-82c9cc3444f1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:19.216383 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e1045150-3b40-463b-b283-82c9cc3444f1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:19.244488 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e1045150-3b40-463b-b283-82c9cc3444f1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040163 Apr 05 12:00:19.245068 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 708/1397] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:19 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:20.218220 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a94c6d61-b1bc-48d3-8aaf-b70f35f8cb28 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:20.219296 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-edc8e342-9d5a-4ac3-b57d-920f935a970c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:20.219925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a94c6d61-b1bc-48d3-8aaf-b70f35f8cb28 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:20.220105 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-edc8e342-9d5a-4ac3-b57d-920f935a970c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:20.230211 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a94c6d61-b1bc-48d3-8aaf-b70f35f8cb28 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:20.230369 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-edc8e342-9d5a-4ac3-b57d-920f935a970c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:20.230658 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a94c6d61-b1bc-48d3-8aaf-b70f35f8cb28 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:20.230818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-edc8e342-9d5a-4ac3-b57d-920f935a970c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:20.231419 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a94c6d61-b1bc-48d3-8aaf-b70f35f8cb28 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:20.231562 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-edc8e342-9d5a-4ac3-b57d-920f935a970c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:20.231853 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a94c6d61-b1bc-48d3-8aaf-b70f35f8cb28 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:20.232007 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-edc8e342-9d5a-4ac3-b57d-920f935a970c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:20.261275 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a94c6d61-b1bc-48d3-8aaf-b70f35f8cb28 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049601 Apr 05 12:00:20.261528 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-edc8e342-9d5a-4ac3-b57d-920f935a970c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049923 Apr 05 12:00:20.261839 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 709/1398] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:20 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:20.262236 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 690/1399] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:20 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:20.270515 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c4c09256-d1b3-4ddf-b6f2-9696d49a7394 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:20.271418 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c4c09256-d1b3-4ddf-b6f2-9696d49a7394 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:20.277099 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c4c09256-d1b3-4ddf-b6f2-9696d49a7394 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:20.277541 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c4c09256-d1b3-4ddf-b6f2-9696d49a7394 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:20.278294 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c4c09256-d1b3-4ddf-b6f2-9696d49a7394 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:20.278739 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c4c09256-d1b3-4ddf-b6f2-9696d49a7394 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:20.312935 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c4c09256-d1b3-4ddf-b6f2-9696d49a7394 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049701 Apr 05 12:00:20.313741 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 710/1400] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:20 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:21.277107 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-61e8d8ac-55e7-47c7-a73c-e0b1834f29ac tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:21.277910 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6ad65fd4-ca22-4781-b1b1-c0fad25e5393 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:21.278359 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-61e8d8ac-55e7-47c7-a73c-e0b1834f29ac tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:21.278827 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6ad65fd4-ca22-4781-b1b1-c0fad25e5393 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:21.284821 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-61e8d8ac-55e7-47c7-a73c-e0b1834f29ac tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:21.284990 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6ad65fd4-ca22-4781-b1b1-c0fad25e5393 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:21.285272 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-61e8d8ac-55e7-47c7-a73c-e0b1834f29ac tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:21.285427 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6ad65fd4-ca22-4781-b1b1-c0fad25e5393 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:21.286042 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-61e8d8ac-55e7-47c7-a73c-e0b1834f29ac tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:21.286187 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6ad65fd4-ca22-4781-b1b1-c0fad25e5393 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:21.286476 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-61e8d8ac-55e7-47c7-a73c-e0b1834f29ac tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:21.286618 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6ad65fd4-ca22-4781-b1b1-c0fad25e5393 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:21.315658 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6ad65fd4-ca22-4781-b1b1-c0fad25e5393 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043647 Apr 05 12:00:21.315932 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-61e8d8ac-55e7-47c7-a73c-e0b1834f29ac tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045170 Apr 05 12:00:21.316468 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 711/1401] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:21 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:21.316615 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 691/1402] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:21 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:21.324731 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b59cca11-3357-45bc-af43-9945aceadaff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:21.325622 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b59cca11-3357-45bc-af43-9945aceadaff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:21.331621 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b59cca11-3357-45bc-af43-9945aceadaff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:21.332066 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b59cca11-3357-45bc-af43-9945aceadaff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:21.332847 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b59cca11-3357-45bc-af43-9945aceadaff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:21.333272 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b59cca11-3357-45bc-af43-9945aceadaff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:21.361883 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b59cca11-3357-45bc-af43-9945aceadaff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040850 Apr 05 12:00:21.362686 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 712/1403] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:21 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:22.331298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-55bc4baa-05c6-4c59-a628-0da1ddabca2a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:22.332254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0bac7d41-9f92-4532-b4c3-8444f93b5621 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:22.332868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-55bc4baa-05c6-4c59-a628-0da1ddabca2a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:22.333032 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0bac7d41-9f92-4532-b4c3-8444f93b5621 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:22.341825 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0bac7d41-9f92-4532-b4c3-8444f93b5621 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:22.342027 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-55bc4baa-05c6-4c59-a628-0da1ddabca2a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:22.342269 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0bac7d41-9f92-4532-b4c3-8444f93b5621 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:22.342528 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-55bc4baa-05c6-4c59-a628-0da1ddabca2a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:22.343030 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0bac7d41-9f92-4532-b4c3-8444f93b5621 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:22.343176 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-55bc4baa-05c6-4c59-a628-0da1ddabca2a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:22.343454 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0bac7d41-9f92-4532-b4c3-8444f93b5621 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:22.343608 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-55bc4baa-05c6-4c59-a628-0da1ddabca2a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:22.373277 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0bac7d41-9f92-4532-b4c3-8444f93b5621 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048474 Apr 05 12:00:22.373551 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-55bc4baa-05c6-4c59-a628-0da1ddabca2a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048965 Apr 05 12:00:22.377397 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 713/1404] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:22 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:22.377559 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 692/1405] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:22 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:22.378753 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b0dd182f-b6ce-45ed-810b-dace6c813ce1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:22.379672 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b0dd182f-b6ce-45ed-810b-dace6c813ce1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:22.386647 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b0dd182f-b6ce-45ed-810b-dace6c813ce1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:22.387091 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b0dd182f-b6ce-45ed-810b-dace6c813ce1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:22.387869 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b0dd182f-b6ce-45ed-810b-dace6c813ce1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:22.388342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b0dd182f-b6ce-45ed-810b-dace6c813ce1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:22.416993 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b0dd182f-b6ce-45ed-810b-dace6c813ce1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041989 Apr 05 12:00:22.417599 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 714/1406] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:22 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:23.388404 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-79bcd11d-2b44-4a5f-a195-0328cbf770dd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:23.389251 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-79bcd11d-2b44-4a5f-a195-0328cbf770dd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:23.389403 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d6171447-1df3-44c9-82d6-34be680f0fe7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:23.390337 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d6171447-1df3-44c9-82d6-34be680f0fe7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:23.396127 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79bcd11d-2b44-4a5f-a195-0328cbf770dd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:23.396629 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79bcd11d-2b44-4a5f-a195-0328cbf770dd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:23.397327 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d6171447-1df3-44c9-82d6-34be680f0fe7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:23.397466 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79bcd11d-2b44-4a5f-a195-0328cbf770dd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:23.397845 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79bcd11d-2b44-4a5f-a195-0328cbf770dd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:23.398177 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d6171447-1df3-44c9-82d6-34be680f0fe7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:23.398974 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d6171447-1df3-44c9-82d6-34be680f0fe7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:23.399435 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d6171447-1df3-44c9-82d6-34be680f0fe7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:23.430033 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-79bcd11d-2b44-4a5f-a195-0328cbf770dd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047518 Apr 05 12:00:23.430600 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d6171447-1df3-44c9-82d6-34be680f0fe7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046225 Apr 05 12:00:23.431173 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 715/1407] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:23 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:23.434531 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 693/1408] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:23 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:23.435743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fb8ce40d-96bc-445c-ab36-cb93bfec82c9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:23.436688 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fb8ce40d-96bc-445c-ab36-cb93bfec82c9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:23.442797 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fb8ce40d-96bc-445c-ab36-cb93bfec82c9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:23.443244 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fb8ce40d-96bc-445c-ab36-cb93bfec82c9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:23.444044 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fb8ce40d-96bc-445c-ab36-cb93bfec82c9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:23.444502 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fb8ce40d-96bc-445c-ab36-cb93bfec82c9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:23.473500 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fb8ce40d-96bc-445c-ab36-cb93bfec82c9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041389 Apr 05 12:00:23.474049 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 716/1409] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:23 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:24.446073 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7d331384-14cd-42d9-b5d0-8544ef0e2c59 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:24.446871 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3c586ac9-97b2-4e8e-986f-3f8d82b5455f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:24.447464 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3c586ac9-97b2-4e8e-986f-3f8d82b5455f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:24.448566 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7d331384-14cd-42d9-b5d0-8544ef0e2c59 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:24.457533 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3c586ac9-97b2-4e8e-986f-3f8d82b5455f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:24.458084 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7d331384-14cd-42d9-b5d0-8544ef0e2c59 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:24.458345 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3c586ac9-97b2-4e8e-986f-3f8d82b5455f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:24.458864 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7d331384-14cd-42d9-b5d0-8544ef0e2c59 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:24.459512 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3c586ac9-97b2-4e8e-986f-3f8d82b5455f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:24.460110 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7d331384-14cd-42d9-b5d0-8544ef0e2c59 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:24.460342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3c586ac9-97b2-4e8e-986f-3f8d82b5455f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:24.460968 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7d331384-14cd-42d9-b5d0-8544ef0e2c59 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:24.492515 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3c586ac9-97b2-4e8e-986f-3f8d82b5455f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052623 Apr 05 12:00:24.493302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 717/1410] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:24 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:24.493443 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7d331384-14cd-42d9-b5d0-8544ef0e2c59 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053226 Apr 05 12:00:24.493901 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 694/1411] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:24 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:24.497761 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e0b27348-0de4-417f-aaab-17f634b9ffe8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:24.498518 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e0b27348-0de4-417f-aaab-17f634b9ffe8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:24.504369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0b27348-0de4-417f-aaab-17f634b9ffe8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:24.504811 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0b27348-0de4-417f-aaab-17f634b9ffe8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:24.505563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0b27348-0de4-417f-aaab-17f634b9ffe8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:24.505965 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0b27348-0de4-417f-aaab-17f634b9ffe8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:24.533924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e0b27348-0de4-417f-aaab-17f634b9ffe8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039903 Apr 05 12:00:24.534471 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 718/1412] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:24 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:25.508686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-64803875-a6c3-489d-a25d-1e84ae677deb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:25.509565 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5a75f2de-84dd-4db5-bec1-375e878bf580 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:25.510199 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-64803875-a6c3-489d-a25d-1e84ae677deb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:25.510973 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5a75f2de-84dd-4db5-bec1-375e878bf580 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:25.518758 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64803875-a6c3-489d-a25d-1e84ae677deb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:25.518989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5a75f2de-84dd-4db5-bec1-375e878bf580 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:25.519217 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64803875-a6c3-489d-a25d-1e84ae677deb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:25.519454 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5a75f2de-84dd-4db5-bec1-375e878bf580 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:25.519993 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64803875-a6c3-489d-a25d-1e84ae677deb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:25.520253 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5a75f2de-84dd-4db5-bec1-375e878bf580 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:25.520471 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64803875-a6c3-489d-a25d-1e84ae677deb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:25.520686 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5a75f2de-84dd-4db5-bec1-375e878bf580 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:25.549723 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5a75f2de-84dd-4db5-bec1-375e878bf580 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046845 Apr 05 12:00:25.550282 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 719/1413] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:25 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:25.550445 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-64803875-a6c3-489d-a25d-1e84ae677deb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048380 Apr 05 12:00:25.554506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 695/1414] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:25 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:25.557165 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6a1efe6b-fbd3-44eb-a015-371225160f64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:25.558068 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6a1efe6b-fbd3-44eb-a015-371225160f64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:25.564019 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6a1efe6b-fbd3-44eb-a015-371225160f64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:25.564496 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6a1efe6b-fbd3-44eb-a015-371225160f64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:25.565251 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6a1efe6b-fbd3-44eb-a015-371225160f64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:25.565677 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6a1efe6b-fbd3-44eb-a015-371225160f64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:25.593554 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6a1efe6b-fbd3-44eb-a015-371225160f64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042326 Apr 05 12:00:25.594090 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 720/1415] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:25 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:26.560957 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-413544d5-02ac-441d-baff-6c17eea755b0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:26.561798 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-413544d5-02ac-441d-baff-6c17eea755b0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:26.562160 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ade3ffc8-8742-4057-9823-0e671f082eba tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:26.563085 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ade3ffc8-8742-4057-9823-0e671f082eba tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:26.568272 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-413544d5-02ac-441d-baff-6c17eea755b0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:26.568555 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-413544d5-02ac-441d-baff-6c17eea755b0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:26.569417 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ade3ffc8-8742-4057-9823-0e671f082eba tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:26.569567 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-413544d5-02ac-441d-baff-6c17eea755b0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:26.569857 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ade3ffc8-8742-4057-9823-0e671f082eba tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:26.570010 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-413544d5-02ac-441d-baff-6c17eea755b0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:26.570680 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ade3ffc8-8742-4057-9823-0e671f082eba tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:26.571031 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ade3ffc8-8742-4057-9823-0e671f082eba tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:26.599367 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-413544d5-02ac-441d-baff-6c17eea755b0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042434 Apr 05 12:00:26.599748 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ade3ffc8-8742-4057-9823-0e671f082eba tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041545 Apr 05 12:00:26.600703 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 721/1416] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:26 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:26.603882 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 696/1417] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:26 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:26.605271 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f72ef9e3-e104-4a2e-96b5-5fcf62aeabe6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:26.606185 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f72ef9e3-e104-4a2e-96b5-5fcf62aeabe6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:26.612356 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f72ef9e3-e104-4a2e-96b5-5fcf62aeabe6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:26.612806 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f72ef9e3-e104-4a2e-96b5-5fcf62aeabe6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:26.613571 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f72ef9e3-e104-4a2e-96b5-5fcf62aeabe6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:26.614003 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f72ef9e3-e104-4a2e-96b5-5fcf62aeabe6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:26.641868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f72ef9e3-e104-4a2e-96b5-5fcf62aeabe6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040213 Apr 05 12:00:26.642564 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 722/1418] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:26 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:27.613556 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-51c3fdbe-973f-4a55-b94c-84dc3bccf0af tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:27.614118 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e3287cd3-6b32-4f23-ae98-8d0e6ae026c8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:27.614779 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e3287cd3-6b32-4f23-ae98-8d0e6ae026c8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:27.615777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-51c3fdbe-973f-4a55-b94c-84dc3bccf0af tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:27.621482 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e3287cd3-6b32-4f23-ae98-8d0e6ae026c8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:27.621934 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e3287cd3-6b32-4f23-ae98-8d0e6ae026c8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:27.622692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-51c3fdbe-973f-4a55-b94c-84dc3bccf0af tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:27.622800 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e3287cd3-6b32-4f23-ae98-8d0e6ae026c8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:27.623124 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e3287cd3-6b32-4f23-ae98-8d0e6ae026c8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:27.623281 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-51c3fdbe-973f-4a55-b94c-84dc3bccf0af tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:27.623907 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-51c3fdbe-973f-4a55-b94c-84dc3bccf0af tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:27.624493 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-51c3fdbe-973f-4a55-b94c-84dc3bccf0af tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:27.652168 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e3287cd3-6b32-4f23-ae98-8d0e6ae026c8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042756 Apr 05 12:00:27.652739 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 723/1419] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:27 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:27.653370 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-51c3fdbe-973f-4a55-b94c-84dc3bccf0af tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044031 Apr 05 12:00:27.657175 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 697/1420] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:27 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:27.657334 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e2324ee2-2b0f-4930-89dc-f474ba992aba tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:27.658162 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e2324ee2-2b0f-4930-89dc-f474ba992aba tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:27.663776 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e2324ee2-2b0f-4930-89dc-f474ba992aba tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:27.664249 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e2324ee2-2b0f-4930-89dc-f474ba992aba tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:27.665009 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e2324ee2-2b0f-4930-89dc-f474ba992aba tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:27.665439 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e2324ee2-2b0f-4930-89dc-f474ba992aba tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:27.693330 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e2324ee2-2b0f-4930-89dc-f474ba992aba tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039626 Apr 05 12:00:27.693877 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 724/1421] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:27 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:28.667983 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8f460fc9-945c-4adf-b587-0adfb169ca34 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:28.668862 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-da494bff-2ed9-44e9-8b3a-211702615a68 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:28.669464 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8f460fc9-945c-4adf-b587-0adfb169ca34 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:28.670346 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-da494bff-2ed9-44e9-8b3a-211702615a68 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:28.679973 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f460fc9-945c-4adf-b587-0adfb169ca34 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:28.680764 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f460fc9-945c-4adf-b587-0adfb169ca34 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:28.681045 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-da494bff-2ed9-44e9-8b3a-211702615a68 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:28.681603 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-da494bff-2ed9-44e9-8b3a-211702615a68 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:28.681940 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f460fc9-945c-4adf-b587-0adfb169ca34 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:28.682709 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f460fc9-945c-4adf-b587-0adfb169ca34 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:28.682974 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-da494bff-2ed9-44e9-8b3a-211702615a68 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:28.683796 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-da494bff-2ed9-44e9-8b3a-211702615a68 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:28.714165 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-da494bff-2ed9-44e9-8b3a-211702615a68 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051827 Apr 05 12:00:28.714727 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 725/1422] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:28 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:28.715261 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8f460fc9-945c-4adf-b587-0adfb169ca34 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054014 Apr 05 12:00:28.719193 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 698/1423] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:28 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:28.719395 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1489f3bc-a027-4d66-a069-279a0cb1614b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:28.720330 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1489f3bc-a027-4d66-a069-279a0cb1614b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:28.726475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1489f3bc-a027-4d66-a069-279a0cb1614b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:28.726940 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1489f3bc-a027-4d66-a069-279a0cb1614b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:28.727721 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1489f3bc-a027-4d66-a069-279a0cb1614b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:28.728113 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1489f3bc-a027-4d66-a069-279a0cb1614b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:28.756317 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1489f3bc-a027-4d66-a069-279a0cb1614b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040613 Apr 05 12:00:28.757072 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 726/1424] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:28 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:29.730711 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-069d52bc-8876-4c0e-b3de-f0a45d637b3a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:29.731604 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ccaad179-6c1f-469b-b2c9-7a075bb9e930 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:29.732270 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-069d52bc-8876-4c0e-b3de-f0a45d637b3a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:29.732681 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ccaad179-6c1f-469b-b2c9-7a075bb9e930 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:29.742944 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-069d52bc-8876-4c0e-b3de-f0a45d637b3a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:29.743545 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ccaad179-6c1f-469b-b2c9-7a075bb9e930 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:29.743933 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-069d52bc-8876-4c0e-b3de-f0a45d637b3a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:29.744317 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ccaad179-6c1f-469b-b2c9-7a075bb9e930 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:29.745234 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-069d52bc-8876-4c0e-b3de-f0a45d637b3a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:29.745624 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ccaad179-6c1f-469b-b2c9-7a075bb9e930 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:29.745950 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-069d52bc-8876-4c0e-b3de-f0a45d637b3a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:29.746230 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ccaad179-6c1f-469b-b2c9-7a075bb9e930 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:29.777776 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-069d52bc-8876-4c0e-b3de-f0a45d637b3a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054082 Apr 05 12:00:29.778036 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ccaad179-6c1f-469b-b2c9-7a075bb9e930 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053628 Apr 05 12:00:29.781804 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 699/1425] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:29 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:29.781975 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 727/1426] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:29 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:29.783106 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ef5db123-f36d-4160-9795-9b50c5bd9d28 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:29.784036 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ef5db123-f36d-4160-9795-9b50c5bd9d28 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:29.790152 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef5db123-f36d-4160-9795-9b50c5bd9d28 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:29.790610 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef5db123-f36d-4160-9795-9b50c5bd9d28 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:29.791360 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef5db123-f36d-4160-9795-9b50c5bd9d28 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:29.791793 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef5db123-f36d-4160-9795-9b50c5bd9d28 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:29.820347 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ef5db123-f36d-4160-9795-9b50c5bd9d28 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040877 Apr 05 12:00:29.820885 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 700/1427] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:29 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:30.793839 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-729adaf8-4632-473a-9ed9-927ae6b06611 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:30.794662 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3fa19fc4-7db3-4cfb-9b70-da3cfab85da0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:30.795287 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3fa19fc4-7db3-4cfb-9b70-da3cfab85da0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:30.795453 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-729adaf8-4632-473a-9ed9-927ae6b06611 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:30.802748 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-729adaf8-4632-473a-9ed9-927ae6b06611 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:30.803198 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-729adaf8-4632-473a-9ed9-927ae6b06611 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:30.803970 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-729adaf8-4632-473a-9ed9-927ae6b06611 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:30.804169 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3fa19fc4-7db3-4cfb-9b70-da3cfab85da0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:30.804443 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-729adaf8-4632-473a-9ed9-927ae6b06611 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:30.804817 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3fa19fc4-7db3-4cfb-9b70-da3cfab85da0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:30.805861 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3fa19fc4-7db3-4cfb-9b70-da3cfab85da0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:30.806293 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3fa19fc4-7db3-4cfb-9b70-da3cfab85da0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:30.836135 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-729adaf8-4632-473a-9ed9-927ae6b06611 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049009 Apr 05 12:00:30.836741 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 728/1428] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:30 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:30.838772 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3fa19fc4-7db3-4cfb-9b70-da3cfab85da0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051476 Apr 05 12:00:30.839826 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 701/1429] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:30 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:30.845799 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c2664ede-3684-4c2d-9dec-0dc7161d5798 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:30.847158 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c2664ede-3684-4c2d-9dec-0dc7161d5798 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:30.855921 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c2664ede-3684-4c2d-9dec-0dc7161d5798 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:30.856622 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c2664ede-3684-4c2d-9dec-0dc7161d5798 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:30.857771 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c2664ede-3684-4c2d-9dec-0dc7161d5798 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:30.858420 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c2664ede-3684-4c2d-9dec-0dc7161d5798 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:30.890431 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c2664ede-3684-4c2d-9dec-0dc7161d5798 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052670 Apr 05 12:00:30.891003 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 729/1430] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:30 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:31.852993 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fa08027a-4385-4415-bddd-76065a3b95e5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:31.854350 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fa08027a-4385-4415-bddd-76065a3b95e5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:31.855067 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d5e146fe-2925-47ca-925e-f5d920aad779 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:31.856578 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d5e146fe-2925-47ca-925e-f5d920aad779 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:31.865117 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fa08027a-4385-4415-bddd-76065a3b95e5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:31.865863 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fa08027a-4385-4415-bddd-76065a3b95e5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:31.866912 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d5e146fe-2925-47ca-925e-f5d920aad779 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:31.867281 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fa08027a-4385-4415-bddd-76065a3b95e5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:31.867626 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d5e146fe-2925-47ca-925e-f5d920aad779 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:31.867983 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fa08027a-4385-4415-bddd-76065a3b95e5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:31.868952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d5e146fe-2925-47ca-925e-f5d920aad779 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:31.869665 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d5e146fe-2925-47ca-925e-f5d920aad779 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:31.900109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fa08027a-4385-4415-bddd-76065a3b95e5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054385 Apr 05 12:00:31.900686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 702/1431] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:31 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:31.901122 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d5e146fe-2925-47ca-925e-f5d920aad779 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052935 Apr 05 12:00:31.901958 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 730/1432] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:31 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:31.905157 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-89243453-9555-42c2-8950-b11a6ddedfb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:31.906071 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-89243453-9555-42c2-8950-b11a6ddedfb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:31.911778 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-89243453-9555-42c2-8950-b11a6ddedfb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:31.912258 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-89243453-9555-42c2-8950-b11a6ddedfb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:31.913012 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-89243453-9555-42c2-8950-b11a6ddedfb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:31.913435 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-89243453-9555-42c2-8950-b11a6ddedfb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:31.941017 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-89243453-9555-42c2-8950-b11a6ddedfb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039398 Apr 05 12:00:31.941584 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 703/1433] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:31 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:32.917233 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-abab9c36-778e-4494-a6bc-bb591e5bc7a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:32.918637 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-abab9c36-778e-4494-a6bc-bb591e5bc7a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:32.918921 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9a1b1c9c-e299-45ab-89a1-31b6f40dfa1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:32.920458 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9a1b1c9c-e299-45ab-89a1-31b6f40dfa1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:32.927014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-abab9c36-778e-4494-a6bc-bb591e5bc7a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:32.927494 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-abab9c36-778e-4494-a6bc-bb591e5bc7a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:32.928307 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-abab9c36-778e-4494-a6bc-bb591e5bc7a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:32.928452 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9a1b1c9c-e299-45ab-89a1-31b6f40dfa1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:32.928741 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-abab9c36-778e-4494-a6bc-bb591e5bc7a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:32.928899 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9a1b1c9c-e299-45ab-89a1-31b6f40dfa1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:32.929568 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9a1b1c9c-e299-45ab-89a1-31b6f40dfa1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:32.929994 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9a1b1c9c-e299-45ab-89a1-31b6f40dfa1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:32.958232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-abab9c36-778e-4494-a6bc-bb591e5bc7a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047737 Apr 05 12:00:32.958798 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 731/1434] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:32 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:32.961448 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9a1b1c9c-e299-45ab-89a1-31b6f40dfa1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049119 Apr 05 12:00:32.962144 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 704/1435] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:32 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:32.963405 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-374797d3-141c-4800-a5bc-ba3a20b5446d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:32.964338 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-374797d3-141c-4800-a5bc-ba3a20b5446d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:32.970456 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-374797d3-141c-4800-a5bc-ba3a20b5446d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:32.970896 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-374797d3-141c-4800-a5bc-ba3a20b5446d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:32.971658 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-374797d3-141c-4800-a5bc-ba3a20b5446d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:32.972172 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-374797d3-141c-4800-a5bc-ba3a20b5446d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:32.999746 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-374797d3-141c-4800-a5bc-ba3a20b5446d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040009 Apr 05 12:00:33.000332 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 732/1436] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:32 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:33.973093 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2397b656-c047-4544-9540-e0ca9d79909e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:33.974024 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2397b656-c047-4544-9540-e0ca9d79909e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:33.974952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-593f33c5-df7c-4a94-857e-1157400f9781 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:33.975864 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-593f33c5-df7c-4a94-857e-1157400f9781 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:33.980721 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2397b656-c047-4544-9540-e0ca9d79909e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:33.981182 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2397b656-c047-4544-9540-e0ca9d79909e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:33.981951 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2397b656-c047-4544-9540-e0ca9d79909e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:33.982391 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2397b656-c047-4544-9540-e0ca9d79909e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:33.982885 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-593f33c5-df7c-4a94-857e-1157400f9781 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:33.983336 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-593f33c5-df7c-4a94-857e-1157400f9781 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:33.984169 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-593f33c5-df7c-4a94-857e-1157400f9781 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:33.984634 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-593f33c5-df7c-4a94-857e-1157400f9781 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:34.012179 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2397b656-c047-4544-9540-e0ca9d79909e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044731 Apr 05 12:00:34.012653 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 705/1437] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:33 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:34.013781 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-593f33c5-df7c-4a94-857e-1157400f9781 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043196 Apr 05 12:00:34.017566 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 733/1438] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:33 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:34.017718 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e36cdb36-7970-414c-bbcc-4d897d1cc5ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:34.018202 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e36cdb36-7970-414c-bbcc-4d897d1cc5ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:34.024028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e36cdb36-7970-414c-bbcc-4d897d1cc5ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:34.024524 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e36cdb36-7970-414c-bbcc-4d897d1cc5ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:34.025290 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e36cdb36-7970-414c-bbcc-4d897d1cc5ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:34.025729 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e36cdb36-7970-414c-bbcc-4d897d1cc5ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:34.053942 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e36cdb36-7970-414c-bbcc-4d897d1cc5ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040304 Apr 05 12:00:34.054459 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 706/1439] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:34 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:35.028437 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7898ee68-7ecb-4927-9dbc-8505209cf992 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:35.029430 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cd81b3cf-9b17-4f2b-b50e-d97e96d7812e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:35.030182 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7898ee68-7ecb-4927-9dbc-8505209cf992 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:35.030931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cd81b3cf-9b17-4f2b-b50e-d97e96d7812e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:35.040485 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7898ee68-7ecb-4927-9dbc-8505209cf992 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:35.041176 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd81b3cf-9b17-4f2b-b50e-d97e96d7812e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:35.041481 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7898ee68-7ecb-4927-9dbc-8505209cf992 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:35.041917 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd81b3cf-9b17-4f2b-b50e-d97e96d7812e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:35.042528 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7898ee68-7ecb-4927-9dbc-8505209cf992 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:35.043159 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd81b3cf-9b17-4f2b-b50e-d97e96d7812e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:35.043403 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7898ee68-7ecb-4927-9dbc-8505209cf992 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:35.043909 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd81b3cf-9b17-4f2b-b50e-d97e96d7812e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:35.074557 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7898ee68-7ecb-4927-9dbc-8505209cf992 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052859 Apr 05 12:00:35.075083 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 734/1440] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:35 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:35.076708 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cd81b3cf-9b17-4f2b-b50e-d97e96d7812e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053757 Apr 05 12:00:35.080609 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 707/1441] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:35 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:35.080765 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1d86afc6-0b27-47ca-a01b-a100764ebec8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:35.080765 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1d86afc6-0b27-47ca-a01b-a100764ebec8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:35.086519 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1d86afc6-0b27-47ca-a01b-a100764ebec8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:35.086968 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1d86afc6-0b27-47ca-a01b-a100764ebec8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:35.087720 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1d86afc6-0b27-47ca-a01b-a100764ebec8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:35.088180 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1d86afc6-0b27-47ca-a01b-a100764ebec8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:35.116382 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1d86afc6-0b27-47ca-a01b-a100764ebec8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040272 Apr 05 12:00:35.116930 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 735/1442] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:35 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:36.090202 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6d11d163-ae52-43ae-bd3f-e8946661abcc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:36.091616 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6d11d163-ae52-43ae-bd3f-e8946661abcc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:36.092421 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-930fb6e2-3a43-40a1-8fa7-9d5300fd5f93 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:36.093881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-930fb6e2-3a43-40a1-8fa7-9d5300fd5f93 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:36.100311 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6d11d163-ae52-43ae-bd3f-e8946661abcc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:36.100767 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6d11d163-ae52-43ae-bd3f-e8946661abcc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:36.101477 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-930fb6e2-3a43-40a1-8fa7-9d5300fd5f93 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:36.101633 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6d11d163-ae52-43ae-bd3f-e8946661abcc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:36.102300 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-930fb6e2-3a43-40a1-8fa7-9d5300fd5f93 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:36.102444 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6d11d163-ae52-43ae-bd3f-e8946661abcc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:36.103070 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-930fb6e2-3a43-40a1-8fa7-9d5300fd5f93 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:36.103507 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-930fb6e2-3a43-40a1-8fa7-9d5300fd5f93 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:36.131787 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6d11d163-ae52-43ae-bd3f-e8946661abcc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048693 Apr 05 12:00:36.132374 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 708/1443] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:36 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:36.132535 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-930fb6e2-3a43-40a1-8fa7-9d5300fd5f93 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046652 Apr 05 12:00:36.136194 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 736/1444] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:36 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:36.137332 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d40238c7-fae1-48bc-be76-a6b2ca420cf9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:36.138238 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d40238c7-fae1-48bc-be76-a6b2ca420cf9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:36.144034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d40238c7-fae1-48bc-be76-a6b2ca420cf9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:36.144508 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d40238c7-fae1-48bc-be76-a6b2ca420cf9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:36.145268 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d40238c7-fae1-48bc-be76-a6b2ca420cf9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:36.145700 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d40238c7-fae1-48bc-be76-a6b2ca420cf9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:36.174113 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d40238c7-fae1-48bc-be76-a6b2ca420cf9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040739 Apr 05 12:00:36.174696 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 709/1445] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:36 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:37.147332 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a0e74c37-d210-4608-b681-e62455025135 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:37.148235 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-be6ce1a1-90ae-436d-a222-0584017d6612 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:37.148874 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a0e74c37-d210-4608-b681-e62455025135 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:37.149736 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-be6ce1a1-90ae-436d-a222-0584017d6612 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:37.159372 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a0e74c37-d210-4608-b681-e62455025135 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:37.159821 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a0e74c37-d210-4608-b681-e62455025135 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:37.160374 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-be6ce1a1-90ae-436d-a222-0584017d6612 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:37.160764 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a0e74c37-d210-4608-b681-e62455025135 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:37.160903 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-be6ce1a1-90ae-436d-a222-0584017d6612 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:37.161440 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a0e74c37-d210-4608-b681-e62455025135 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:37.161578 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-be6ce1a1-90ae-436d-a222-0584017d6612 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:37.162024 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-be6ce1a1-90ae-436d-a222-0584017d6612 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:37.190683 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a0e74c37-d210-4608-b681-e62455025135 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050145 Apr 05 12:00:37.191205 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 737/1446] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:37 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:37.192902 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-be6ce1a1-90ae-436d-a222-0584017d6612 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050936 Apr 05 12:00:37.193713 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 710/1447] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:37 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:37.195723 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f7d52d0e-2fd3-4818-aa1f-436b554a3627 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:37.196661 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f7d52d0e-2fd3-4818-aa1f-436b554a3627 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:37.202851 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f7d52d0e-2fd3-4818-aa1f-436b554a3627 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:37.203295 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f7d52d0e-2fd3-4818-aa1f-436b554a3627 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:37.204064 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f7d52d0e-2fd3-4818-aa1f-436b554a3627 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:37.204533 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f7d52d0e-2fd3-4818-aa1f-436b554a3627 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:37.232592 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f7d52d0e-2fd3-4818-aa1f-436b554a3627 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040369 Apr 05 12:00:37.233134 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 738/1448] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:37 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:38.206501 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7f3f4689-0720-42cd-bf91-1ca2b470e54a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:38.207094 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c9d1550f-fa40-4b56-9ff5-a540325483a9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:38.207470 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7f3f4689-0720-42cd-bf91-1ca2b470e54a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:38.207961 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c9d1550f-fa40-4b56-9ff5-a540325483a9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:38.214120 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f3f4689-0720-42cd-bf91-1ca2b470e54a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:38.214563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f3f4689-0720-42cd-bf91-1ca2b470e54a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:38.214707 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9d1550f-fa40-4b56-9ff5-a540325483a9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:38.215058 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9d1550f-fa40-4b56-9ff5-a540325483a9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:38.215322 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f3f4689-0720-42cd-bf91-1ca2b470e54a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:38.215748 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f3f4689-0720-42cd-bf91-1ca2b470e54a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:38.215929 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9d1550f-fa40-4b56-9ff5-a540325483a9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:38.216310 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9d1550f-fa40-4b56-9ff5-a540325483a9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:38.245881 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7f3f4689-0720-42cd-bf91-1ca2b470e54a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045999 Apr 05 12:00:38.246107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c9d1550f-fa40-4b56-9ff5-a540325483a9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045598 Apr 05 12:00:38.246445 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 711/1449] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:38 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:38.249937 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 739/1450] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:38 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:38.251200 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-edaa03f5-ae8b-41d3-92a1-1c44efd2036f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:38.252139 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-edaa03f5-ae8b-41d3-92a1-1c44efd2036f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:38.258133 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-edaa03f5-ae8b-41d3-92a1-1c44efd2036f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:38.258583 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-edaa03f5-ae8b-41d3-92a1-1c44efd2036f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:38.259336 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-edaa03f5-ae8b-41d3-92a1-1c44efd2036f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:38.259774 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-edaa03f5-ae8b-41d3-92a1-1c44efd2036f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:38.287450 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-edaa03f5-ae8b-41d3-92a1-1c44efd2036f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039876 Apr 05 12:00:38.287990 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 712/1451] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:38 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:39.258809 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4f29ab43-63a9-4ba7-9bb1-a73dc23cd2f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:39.259450 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cc51e5b1-2c81-49ac-aa42-ad821369bc89 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:39.259853 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4f29ab43-63a9-4ba7-9bb1-a73dc23cd2f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:39.259954 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cc51e5b1-2c81-49ac-aa42-ad821369bc89 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:39.266016 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cc51e5b1-2c81-49ac-aa42-ad821369bc89 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:39.266450 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cc51e5b1-2c81-49ac-aa42-ad821369bc89 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:39.267168 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4f29ab43-63a9-4ba7-9bb1-a73dc23cd2f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:39.267327 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cc51e5b1-2c81-49ac-aa42-ad821369bc89 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:39.267645 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cc51e5b1-2c81-49ac-aa42-ad821369bc89 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:39.267796 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4f29ab43-63a9-4ba7-9bb1-a73dc23cd2f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:39.268564 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4f29ab43-63a9-4ba7-9bb1-a73dc23cd2f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:39.269159 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4f29ab43-63a9-4ba7-9bb1-a73dc23cd2f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:39.296859 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cc51e5b1-2c81-49ac-aa42-ad821369bc89 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042128 Apr 05 12:00:39.297420 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4f29ab43-63a9-4ba7-9bb1-a73dc23cd2f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042706 Apr 05 12:00:39.297561 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 740/1452] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:39 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:39.298152 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 713/1453] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:39 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:39.301873 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-dbb4b229-84df-451a-a223-d31de70d2508 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:39.302758 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-dbb4b229-84df-451a-a223-d31de70d2508 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:39.308589 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dbb4b229-84df-451a-a223-d31de70d2508 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:39.309031 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dbb4b229-84df-451a-a223-d31de70d2508 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:39.309779 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dbb4b229-84df-451a-a223-d31de70d2508 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:39.310206 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dbb4b229-84df-451a-a223-d31de70d2508 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:39.341283 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-dbb4b229-84df-451a-a223-d31de70d2508 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042871 Apr 05 12:00:39.341806 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 741/1454] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:39 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:40.313123 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e1154c81-6de7-4f65-ad9a-05aef084ca6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:40.313979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fee9b30d-382d-40bc-8007-56da4ea108fa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:40.314573 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fee9b30d-382d-40bc-8007-56da4ea108fa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:40.314723 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e1154c81-6de7-4f65-ad9a-05aef084ca6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:40.325010 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e1154c81-6de7-4f65-ad9a-05aef084ca6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:40.325289 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fee9b30d-382d-40bc-8007-56da4ea108fa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:40.325715 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e1154c81-6de7-4f65-ad9a-05aef084ca6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:40.325921 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fee9b30d-382d-40bc-8007-56da4ea108fa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:40.327011 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e1154c81-6de7-4f65-ad9a-05aef084ca6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:40.327250 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fee9b30d-382d-40bc-8007-56da4ea108fa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:40.327738 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e1154c81-6de7-4f65-ad9a-05aef084ca6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:40.328001 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fee9b30d-382d-40bc-8007-56da4ea108fa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:40.359068 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fee9b30d-382d-40bc-8007-56da4ea108fa tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052528 Apr 05 12:00:40.359359 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e1154c81-6de7-4f65-ad9a-05aef084ca6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052664 Apr 05 12:00:40.363879 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 742/1456] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:40 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:40.364095 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 714/1456] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:40 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:40.364581 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-63466aaf-b509-401d-b067-d3bb98156c48 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:40.365504 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-63466aaf-b509-401d-b067-d3bb98156c48 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:40.371524 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63466aaf-b509-401d-b067-d3bb98156c48 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:40.371972 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63466aaf-b509-401d-b067-d3bb98156c48 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:40.372783 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63466aaf-b509-401d-b067-d3bb98156c48 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:40.373207 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63466aaf-b509-401d-b067-d3bb98156c48 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:40.402127 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-63466aaf-b509-401d-b067-d3bb98156c48 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041414 Apr 05 12:00:40.402657 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 715/1457] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:40 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:41.375032 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5aeb1e2f-39b3-4651-b3cf-8d2c8a1082d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:41.375884 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-00e722e8-c3c3-4b07-9c5d-57ccacc762cc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:41.376550 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5aeb1e2f-39b3-4651-b3cf-8d2c8a1082d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:41.376732 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-00e722e8-c3c3-4b07-9c5d-57ccacc762cc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:41.384051 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5aeb1e2f-39b3-4651-b3cf-8d2c8a1082d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:41.384349 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00e722e8-c3c3-4b07-9c5d-57ccacc762cc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:41.384623 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5aeb1e2f-39b3-4651-b3cf-8d2c8a1082d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:41.384789 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00e722e8-c3c3-4b07-9c5d-57ccacc762cc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:41.385386 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5aeb1e2f-39b3-4651-b3cf-8d2c8a1082d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:41.385677 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00e722e8-c3c3-4b07-9c5d-57ccacc762cc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:41.385823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5aeb1e2f-39b3-4651-b3cf-8d2c8a1082d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:41.386130 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00e722e8-c3c3-4b07-9c5d-57ccacc762cc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:41.417660 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-00e722e8-c3c3-4b07-9c5d-57ccacc762cc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049211 Apr 05 12:00:41.417940 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5aeb1e2f-39b3-4651-b3cf-8d2c8a1082d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049584 Apr 05 12:00:41.418230 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 716/1458] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:41 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:41.418688 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 743/1459] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:41 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:41.423624 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b71a5e44-bcf0-48bc-b515-b3a3ff066e64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:41.424566 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b71a5e44-bcf0-48bc-b515-b3a3ff066e64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:41.430707 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b71a5e44-bcf0-48bc-b515-b3a3ff066e64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:41.431165 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b71a5e44-bcf0-48bc-b515-b3a3ff066e64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:41.431930 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b71a5e44-bcf0-48bc-b515-b3a3ff066e64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:41.432398 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b71a5e44-bcf0-48bc-b515-b3a3ff066e64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:41.461417 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b71a5e44-bcf0-48bc-b515-b3a3ff066e64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041592 Apr 05 12:00:41.461970 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 717/1460] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:41 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:42.429155 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2085080b-e75d-4770-95a9-267b4a399de8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:42.429880 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-668d9a64-f256-4d7c-96ed-fb50202d20d1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:42.430274 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2085080b-e75d-4770-95a9-267b4a399de8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:42.430382 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-668d9a64-f256-4d7c-96ed-fb50202d20d1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:42.436629 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-668d9a64-f256-4d7c-96ed-fb50202d20d1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:42.436825 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2085080b-e75d-4770-95a9-267b4a399de8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:42.437043 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2085080b-e75d-4770-95a9-267b4a399de8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:42.437167 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-668d9a64-f256-4d7c-96ed-fb50202d20d1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:42.437836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2085080b-e75d-4770-95a9-267b4a399de8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:42.437979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-668d9a64-f256-4d7c-96ed-fb50202d20d1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:42.438260 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2085080b-e75d-4770-95a9-267b4a399de8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:42.438418 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-668d9a64-f256-4d7c-96ed-fb50202d20d1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:42.467554 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2085080b-e75d-4770-95a9-267b4a399de8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042233 Apr 05 12:00:42.467812 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-668d9a64-f256-4d7c-96ed-fb50202d20d1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042448 Apr 05 12:00:42.468359 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 744/1461] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:42 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:42.468688 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 718/1462] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:42 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:42.473212 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b63db1aa-2483-4c40-871b-716a5f587932 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:42.474110 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b63db1aa-2483-4c40-871b-716a5f587932 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:42.480031 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b63db1aa-2483-4c40-871b-716a5f587932 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:42.480515 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b63db1aa-2483-4c40-871b-716a5f587932 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:42.481279 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b63db1aa-2483-4c40-871b-716a5f587932 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:42.481711 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b63db1aa-2483-4c40-871b-716a5f587932 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:42.510012 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b63db1aa-2483-4c40-871b-716a5f587932 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040608 Apr 05 12:00:42.510573 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 745/1463] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:42 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:43.483019 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-07daad48-546a-4935-8858-a0390e09d675 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:43.483941 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b2ccb00d-d4d9-49a0-867a-94acdabcba41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:43.484592 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b2ccb00d-d4d9-49a0-867a-94acdabcba41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:43.484689 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-07daad48-546a-4935-8858-a0390e09d675 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:43.492110 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-07daad48-546a-4935-8858-a0390e09d675 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:43.492277 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b2ccb00d-d4d9-49a0-867a-94acdabcba41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:43.492470 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-07daad48-546a-4935-8858-a0390e09d675 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:43.492595 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b2ccb00d-d4d9-49a0-867a-94acdabcba41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:43.493278 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-07daad48-546a-4935-8858-a0390e09d675 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:43.493441 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b2ccb00d-d4d9-49a0-867a-94acdabcba41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:43.494051 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-07daad48-546a-4935-8858-a0390e09d675 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:43.494134 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b2ccb00d-d4d9-49a0-867a-94acdabcba41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:43.523304 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-07daad48-546a-4935-8858-a0390e09d675 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047254 Apr 05 12:00:43.523529 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b2ccb00d-d4d9-49a0-867a-94acdabcba41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047325 Apr 05 12:00:43.523850 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 746/1464] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:43 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:43.524002 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 719/1465] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:43 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:43.528728 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-84eee7bd-0ec9-4cb1-b429-bfde0b6a268a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:43.529634 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-84eee7bd-0ec9-4cb1-b429-bfde0b6a268a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:43.535314 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84eee7bd-0ec9-4cb1-b429-bfde0b6a268a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:43.535766 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84eee7bd-0ec9-4cb1-b429-bfde0b6a268a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:43.536543 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84eee7bd-0ec9-4cb1-b429-bfde0b6a268a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:43.536976 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84eee7bd-0ec9-4cb1-b429-bfde0b6a268a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:43.564585 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-84eee7bd-0ec9-4cb1-b429-bfde0b6a268a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039733 Apr 05 12:00:43.565164 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 747/1466] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:43 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:44.536520 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a722230d-a1fd-4298-9558-a5cb183cf63a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:44.537028 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2683ccc0-80ad-4627-b234-a41c0152dcc7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:44.537387 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a722230d-a1fd-4298-9558-a5cb183cf63a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:44.537471 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2683ccc0-80ad-4627-b234-a41c0152dcc7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:44.544033 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a722230d-a1fd-4298-9558-a5cb183cf63a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:44.544234 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2683ccc0-80ad-4627-b234-a41c0152dcc7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:44.544511 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a722230d-a1fd-4298-9558-a5cb183cf63a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:44.544656 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2683ccc0-80ad-4627-b234-a41c0152dcc7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:44.545268 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a722230d-a1fd-4298-9558-a5cb183cf63a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:44.545414 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2683ccc0-80ad-4627-b234-a41c0152dcc7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:44.545700 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a722230d-a1fd-4298-9558-a5cb183cf63a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:44.545862 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2683ccc0-80ad-4627-b234-a41c0152dcc7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:44.575591 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a722230d-a1fd-4298-9558-a5cb183cf63a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043743 Apr 05 12:00:44.575786 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2683ccc0-80ad-4627-b234-a41c0152dcc7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043666 Apr 05 12:00:44.576051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 720/1467] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:44 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:44.576461 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 748/1468] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:44 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:44.580617 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9e4709fc-06a5-49f4-8a94-54a92a43007c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:44.581514 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9e4709fc-06a5-49f4-8a94-54a92a43007c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:44.587729 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9e4709fc-06a5-49f4-8a94-54a92a43007c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:44.588218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9e4709fc-06a5-49f4-8a94-54a92a43007c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:44.589006 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9e4709fc-06a5-49f4-8a94-54a92a43007c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:44.589440 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9e4709fc-06a5-49f4-8a94-54a92a43007c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:44.617924 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9e4709fc-06a5-49f4-8a94-54a92a43007c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040859 Apr 05 12:00:44.618482 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 721/1469] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:44 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:45.591433 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-52f22e06-9fb6-4dab-ac61-dd851ea40710 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:45.592992 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-52f22e06-9fb6-4dab-ac61-dd851ea40710 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:45.594102 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-668d95dc-5e39-4cdb-9653-baa89946e571 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:45.595616 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-668d95dc-5e39-4cdb-9653-baa89946e571 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:45.604048 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-52f22e06-9fb6-4dab-ac61-dd851ea40710 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:45.604843 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-52f22e06-9fb6-4dab-ac61-dd851ea40710 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:45.606099 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-52f22e06-9fb6-4dab-ac61-dd851ea40710 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:45.606336 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-668d95dc-5e39-4cdb-9653-baa89946e571 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:45.606818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-52f22e06-9fb6-4dab-ac61-dd851ea40710 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:45.607080 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-668d95dc-5e39-4cdb-9653-baa89946e571 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:45.608379 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-668d95dc-5e39-4cdb-9653-baa89946e571 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:45.609024 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-668d95dc-5e39-4cdb-9653-baa89946e571 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:45.639037 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-52f22e06-9fb6-4dab-ac61-dd851ea40710 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054219 Apr 05 12:00:45.639256 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-668d95dc-5e39-4cdb-9653-baa89946e571 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051707 Apr 05 12:00:45.646054 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 749/1470] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:45 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:45.646200 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 722/1471] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:45 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:45.646321 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-01e89117-4c3c-47c9-abfd-c2e664c78f05 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:45.646321 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-01e89117-4c3c-47c9-abfd-c2e664c78f05 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:45.650907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-01e89117-4c3c-47c9-abfd-c2e664c78f05 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:45.651367 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-01e89117-4c3c-47c9-abfd-c2e664c78f05 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:45.652110 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-01e89117-4c3c-47c9-abfd-c2e664c78f05 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:45.652583 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-01e89117-4c3c-47c9-abfd-c2e664c78f05 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:45.680358 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-01e89117-4c3c-47c9-abfd-c2e664c78f05 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039425 Apr 05 12:00:45.680867 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 750/1472] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:45 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:46.654888 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7ee21a40-d7dc-4422-848d-c874e7086f86 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:46.656419 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7ee21a40-d7dc-4422-848d-c874e7086f86 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:46.657806 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-08d83dea-949f-47da-a310-09e25c560975 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:46.659283 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-08d83dea-949f-47da-a310-09e25c560975 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:46.664962 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7ee21a40-d7dc-4422-848d-c874e7086f86 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:46.665392 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7ee21a40-d7dc-4422-848d-c874e7086f86 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:46.666213 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7ee21a40-d7dc-4422-848d-c874e7086f86 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:46.666633 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7ee21a40-d7dc-4422-848d-c874e7086f86 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:46.667189 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-08d83dea-949f-47da-a310-09e25c560975 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:46.667631 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-08d83dea-949f-47da-a310-09e25c560975 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:46.668436 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-08d83dea-949f-47da-a310-09e25c560975 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:46.668877 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-08d83dea-949f-47da-a310-09e25c560975 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:46.697650 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7ee21a40-d7dc-4422-848d-c874e7086f86 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049361 Apr 05 12:00:46.697904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-08d83dea-949f-47da-a310-09e25c560975 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046597 Apr 05 12:00:46.698466 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 723/1473] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:46 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:46.699162 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 751/1474] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:46 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:46.703860 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-624cdcff-7ab6-4a2a-95a3-d9ca75536857 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:46.704799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-624cdcff-7ab6-4a2a-95a3-d9ca75536857 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:46.710891 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-624cdcff-7ab6-4a2a-95a3-d9ca75536857 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:46.711326 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-624cdcff-7ab6-4a2a-95a3-d9ca75536857 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:46.712117 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-624cdcff-7ab6-4a2a-95a3-d9ca75536857 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:46.712534 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-624cdcff-7ab6-4a2a-95a3-d9ca75536857 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:46.740533 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-624cdcff-7ab6-4a2a-95a3-d9ca75536857 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041194 Apr 05 12:00:46.741070 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 724/1475] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:46 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:47.710989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-57ab4b13-7961-4535-9fac-35a5d475dc06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:47.711635 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1486cfb0-8792-45de-8a96-a04ef82efa5e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:47.712028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1486cfb0-8792-45de-8a96-a04ef82efa5e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:47.712157 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-57ab4b13-7961-4535-9fac-35a5d475dc06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:47.718431 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-57ab4b13-7961-4535-9fac-35a5d475dc06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:47.718594 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1486cfb0-8792-45de-8a96-a04ef82efa5e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:47.718873 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-57ab4b13-7961-4535-9fac-35a5d475dc06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:47.718995 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1486cfb0-8792-45de-8a96-a04ef82efa5e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:47.719625 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-57ab4b13-7961-4535-9fac-35a5d475dc06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:47.719736 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1486cfb0-8792-45de-8a96-a04ef82efa5e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:47.720051 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-57ab4b13-7961-4535-9fac-35a5d475dc06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:47.720178 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1486cfb0-8792-45de-8a96-a04ef82efa5e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:47.749226 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1486cfb0-8792-45de-8a96-a04ef82efa5e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042725 Apr 05 12:00:47.749724 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 725/1476] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:47 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:47.750132 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-57ab4b13-7961-4535-9fac-35a5d475dc06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043860 Apr 05 12:00:47.750954 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 752/1477] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:47 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:47.757306 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6bb64d72-8d77-4c6f-91bb-4a728173b3ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:47.758215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6bb64d72-8d77-4c6f-91bb-4a728173b3ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:47.764034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6bb64d72-8d77-4c6f-91bb-4a728173b3ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:47.764528 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6bb64d72-8d77-4c6f-91bb-4a728173b3ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:47.765292 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6bb64d72-8d77-4c6f-91bb-4a728173b3ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:47.765730 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6bb64d72-8d77-4c6f-91bb-4a728173b3ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:47.793445 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6bb64d72-8d77-4c6f-91bb-4a728173b3ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042738 Apr 05 12:00:47.793985 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 726/1478] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:47 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:48.764938 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8e9862a9-eba1-4ef6-abf2-60075473a855 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:48.766468 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-448b3bbf-e314-4e81-a40a-7c178a6a1b89 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:48.767189 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8e9862a9-eba1-4ef6-abf2-60075473a855 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:48.767941 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-448b3bbf-e314-4e81-a40a-7c178a6a1b89 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:48.775406 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e9862a9-eba1-4ef6-abf2-60075473a855 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:48.775859 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e9862a9-eba1-4ef6-abf2-60075473a855 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:48.776103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-448b3bbf-e314-4e81-a40a-7c178a6a1b89 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:48.776605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-448b3bbf-e314-4e81-a40a-7c178a6a1b89 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:48.776755 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e9862a9-eba1-4ef6-abf2-60075473a855 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:48.777091 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e9862a9-eba1-4ef6-abf2-60075473a855 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:48.777374 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-448b3bbf-e314-4e81-a40a-7c178a6a1b89 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:48.777808 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-448b3bbf-e314-4e81-a40a-7c178a6a1b89 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:48.806725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8e9862a9-eba1-4ef6-abf2-60075473a855 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048382 Apr 05 12:00:48.807096 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-448b3bbf-e314-4e81-a40a-7c178a6a1b89 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047360 Apr 05 12:00:48.807571 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 753/1479] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:48 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:48.807891 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 727/1480] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:48 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:48.812106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-062412f4-a970-495b-87e1-db37fd84fd8d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:48.813050 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-062412f4-a970-495b-87e1-db37fd84fd8d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:48.819302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-062412f4-a970-495b-87e1-db37fd84fd8d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:48.819752 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-062412f4-a970-495b-87e1-db37fd84fd8d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:48.820555 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-062412f4-a970-495b-87e1-db37fd84fd8d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:48.820961 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-062412f4-a970-495b-87e1-db37fd84fd8d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:48.849166 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-062412f4-a970-495b-87e1-db37fd84fd8d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040759 Apr 05 12:00:48.849747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 754/1481] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:48 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:49.819135 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-edef5d9c-665f-4561-bdb7-0c2b5e2d7687 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:49.820042 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-edef5d9c-665f-4561-bdb7-0c2b5e2d7687 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:49.821530 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-93608822-eb86-446d-8e9d-7b3b17504177 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:49.823003 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-93608822-eb86-446d-8e9d-7b3b17504177 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:49.826848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-edef5d9c-665f-4561-bdb7-0c2b5e2d7687 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:49.827301 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-edef5d9c-665f-4561-bdb7-0c2b5e2d7687 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:49.828127 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-edef5d9c-665f-4561-bdb7-0c2b5e2d7687 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:49.828587 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-edef5d9c-665f-4561-bdb7-0c2b5e2d7687 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:49.829560 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-93608822-eb86-446d-8e9d-7b3b17504177 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:49.830008 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-93608822-eb86-446d-8e9d-7b3b17504177 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:49.830872 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-93608822-eb86-446d-8e9d-7b3b17504177 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:49.831195 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-93608822-eb86-446d-8e9d-7b3b17504177 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:49.858761 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-edef5d9c-665f-4561-bdb7-0c2b5e2d7687 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043679 Apr 05 12:00:49.859480 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 728/1482] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:49 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:49.862718 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-93608822-eb86-446d-8e9d-7b3b17504177 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045073 Apr 05 12:00:49.866705 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 755/1483] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:49 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:49.866866 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-71c3a298-4c39-4ce4-83e1-0b6e46d72581 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:49.866866 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-71c3a298-4c39-4ce4-83e1-0b6e46d72581 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:49.871094 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-71c3a298-4c39-4ce4-83e1-0b6e46d72581 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:49.871542 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-71c3a298-4c39-4ce4-83e1-0b6e46d72581 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:49.872341 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-71c3a298-4c39-4ce4-83e1-0b6e46d72581 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:49.872779 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-71c3a298-4c39-4ce4-83e1-0b6e46d72581 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:49.900623 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-71c3a298-4c39-4ce4-83e1-0b6e46d72581 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040000 Apr 05 12:00:49.901166 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 729/1484] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:49 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:50.873514 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a586f620-739b-46cf-a48f-193b90b3831b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:50.874980 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a586f620-739b-46cf-a48f-193b90b3831b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:50.877449 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-38b92152-33a0-4465-b36f-306684a78961 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:50.879502 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-38b92152-33a0-4465-b36f-306684a78961 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:50.884952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a586f620-739b-46cf-a48f-193b90b3831b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:50.885600 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a586f620-739b-46cf-a48f-193b90b3831b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:50.886754 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a586f620-739b-46cf-a48f-193b90b3831b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:50.887406 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a586f620-739b-46cf-a48f-193b90b3831b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:50.889017 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-38b92152-33a0-4465-b36f-306684a78961 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:50.889714 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-38b92152-33a0-4465-b36f-306684a78961 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:50.890888 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-38b92152-33a0-4465-b36f-306684a78961 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:50.891554 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-38b92152-33a0-4465-b36f-306684a78961 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:50.921313 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a586f620-739b-46cf-a48f-193b90b3831b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054108 Apr 05 12:00:50.923332 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 756/1485] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:50 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:50.923488 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-38b92152-33a0-4465-b36f-306684a78961 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051078 Apr 05 12:00:50.923488 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 730/1486] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:50 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:50.929319 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-92cb3520-6b13-4288-aa3c-512c68c6f4ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:50.930234 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-92cb3520-6b13-4288-aa3c-512c68c6f4ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:50.936439 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92cb3520-6b13-4288-aa3c-512c68c6f4ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:50.936886 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92cb3520-6b13-4288-aa3c-512c68c6f4ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:50.937643 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92cb3520-6b13-4288-aa3c-512c68c6f4ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:50.938077 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92cb3520-6b13-4288-aa3c-512c68c6f4ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:50.969707 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-92cb3520-6b13-4288-aa3c-512c68c6f4ee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046496 Apr 05 12:00:50.970780 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 757/1487] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:50 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:51.937670 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d631b0e4-a217-4946-a164-16b4410f3b85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:51.939060 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6319b65b-b811-4c95-8692-ea2ab021af92 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:51.939810 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d631b0e4-a217-4946-a164-16b4410f3b85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:51.940572 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6319b65b-b811-4c95-8692-ea2ab021af92 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:51.947908 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d631b0e4-a217-4946-a164-16b4410f3b85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:51.948380 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d631b0e4-a217-4946-a164-16b4410f3b85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:51.948621 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6319b65b-b811-4c95-8692-ea2ab021af92 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:51.949067 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6319b65b-b811-4c95-8692-ea2ab021af92 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:51.949230 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d631b0e4-a217-4946-a164-16b4410f3b85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:51.949565 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d631b0e4-a217-4946-a164-16b4410f3b85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:51.949825 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6319b65b-b811-4c95-8692-ea2ab021af92 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:51.950241 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6319b65b-b811-4c95-8692-ea2ab021af92 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:51.979683 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d631b0e4-a217-4946-a164-16b4410f3b85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048360 Apr 05 12:00:51.979940 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6319b65b-b811-4c95-8692-ea2ab021af92 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047667 Apr 05 12:00:51.980525 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 731/1488] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:51 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:51.980677 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 758/1489] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:51 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:51.984963 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3b3aed91-411a-4b06-b9cd-d2f22177ab96 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:51.985867 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3b3aed91-411a-4b06-b9cd-d2f22177ab96 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:51.992024 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b3aed91-411a-4b06-b9cd-d2f22177ab96 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:51.992524 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b3aed91-411a-4b06-b9cd-d2f22177ab96 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:51.993316 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b3aed91-411a-4b06-b9cd-d2f22177ab96 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:51.993754 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b3aed91-411a-4b06-b9cd-d2f22177ab96 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:52.022819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3b3aed91-411a-4b06-b9cd-d2f22177ab96 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041498 Apr 05 12:00:52.023302 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 732/1490] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:51 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:52.992171 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4b0a9a33-7163-47e1-ba56-2ad1ade7f8a1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:52.993850 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4b0a9a33-7163-47e1-ba56-2ad1ade7f8a1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:52.997216 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-641b091c-a428-4b96-92fe-6b817a5ac63f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:52.998858 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-641b091c-a428-4b96-92fe-6b817a5ac63f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:53.001476 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4b0a9a33-7163-47e1-ba56-2ad1ade7f8a1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:53.002054 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4b0a9a33-7163-47e1-ba56-2ad1ade7f8a1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:53.003008 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4b0a9a33-7163-47e1-ba56-2ad1ade7f8a1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:53.003494 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4b0a9a33-7163-47e1-ba56-2ad1ade7f8a1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:53.006415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-641b091c-a428-4b96-92fe-6b817a5ac63f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:53.006892 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-641b091c-a428-4b96-92fe-6b817a5ac63f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:53.007657 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-641b091c-a428-4b96-92fe-6b817a5ac63f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:53.008107 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-641b091c-a428-4b96-92fe-6b817a5ac63f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:53.033796 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4b0a9a33-7163-47e1-ba56-2ad1ade7f8a1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046446 Apr 05 12:00:53.034356 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 759/1491] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:52 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:53.039060 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ffed40da-5e4b-4309-97d5-556868dbaade tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:53.039961 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ffed40da-5e4b-4309-97d5-556868dbaade tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:53.042769 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-641b091c-a428-4b96-92fe-6b817a5ac63f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051200 Apr 05 12:00:53.043410 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 733/1492] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:52 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:53.046741 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ffed40da-5e4b-4309-97d5-556868dbaade tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:53.046741 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ffed40da-5e4b-4309-97d5-556868dbaade tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:53.046983 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ffed40da-5e4b-4309-97d5-556868dbaade tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:53.047333 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ffed40da-5e4b-4309-97d5-556868dbaade tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:53.076396 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ffed40da-5e4b-4309-97d5-556868dbaade tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040791 Apr 05 12:00:53.076958 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 760/1493] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:53 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:53.724274 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:00:53.724556 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Tue Apr 5 12:00:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:00:54.050423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-680f2bd3-f645-41c7-b766-08886e170bff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:54.051799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-680f2bd3-f645-41c7-b766-08886e170bff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:54.060142 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-58d16264-011c-4824-8187-ceda400fa093 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:54.061672 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-58d16264-011c-4824-8187-ceda400fa093 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:54.061948 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-680f2bd3-f645-41c7-b766-08886e170bff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:54.062738 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-680f2bd3-f645-41c7-b766-08886e170bff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:54.063962 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-680f2bd3-f645-41c7-b766-08886e170bff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:54.064726 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-680f2bd3-f645-41c7-b766-08886e170bff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:54.071360 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-58d16264-011c-4824-8187-ceda400fa093 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:54.071798 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-58d16264-011c-4824-8187-ceda400fa093 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:54.072676 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-58d16264-011c-4824-8187-ceda400fa093 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:54.073103 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-58d16264-011c-4824-8187-ceda400fa093 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:54.095775 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-680f2bd3-f645-41c7-b766-08886e170bff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052501 Apr 05 12:00:54.096371 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 734/1494] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:54 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:54.100816 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-44481deb-2477-4850-b7c8-22bed6b918da tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:54.101780 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-44481deb-2477-4850-b7c8-22bed6b918da tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:54.102420 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-58d16264-011c-4824-8187-ceda400fa093 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049352 Apr 05 12:00:54.102974 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 761/1495] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:54 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:54.107872 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-44481deb-2477-4850-b7c8-22bed6b918da tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:54.108349 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-44481deb-2477-4850-b7c8-22bed6b918da tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:54.109138 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-44481deb-2477-4850-b7c8-22bed6b918da tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:54.109622 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-44481deb-2477-4850-b7c8-22bed6b918da tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:54.137799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-44481deb-2477-4850-b7c8-22bed6b918da tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040453 Apr 05 12:00:54.138306 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 735/1496] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:54 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:55.112499 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-92bc08d4-bf96-498f-a138-354d1c47855c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:55.113829 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-92bc08d4-bf96-498f-a138-354d1c47855c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:55.118328 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cf49c145-bc90-4831-8ef8-65087ce91f8d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:55.119828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cf49c145-bc90-4831-8ef8-65087ce91f8d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:55.124618 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92bc08d4-bf96-498f-a138-354d1c47855c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:55.125355 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92bc08d4-bf96-498f-a138-354d1c47855c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:55.126602 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92bc08d4-bf96-498f-a138-354d1c47855c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:55.127315 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92bc08d4-bf96-498f-a138-354d1c47855c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:55.130272 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cf49c145-bc90-4831-8ef8-65087ce91f8d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:55.131070 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cf49c145-bc90-4831-8ef8-65087ce91f8d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:55.132412 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cf49c145-bc90-4831-8ef8-65087ce91f8d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:55.133001 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cf49c145-bc90-4831-8ef8-65087ce91f8d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:55.161276 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-92bc08d4-bf96-498f-a138-354d1c47855c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055345 Apr 05 12:00:55.162068 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 762/1497] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:55 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:55.165174 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cf49c145-bc90-4831-8ef8-65087ce91f8d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053514 Apr 05 12:00:55.165761 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 736/1498] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:55 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:55.167120 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c72fd52c-4685-476b-be24-a171432571c0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:55.168032 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c72fd52c-4685-476b-be24-a171432571c0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:55.173987 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c72fd52c-4685-476b-be24-a171432571c0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:55.174469 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c72fd52c-4685-476b-be24-a171432571c0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:55.175230 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c72fd52c-4685-476b-be24-a171432571c0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:55.175661 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c72fd52c-4685-476b-be24-a171432571c0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:55.203558 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c72fd52c-4685-476b-be24-a171432571c0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040514 Apr 05 12:00:55.204101 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 763/1499] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:55 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:56.177600 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bca1f839-9d5a-41f3-a652-e92f1744459e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:56.179128 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bca1f839-9d5a-41f3-a652-e92f1744459e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:56.180450 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1920809f-2ac4-4395-bec2-34d176fb845d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:56.181767 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1920809f-2ac4-4395-bec2-34d176fb845d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:56.185740 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bca1f839-9d5a-41f3-a652-e92f1744459e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:56.186200 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bca1f839-9d5a-41f3-a652-e92f1744459e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:56.186969 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bca1f839-9d5a-41f3-a652-e92f1744459e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:56.187400 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bca1f839-9d5a-41f3-a652-e92f1744459e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:56.187997 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1920809f-2ac4-4395-bec2-34d176fb845d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:56.188488 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1920809f-2ac4-4395-bec2-34d176fb845d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:56.189264 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1920809f-2ac4-4395-bec2-34d176fb845d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:56.189702 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1920809f-2ac4-4395-bec2-34d176fb845d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:56.216805 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bca1f839-9d5a-41f3-a652-e92f1744459e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045810 Apr 05 12:00:56.217281 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 737/1500] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:56 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:56.219043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1920809f-2ac4-4395-bec2-34d176fb845d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044838 Apr 05 12:00:56.222867 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 764/1501] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:56 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:56.223010 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7380e32a-d34c-4580-ae27-9b80595b18fa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:56.223010 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7380e32a-d34c-4580-ae27-9b80595b18fa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:56.228781 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7380e32a-d34c-4580-ae27-9b80595b18fa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:56.229225 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7380e32a-d34c-4580-ae27-9b80595b18fa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:56.230354 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7380e32a-d34c-4580-ae27-9b80595b18fa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:56.230786 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7380e32a-d34c-4580-ae27-9b80595b18fa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:56.258605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7380e32a-d34c-4580-ae27-9b80595b18fa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040374 Apr 05 12:00:56.259147 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 738/1502] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:56 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:57.231134 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e301abc6-5385-4ede-8673-c0d08e0caf9a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:57.232190 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e301abc6-5385-4ede-8673-c0d08e0caf9a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:57.233339 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e75fc849-3249-4d49-9775-240d3c852123 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:57.234353 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e75fc849-3249-4d49-9775-240d3c852123 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:57.239563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e301abc6-5385-4ede-8673-c0d08e0caf9a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:57.240059 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e301abc6-5385-4ede-8673-c0d08e0caf9a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:57.240941 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e301abc6-5385-4ede-8673-c0d08e0caf9a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:57.241419 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e301abc6-5385-4ede-8673-c0d08e0caf9a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:57.241579 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e75fc849-3249-4d49-9775-240d3c852123 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:57.242049 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e75fc849-3249-4d49-9775-240d3c852123 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:57.242894 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e75fc849-3249-4d49-9775-240d3c852123 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:57.243381 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e75fc849-3249-4d49-9775-240d3c852123 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:57.272577 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e301abc6-5385-4ede-8673-c0d08e0caf9a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047394 Apr 05 12:00:57.273140 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 765/1503] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:57 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:57.273756 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e75fc849-3249-4d49-9775-240d3c852123 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045688 Apr 05 12:00:57.274505 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 739/1504] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:57 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:57.280130 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-95a78133-bd3c-4d89-9cb7-7353890807c7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:57.280985 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-95a78133-bd3c-4d89-9cb7-7353890807c7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:57.287054 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95a78133-bd3c-4d89-9cb7-7353890807c7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:57.287500 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95a78133-bd3c-4d89-9cb7-7353890807c7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:57.288375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95a78133-bd3c-4d89-9cb7-7353890807c7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:57.288832 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95a78133-bd3c-4d89-9cb7-7353890807c7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:57.316797 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-95a78133-bd3c-4d89-9cb7-7353890807c7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042697 Apr 05 12:00:57.317334 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 766/1505] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:57 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:58.288485 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4e72c833-a508-4e81-bbe0-6b991fcf28e0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:58.289371 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4ba7d4ba-df33-4db1-ad47-45d7e6a0336d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:58.289985 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4e72c833-a508-4e81-bbe0-6b991fcf28e0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:58.290771 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4ba7d4ba-df33-4db1-ad47-45d7e6a0336d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:58.300531 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4e72c833-a508-4e81-bbe0-6b991fcf28e0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:58.301197 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4ba7d4ba-df33-4db1-ad47-45d7e6a0336d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:58.301437 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4e72c833-a508-4e81-bbe0-6b991fcf28e0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:58.301938 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4ba7d4ba-df33-4db1-ad47-45d7e6a0336d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:58.302540 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4e72c833-a508-4e81-bbe0-6b991fcf28e0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:58.303170 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4ba7d4ba-df33-4db1-ad47-45d7e6a0336d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:58.303407 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4e72c833-a508-4e81-bbe0-6b991fcf28e0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:58.303829 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4ba7d4ba-df33-4db1-ad47-45d7e6a0336d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:58.333891 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4e72c833-a508-4e81-bbe0-6b991fcf28e0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052068 Apr 05 12:00:58.334290 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4ba7d4ba-df33-4db1-ad47-45d7e6a0336d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051494 Apr 05 12:00:58.334475 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 740/1506] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:58 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:58.338186 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 767/1507] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:58 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:58.339190 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-701a64b5-2f37-433e-b789-a1a4519037c4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:58.340157 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-701a64b5-2f37-433e-b789-a1a4519037c4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:58.345859 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-701a64b5-2f37-433e-b789-a1a4519037c4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:58.346318 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-701a64b5-2f37-433e-b789-a1a4519037c4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:58.347082 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-701a64b5-2f37-433e-b789-a1a4519037c4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:58.347523 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-701a64b5-2f37-433e-b789-a1a4519037c4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:58.377330 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-701a64b5-2f37-433e-b789-a1a4519037c4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041867 Apr 05 12:00:58.377891 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 741/1508] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:58 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:59.349418 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-625c94d0-b0f2-4458-83c4-c9985967cff3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:59.350280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-720dfd38-87ec-4688-8d69-3b5d764f5240 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:59.350859 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-625c94d0-b0f2-4458-83c4-c9985967cff3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:59.351018 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-720dfd38-87ec-4688-8d69-3b5d764f5240 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:59.358913 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-720dfd38-87ec-4688-8d69-3b5d764f5240 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:59.359073 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-625c94d0-b0f2-4458-83c4-c9985967cff3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:59.359356 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-625c94d0-b0f2-4458-83c4-c9985967cff3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:59.359499 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-720dfd38-87ec-4688-8d69-3b5d764f5240 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:59.360135 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-625c94d0-b0f2-4458-83c4-c9985967cff3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:59.360272 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-720dfd38-87ec-4688-8d69-3b5d764f5240 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:59.360589 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-625c94d0-b0f2-4458-83c4-c9985967cff3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:59.360726 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-720dfd38-87ec-4688-8d69-3b5d764f5240 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:59.390311 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-625c94d0-b0f2-4458-83c4-c9985967cff3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047243 Apr 05 12:00:59.390891 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 768/1509] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:59 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:59.391010 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-720dfd38-87ec-4688-8d69-3b5d764f5240 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047863 Apr 05 12:00:59.391637 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 742/1510] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:00:59 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:59.395658 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a7c1e159-ef5b-425a-81d4-6402a70e2e81 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:00:59.396632 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a7c1e159-ef5b-425a-81d4-6402a70e2e81 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:00:59.402572 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7c1e159-ef5b-425a-81d4-6402a70e2e81 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:59.403010 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7c1e159-ef5b-425a-81d4-6402a70e2e81 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:59.403781 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7c1e159-ef5b-425a-81d4-6402a70e2e81 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:00:59.404247 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7c1e159-ef5b-425a-81d4-6402a70e2e81 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:00:59.431930 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a7c1e159-ef5b-425a-81d4-6402a70e2e81 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040016 Apr 05 12:00:59.432543 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 769/1511] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:00:59 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:00.404583 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ac217db0-b46a-420d-88eb-f352d4434f97 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:00.405367 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3ce72a96-694d-4a27-840b-550903fdbbdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:00.405775 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ac217db0-b46a-420d-88eb-f352d4434f97 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:00.405870 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3ce72a96-694d-4a27-840b-550903fdbbdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:00.412963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ac217db0-b46a-420d-88eb-f352d4434f97 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:00.413150 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3ce72a96-694d-4a27-840b-550903fdbbdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:00.413480 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ac217db0-b46a-420d-88eb-f352d4434f97 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:00.413656 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3ce72a96-694d-4a27-840b-550903fdbbdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:00.414306 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ac217db0-b46a-420d-88eb-f352d4434f97 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:00.414468 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3ce72a96-694d-4a27-840b-550903fdbbdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:00.414777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ac217db0-b46a-420d-88eb-f352d4434f97 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:00.414953 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3ce72a96-694d-4a27-840b-550903fdbbdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:00.446235 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ac217db0-b46a-420d-88eb-f352d4434f97 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046706 Apr 05 12:01:00.447030 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 770/1512] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:00 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:00.448001 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3ce72a96-694d-4a27-840b-550903fdbbdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048535 Apr 05 12:01:00.448726 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 743/1513] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:00 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:00.451378 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4c9a8538-d1f8-416d-ad04-8a56d086ea50 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:00.452335 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4c9a8538-d1f8-416d-ad04-8a56d086ea50 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:00.458313 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4c9a8538-d1f8-416d-ad04-8a56d086ea50 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:00.458699 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4c9a8538-d1f8-416d-ad04-8a56d086ea50 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:00.459468 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4c9a8538-d1f8-416d-ad04-8a56d086ea50 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:00.459901 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4c9a8538-d1f8-416d-ad04-8a56d086ea50 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:00.488600 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4c9a8538-d1f8-416d-ad04-8a56d086ea50 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040768 Apr 05 12:01:00.489146 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 771/1514] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:00 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:01.462629 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1ad7bdd7-3424-43fa-844c-7957f9ed815c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:01.463721 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-14f85833-2083-4c59-8494-4ae8d99c49df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:01.464146 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1ad7bdd7-3424-43fa-844c-7957f9ed815c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:01.464261 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-14f85833-2083-4c59-8494-4ae8d99c49df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:01.470755 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ad7bdd7-3424-43fa-844c-7957f9ed815c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:01.470912 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14f85833-2083-4c59-8494-4ae8d99c49df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:01.471203 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14f85833-2083-4c59-8494-4ae8d99c49df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:01.471366 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ad7bdd7-3424-43fa-844c-7957f9ed815c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:01.471969 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14f85833-2083-4c59-8494-4ae8d99c49df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:01.472139 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ad7bdd7-3424-43fa-844c-7957f9ed815c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:01.472437 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ad7bdd7-3424-43fa-844c-7957f9ed815c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:01.472614 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14f85833-2083-4c59-8494-4ae8d99c49df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:01.503541 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-14f85833-2083-4c59-8494-4ae8d99c49df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047369 Apr 05 12:01:01.503958 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1ad7bdd7-3424-43fa-844c-7957f9ed815c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048033 Apr 05 12:01:01.504411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 772/1515] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:01 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:01.507779 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 744/1516] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:01 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:01.508772 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a918de07-da49-4e18-81be-c3c344e2727e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:01.509674 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a918de07-da49-4e18-81be-c3c344e2727e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:01.515446 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a918de07-da49-4e18-81be-c3c344e2727e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:01.515890 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a918de07-da49-4e18-81be-c3c344e2727e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:01.516675 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a918de07-da49-4e18-81be-c3c344e2727e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:01.517098 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a918de07-da49-4e18-81be-c3c344e2727e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:01.544609 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a918de07-da49-4e18-81be-c3c344e2727e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039232 Apr 05 12:01:01.545077 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 773/1517] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:01 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:02.516538 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3d0cd14e-431f-43fe-8eb6-c2b9f23a6d4b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:02.517166 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8f0584b9-489e-42d2-bb21-1948aa84de13 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:02.517566 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8f0584b9-489e-42d2-bb21-1948aa84de13 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:02.517672 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3d0cd14e-431f-43fe-8eb6-c2b9f23a6d4b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:02.524630 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f0584b9-489e-42d2-bb21-1948aa84de13 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:02.524809 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3d0cd14e-431f-43fe-8eb6-c2b9f23a6d4b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:02.525122 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3d0cd14e-431f-43fe-8eb6-c2b9f23a6d4b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:02.525287 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f0584b9-489e-42d2-bb21-1948aa84de13 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:02.525914 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3d0cd14e-431f-43fe-8eb6-c2b9f23a6d4b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:02.526064 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f0584b9-489e-42d2-bb21-1948aa84de13 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:02.526362 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3d0cd14e-431f-43fe-8eb6-c2b9f23a6d4b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:02.526532 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f0584b9-489e-42d2-bb21-1948aa84de13 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:02.556686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8f0584b9-489e-42d2-bb21-1948aa84de13 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044283 Apr 05 12:01:02.557222 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 745/1518] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:02 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:02.557369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3d0cd14e-431f-43fe-8eb6-c2b9f23a6d4b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044693 Apr 05 12:01:02.558006 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 774/1519] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:02 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:02.561767 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6ad91bf8-be80-4717-8c8d-5834f13d70b8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:02.562688 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6ad91bf8-be80-4717-8c8d-5834f13d70b8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:02.568519 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6ad91bf8-be80-4717-8c8d-5834f13d70b8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:02.568959 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6ad91bf8-be80-4717-8c8d-5834f13d70b8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:02.569725 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6ad91bf8-be80-4717-8c8d-5834f13d70b8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:02.570149 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6ad91bf8-be80-4717-8c8d-5834f13d70b8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:02.597862 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6ad91bf8-be80-4717-8c8d-5834f13d70b8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039633 Apr 05 12:01:02.598400 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 746/1520] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:02 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:03.573411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f2afe9fa-bc5b-4deb-87f9-371ea8b4a993 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:03.574215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-60e027ef-848a-4037-baa0-4ecca7e7288e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:03.574857 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-60e027ef-848a-4037-baa0-4ecca7e7288e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:03.575031 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f2afe9fa-bc5b-4deb-87f9-371ea8b4a993 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:03.585239 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f2afe9fa-bc5b-4deb-87f9-371ea8b4a993 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:03.585491 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-60e027ef-848a-4037-baa0-4ecca7e7288e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:03.585988 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f2afe9fa-bc5b-4deb-87f9-371ea8b4a993 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:03.586256 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-60e027ef-848a-4037-baa0-4ecca7e7288e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:03.587253 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f2afe9fa-bc5b-4deb-87f9-371ea8b4a993 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:03.587495 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-60e027ef-848a-4037-baa0-4ecca7e7288e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:03.587981 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f2afe9fa-bc5b-4deb-87f9-371ea8b4a993 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:03.588273 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-60e027ef-848a-4037-baa0-4ecca7e7288e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:03.617916 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-60e027ef-848a-4037-baa0-4ecca7e7288e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051230 Apr 05 12:01:03.618221 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f2afe9fa-bc5b-4deb-87f9-371ea8b4a993 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051592 Apr 05 12:01:03.618501 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 747/1521] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:03 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:03.618823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 775/1522] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:03 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:03.623433 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-baf55b93-4d47-48ea-a6a6-54911704d071 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:03.624358 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-baf55b93-4d47-48ea-a6a6-54911704d071 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:03.630150 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-baf55b93-4d47-48ea-a6a6-54911704d071 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:03.630641 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-baf55b93-4d47-48ea-a6a6-54911704d071 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:03.631348 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-baf55b93-4d47-48ea-a6a6-54911704d071 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:03.631774 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-baf55b93-4d47-48ea-a6a6-54911704d071 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:03.658604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-baf55b93-4d47-48ea-a6a6-54911704d071 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038809 Apr 05 12:01:03.659097 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 748/1523] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:03 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:04.633799 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-724b22d3-f66e-46fe-8157-7dab4c94d223 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:04.634856 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-68f93817-c562-47e0-a87f-d7d657efccd8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:04.635594 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-724b22d3-f66e-46fe-8157-7dab4c94d223 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:04.636362 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-68f93817-c562-47e0-a87f-d7d657efccd8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:04.642890 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-724b22d3-f66e-46fe-8157-7dab4c94d223 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:04.643332 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-724b22d3-f66e-46fe-8157-7dab4c94d223 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:04.643488 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-68f93817-c562-47e0-a87f-d7d657efccd8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:04.643846 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-68f93817-c562-47e0-a87f-d7d657efccd8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:04.644090 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-724b22d3-f66e-46fe-8157-7dab4c94d223 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:04.644547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-724b22d3-f66e-46fe-8157-7dab4c94d223 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:04.644691 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-68f93817-c562-47e0-a87f-d7d657efccd8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:04.645046 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-68f93817-c562-47e0-a87f-d7d657efccd8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:04.673986 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-68f93817-c562-47e0-a87f-d7d657efccd8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045624 Apr 05 12:01:04.674522 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 749/1524] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:04 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:04.674908 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-724b22d3-f66e-46fe-8157-7dab4c94d223 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047796 Apr 05 12:01:04.675610 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 776/1525] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:04 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:04.679327 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b356b042-ae04-430b-847e-9a093fba6eed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:04.680270 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b356b042-ae04-430b-847e-9a093fba6eed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:04.686415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b356b042-ae04-430b-847e-9a093fba6eed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:04.686868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b356b042-ae04-430b-847e-9a093fba6eed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:04.687622 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b356b042-ae04-430b-847e-9a093fba6eed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:04.688058 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b356b042-ae04-430b-847e-9a093fba6eed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:04.715996 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b356b042-ae04-430b-847e-9a093fba6eed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040469 Apr 05 12:01:04.716577 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 750/1526] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:04 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:05.689223 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1819670e-7c7a-47f2-930b-31094fad5138 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:05.690542 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1819670e-7c7a-47f2-930b-31094fad5138 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:05.699881 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1819670e-7c7a-47f2-930b-31094fad5138 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:05.700565 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1819670e-7c7a-47f2-930b-31094fad5138 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:05.701731 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1819670e-7c7a-47f2-930b-31094fad5138 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:05.702246 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1819670e-7c7a-47f2-930b-31094fad5138 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:05.734313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1819670e-7c7a-47f2-930b-31094fad5138 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050586 Apr 05 12:01:05.734898 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 751/1527] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:05 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:05.739419 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2c74bfec-66c9-4166-9d22-4ad9238efae0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:05.740344 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2c74bfec-66c9-4166-9d22-4ad9238efae0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:05.745957 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2c74bfec-66c9-4166-9d22-4ad9238efae0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:05.746463 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2c74bfec-66c9-4166-9d22-4ad9238efae0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:05.747204 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2c74bfec-66c9-4166-9d22-4ad9238efae0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:05.747634 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2c74bfec-66c9-4166-9d22-4ad9238efae0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:05.766747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-52cc4525-2140-40fa-bde1-f0cd1f531e0b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:05.767644 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-52cc4525-2140-40fa-bde1-f0cd1f531e0b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:05.773382 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-52cc4525-2140-40fa-bde1-f0cd1f531e0b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:05.773834 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-52cc4525-2140-40fa-bde1-f0cd1f531e0b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:05.774595 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-52cc4525-2140-40fa-bde1-f0cd1f531e0b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:05.775027 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-52cc4525-2140-40fa-bde1-f0cd1f531e0b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:05.776975 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2c74bfec-66c9-4166-9d22-4ad9238efae0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041075 Apr 05 12:01:05.777525 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 752/1528] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:05 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:05.802744 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-52cc4525-2140-40fa-bde1-f0cd1f531e0b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.119514 Apr 05 12:01:05.803295 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 777/1529] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:05 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:06.750244 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5dd8137c-ab50-45fb-8f2a-df9bf3597a85 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:06.751604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5dd8137c-ab50-45fb-8f2a-df9bf3597a85 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:06.762539 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5dd8137c-ab50-45fb-8f2a-df9bf3597a85 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:06.763240 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5dd8137c-ab50-45fb-8f2a-df9bf3597a85 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:06.764036 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5dd8137c-ab50-45fb-8f2a-df9bf3597a85 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:06.764476 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5dd8137c-ab50-45fb-8f2a-df9bf3597a85 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:06.793923 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5dd8137c-ab50-45fb-8f2a-df9bf3597a85 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050409 Apr 05 12:01:06.794552 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 753/1530] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:06 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:06.814194 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d906b4cb-4ca5-4f9f-af33-6de3b93c04af tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:06.815111 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d906b4cb-4ca5-4f9f-af33-6de3b93c04af tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:06.820990 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d906b4cb-4ca5-4f9f-af33-6de3b93c04af tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:06.821446 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d906b4cb-4ca5-4f9f-af33-6de3b93c04af tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:06.822215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d906b4cb-4ca5-4f9f-af33-6de3b93c04af tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:06.822651 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d906b4cb-4ca5-4f9f-af33-6de3b93c04af tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:06.851398 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d906b4cb-4ca5-4f9f-af33-6de3b93c04af tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041097 Apr 05 12:01:06.851950 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 754/1531] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:06 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:06.854533 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-75a72984-07c8-449f-82f7-78a1f6b1bccd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:06.855455 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-75a72984-07c8-449f-82f7-78a1f6b1bccd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:06.861975 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-75a72984-07c8-449f-82f7-78a1f6b1bccd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:06.862424 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-75a72984-07c8-449f-82f7-78a1f6b1bccd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:06.863276 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-75a72984-07c8-449f-82f7-78a1f6b1bccd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:06.863711 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-75a72984-07c8-449f-82f7-78a1f6b1bccd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:06.892847 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-75a72984-07c8-449f-82f7-78a1f6b1bccd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108041 Apr 05 12:01:06.893401 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 778/1532] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:06 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:07.806114 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d36225ca-6eaf-4952-a4ef-81d112934abb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:07.807044 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d36225ca-6eaf-4952-a4ef-81d112934abb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:07.813789 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d36225ca-6eaf-4952-a4ef-81d112934abb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:07.814245 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d36225ca-6eaf-4952-a4ef-81d112934abb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:07.815020 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d36225ca-6eaf-4952-a4ef-81d112934abb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:07.815451 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d36225ca-6eaf-4952-a4ef-81d112934abb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:07.844697 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d36225ca-6eaf-4952-a4ef-81d112934abb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042565 Apr 05 12:01:07.845235 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 755/1533] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:07 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:07.863508 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-92a8de8a-39b0-405f-be16-fca8796fcac8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:07.864481 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-92a8de8a-39b0-405f-be16-fca8796fcac8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:07.870820 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92a8de8a-39b0-405f-be16-fca8796fcac8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:07.871262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92a8de8a-39b0-405f-be16-fca8796fcac8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:07.872023 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92a8de8a-39b0-405f-be16-fca8796fcac8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:07.872484 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92a8de8a-39b0-405f-be16-fca8796fcac8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:07.902479 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-92a8de8a-39b0-405f-be16-fca8796fcac8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042660 Apr 05 12:01:07.904860 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 779/1534] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:07 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:07.905759 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3af5cd7b-c39c-4800-a731-a1467beb9525 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:07.906688 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3af5cd7b-c39c-4800-a731-a1467beb9525 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:07.912619 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3af5cd7b-c39c-4800-a731-a1467beb9525 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:07.913068 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3af5cd7b-c39c-4800-a731-a1467beb9525 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:07.913870 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3af5cd7b-c39c-4800-a731-a1467beb9525 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:07.914271 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3af5cd7b-c39c-4800-a731-a1467beb9525 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:07.942510 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3af5cd7b-c39c-4800-a731-a1467beb9525 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041028 Apr 05 12:01:07.943104 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 756/1535] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:07 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:01:08.860026 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-520a44bf-9ff9-4d72-864d-395280fb1854 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:08.861422 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-520a44bf-9ff9-4d72-864d-395280fb1854 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:08.868902 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-520a44bf-9ff9-4d72-864d-395280fb1854 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:08.869514 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-520a44bf-9ff9-4d72-864d-395280fb1854 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:08.870113 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-520a44bf-9ff9-4d72-864d-395280fb1854 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:08.870539 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-520a44bf-9ff9-4d72-864d-395280fb1854 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:08.899855 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-520a44bf-9ff9-4d72-864d-395280fb1854 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046860 Apr 05 12:01:08.900694 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 780/1536] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:08 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:08.915125 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3209e7fb-0be6-469f-a12d-a5898aca91ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:08.916019 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3209e7fb-0be6-469f-a12d-a5898aca91ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:08.922761 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3209e7fb-0be6-469f-a12d-a5898aca91ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:08.923202 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3209e7fb-0be6-469f-a12d-a5898aca91ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:08.923946 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3209e7fb-0be6-469f-a12d-a5898aca91ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:08.924407 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3209e7fb-0be6-469f-a12d-a5898aca91ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:08.953171 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3209e7fb-0be6-469f-a12d-a5898aca91ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041980 Apr 05 12:01:08.953710 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 757/1537] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:08 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 12:01:08.954393 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c8611dad-081d-48be-b383-24b6f0bdf68d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:08.955314 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c8611dad-081d-48be-b383-24b6f0bdf68d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:08.961377 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c8611dad-081d-48be-b383-24b6f0bdf68d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:08.961825 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c8611dad-081d-48be-b383-24b6f0bdf68d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:08.962585 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c8611dad-081d-48be-b383-24b6f0bdf68d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:08.963120 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c8611dad-081d-48be-b383-24b6f0bdf68d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:08.992527 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c8611dad-081d-48be-b383-24b6f0bdf68d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042118 Apr 05 12:01:08.993045 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 781/1538] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:08 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:09.916151 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a865b013-66f1-4e97-83e8-aadcea916b14 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:09.917651 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a865b013-66f1-4e97-83e8-aadcea916b14 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:09.925265 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a865b013-66f1-4e97-83e8-aadcea916b14 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:09.925708 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a865b013-66f1-4e97-83e8-aadcea916b14 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:09.926459 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a865b013-66f1-4e97-83e8-aadcea916b14 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:09.926896 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a865b013-66f1-4e97-83e8-aadcea916b14 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:09.955228 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a865b013-66f1-4e97-83e8-aadcea916b14 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045691 Apr 05 12:01:09.955772 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 758/1539] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:09 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:09.965065 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3a1d0199-8d08-44a3-9df0-11079a550202 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:09.966005 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3a1d0199-8d08-44a3-9df0-11079a550202 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:09.972426 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a1d0199-8d08-44a3-9df0-11079a550202 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:09.972867 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a1d0199-8d08-44a3-9df0-11079a550202 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:09.973613 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a1d0199-8d08-44a3-9df0-11079a550202 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:09.974036 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a1d0199-8d08-44a3-9df0-11079a550202 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:10.002239 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3a1d0199-8d08-44a3-9df0-11079a550202 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041097 Apr 05 12:01:10.002787 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 782/1540] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:09 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:10.004765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3c4228ff-b682-4188-beee-12c73bf18fee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:10.005632 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3c4228ff-b682-4188-beee-12c73bf18fee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:10.012016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3c4228ff-b682-4188-beee-12c73bf18fee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:10.012488 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3c4228ff-b682-4188-beee-12c73bf18fee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:10.013267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3c4228ff-b682-4188-beee-12c73bf18fee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:10.013697 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3c4228ff-b682-4188-beee-12c73bf18fee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:10.043203 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3c4228ff-b682-4188-beee-12c73bf18fee tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042502 Apr 05 12:01:10.043785 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 759/1541] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:09 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:10.967188 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f201e24d-fd1b-4da4-845d-301e660aaa6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:10.968249 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f201e24d-fd1b-4da4-845d-301e660aaa6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:10.974784 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f201e24d-fd1b-4da4-845d-301e660aaa6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:10.975228 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f201e24d-fd1b-4da4-845d-301e660aaa6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:10.975973 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f201e24d-fd1b-4da4-845d-301e660aaa6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:10.976431 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f201e24d-fd1b-4da4-845d-301e660aaa6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:11.006464 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f201e24d-fd1b-4da4-845d-301e660aaa6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043348 Apr 05 12:01:11.007006 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 783/1542] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:10 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:11.013997 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-11ac104b-d225-45b7-ba8c-e1240014c637 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:11.014920 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-11ac104b-d225-45b7-ba8c-e1240014c637 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:11.021447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-11ac104b-d225-45b7-ba8c-e1240014c637 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:11.021995 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-11ac104b-d225-45b7-ba8c-e1240014c637 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:11.022803 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-11ac104b-d225-45b7-ba8c-e1240014c637 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:11.023335 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-11ac104b-d225-45b7-ba8c-e1240014c637 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:11.052991 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-11ac104b-d225-45b7-ba8c-e1240014c637 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043023 Apr 05 12:01:11.053547 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 760/1543] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:11 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:11.055158 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2ce1cfba-aae2-47e3-be9c-fae0d98bc037 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:11.056169 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2ce1cfba-aae2-47e3-be9c-fae0d98bc037 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:11.062638 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2ce1cfba-aae2-47e3-be9c-fae0d98bc037 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:11.063012 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2ce1cfba-aae2-47e3-be9c-fae0d98bc037 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:11.063766 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2ce1cfba-aae2-47e3-be9c-fae0d98bc037 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:11.064222 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2ce1cfba-aae2-47e3-be9c-fae0d98bc037 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:11.092965 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2ce1cfba-aae2-47e3-be9c-fae0d98bc037 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041664 Apr 05 12:01:11.093511 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 784/1544] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:11 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:01:12.021864 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9fa2c3e9-a94f-469c-9c97-13311830fd2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:12.023412 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9fa2c3e9-a94f-469c-9c97-13311830fd2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:12.033888 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9fa2c3e9-a94f-469c-9c97-13311830fd2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:12.034626 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9fa2c3e9-a94f-469c-9c97-13311830fd2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:12.035869 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9fa2c3e9-a94f-469c-9c97-13311830fd2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:12.036628 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9fa2c3e9-a94f-469c-9c97-13311830fd2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:12.064802 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bbc51bba-4cfc-4525-bf76-2d1bf2995e69 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:12.066269 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bbc51bba-4cfc-4525-bf76-2d1bf2995e69 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:12.069418 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9fa2c3e9-a94f-469c-9c97-13311830fd2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054172 Apr 05 12:01:12.069992 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 761/1545] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:12 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:12.072908 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bbc51bba-4cfc-4525-bf76-2d1bf2995e69 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:12.073340 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bbc51bba-4cfc-4525-bf76-2d1bf2995e69 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:12.074097 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bbc51bba-4cfc-4525-bf76-2d1bf2995e69 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:12.074532 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bbc51bba-4cfc-4525-bf76-2d1bf2995e69 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:12.102952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bbc51bba-4cfc-4525-bf76-2d1bf2995e69 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042063 Apr 05 12:01:12.103684 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 785/1546] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:12 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:12.104524 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-72c1d060-6fa2-4dfb-a0f1-5c1b927f8472 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:12.105531 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-72c1d060-6fa2-4dfb-a0f1-5c1b927f8472 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:12.112094 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-72c1d060-6fa2-4dfb-a0f1-5c1b927f8472 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:12.112564 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-72c1d060-6fa2-4dfb-a0f1-5c1b927f8472 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:12.113337 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-72c1d060-6fa2-4dfb-a0f1-5c1b927f8472 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:12.113776 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-72c1d060-6fa2-4dfb-a0f1-5c1b927f8472 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:12.141950 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-72c1d060-6fa2-4dfb-a0f1-5c1b927f8472 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041155 Apr 05 12:01:12.142429 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 762/1547] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:12 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:13.081372 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-22fb63e2-bb4f-4d7a-bcdc-5f59c2c499ec tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:13.082290 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-22fb63e2-bb4f-4d7a-bcdc-5f59c2c499ec tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:13.088725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-22fb63e2-bb4f-4d7a-bcdc-5f59c2c499ec tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:13.089166 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-22fb63e2-bb4f-4d7a-bcdc-5f59c2c499ec tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:13.089908 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-22fb63e2-bb4f-4d7a-bcdc-5f59c2c499ec tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:13.090344 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-22fb63e2-bb4f-4d7a-bcdc-5f59c2c499ec tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:13.114556 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-da933cd5-77a8-4d46-81e8-d627b6bddd32 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:13.115489 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-da933cd5-77a8-4d46-81e8-d627b6bddd32 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:13.120000 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-22fb63e2-bb4f-4d7a-bcdc-5f59c2c499ec tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042576 Apr 05 12:01:13.120611 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 786/1548] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:13 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:13.121715 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-da933cd5-77a8-4d46-81e8-d627b6bddd32 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:13.122160 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-da933cd5-77a8-4d46-81e8-d627b6bddd32 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:13.122915 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-da933cd5-77a8-4d46-81e8-d627b6bddd32 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:13.123345 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-da933cd5-77a8-4d46-81e8-d627b6bddd32 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:13.151351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-da933cd5-77a8-4d46-81e8-d627b6bddd32 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040750 Apr 05 12:01:13.151914 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 763/1549] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:13 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 12:01:13.153628 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1257c14b-855e-4821-818b-bd6d6501672f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:13.154572 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1257c14b-855e-4821-818b-bd6d6501672f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:13.160732 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1257c14b-855e-4821-818b-bd6d6501672f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:13.161173 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1257c14b-855e-4821-818b-bd6d6501672f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:13.161930 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1257c14b-855e-4821-818b-bd6d6501672f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:13.162359 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1257c14b-855e-4821-818b-bd6d6501672f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:13.192269 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1257c14b-855e-4821-818b-bd6d6501672f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042569 Apr 05 12:01:13.192805 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 787/1550] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:13 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:14.130981 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9d5b1b84-3a67-4786-bc61-67aa50c44b52 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:14.131911 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9d5b1b84-3a67-4786-bc61-67aa50c44b52 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:14.138359 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9d5b1b84-3a67-4786-bc61-67aa50c44b52 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:14.138810 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9d5b1b84-3a67-4786-bc61-67aa50c44b52 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:14.139578 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9d5b1b84-3a67-4786-bc61-67aa50c44b52 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:14.140019 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9d5b1b84-3a67-4786-bc61-67aa50c44b52 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:14.163072 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-61fae0b7-0585-4a46-bb62-5c10370b208a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:14.163957 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-61fae0b7-0585-4a46-bb62-5c10370b208a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:14.168763 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9d5b1b84-3a67-4786-bc61-67aa50c44b52 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041734 Apr 05 12:01:14.169304 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 764/1551] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:14 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:14.171132 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-61fae0b7-0585-4a46-bb62-5c10370b208a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:14.171794 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-61fae0b7-0585-4a46-bb62-5c10370b208a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:14.173046 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-61fae0b7-0585-4a46-bb62-5c10370b208a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:14.173632 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-61fae0b7-0585-4a46-bb62-5c10370b208a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:14.203827 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-18db1b57-d986-408f-ac0b-6619333fc953 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:14.204782 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-18db1b57-d986-408f-ac0b-6619333fc953 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:14.207488 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-61fae0b7-0585-4a46-bb62-5c10370b208a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048448 Apr 05 12:01:14.208050 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 788/1552] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:14 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:14.210977 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-18db1b57-d986-408f-ac0b-6619333fc953 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:14.211426 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-18db1b57-d986-408f-ac0b-6619333fc953 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:14.212236 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-18db1b57-d986-408f-ac0b-6619333fc953 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:14.212671 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-18db1b57-d986-408f-ac0b-6619333fc953 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:14.241529 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-18db1b57-d986-408f-ac0b-6619333fc953 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041643 Apr 05 12:01:14.242082 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 765/1553] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:14 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:01:15.182011 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6a16ca2f-6cb0-4c22-9f54-191426beaa1b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:15.182934 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6a16ca2f-6cb0-4c22-9f54-191426beaa1b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:15.189339 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6a16ca2f-6cb0-4c22-9f54-191426beaa1b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:15.189786 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6a16ca2f-6cb0-4c22-9f54-191426beaa1b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:15.190543 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6a16ca2f-6cb0-4c22-9f54-191426beaa1b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:15.191007 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6a16ca2f-6cb0-4c22-9f54-191426beaa1b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:15.219100 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d01e9ddb-2a6a-41bc-9d10-e958eeb43c30 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:15.219685 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6a16ca2f-6cb0-4c22-9f54-191426beaa1b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041198 Apr 05 12:01:15.220099 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 789/1554] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:15 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:15.220229 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d01e9ddb-2a6a-41bc-9d10-e958eeb43c30 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:15.226925 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d01e9ddb-2a6a-41bc-9d10-e958eeb43c30 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:15.227372 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d01e9ddb-2a6a-41bc-9d10-e958eeb43c30 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:15.228172 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d01e9ddb-2a6a-41bc-9d10-e958eeb43c30 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:15.228606 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d01e9ddb-2a6a-41bc-9d10-e958eeb43c30 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:15.253086 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-91bc250e-c263-4761-9b27-ca7d733a159f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:15.254002 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-91bc250e-c263-4761-9b27-ca7d733a159f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:15.257049 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d01e9ddb-2a6a-41bc-9d10-e958eeb43c30 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041955 Apr 05 12:01:15.257604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 766/1555] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:15 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:15.260143 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-91bc250e-c263-4761-9b27-ca7d733a159f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:15.260602 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-91bc250e-c263-4761-9b27-ca7d733a159f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:15.261369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-91bc250e-c263-4761-9b27-ca7d733a159f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:15.261826 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-91bc250e-c263-4761-9b27-ca7d733a159f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:15.290922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-91bc250e-c263-4761-9b27-ca7d733a159f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041663 Apr 05 12:01:15.291476 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 790/1556] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:15 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:16.268779 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e5820554-15b0-4637-a1c2-f0458b8cde8b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:16.269745 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e5820554-15b0-4637-a1c2-f0458b8cde8b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:16.276447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e5820554-15b0-4637-a1c2-f0458b8cde8b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:16.276891 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e5820554-15b0-4637-a1c2-f0458b8cde8b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:16.277642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e5820554-15b0-4637-a1c2-f0458b8cde8b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:16.277958 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f7484727-cc1b-4b32-bb37-d27e117e34c9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:16.278422 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e5820554-15b0-4637-a1c2-f0458b8cde8b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:16.278951 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f7484727-cc1b-4b32-bb37-d27e117e34c9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:16.285416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f7484727-cc1b-4b32-bb37-d27e117e34c9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:16.285868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f7484727-cc1b-4b32-bb37-d27e117e34c9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:16.286635 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f7484727-cc1b-4b32-bb37-d27e117e34c9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:16.287073 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f7484727-cc1b-4b32-bb37-d27e117e34c9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:16.307416 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e5820554-15b0-4637-a1c2-f0458b8cde8b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042532 Apr 05 12:01:16.308007 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 791/1557] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:16 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:16.312682 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-997daf25-6d0a-4b68-bc95-4613163ce94d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:16.313583 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-997daf25-6d0a-4b68-bc95-4613163ce94d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:16.316130 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f7484727-cc1b-4b32-bb37-d27e117e34c9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089086 Apr 05 12:01:16.316713 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 767/1558] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:16 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:16.319239 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-997daf25-6d0a-4b68-bc95-4613163ce94d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:16.319677 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-997daf25-6d0a-4b68-bc95-4613163ce94d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:16.320455 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-997daf25-6d0a-4b68-bc95-4613163ce94d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:16.320885 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-997daf25-6d0a-4b68-bc95-4613163ce94d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:16.353188 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-997daf25-6d0a-4b68-bc95-4613163ce94d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044058 Apr 05 12:01:16.353754 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 792/1559] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:16 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:17.322738 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-67d232d0-e3eb-41c5-95fd-de0fb37f1e6c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:17.323811 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-67d232d0-e3eb-41c5-95fd-de0fb37f1e6c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:17.329387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7a4a0be9-0b98-427a-8e2a-5d3c2061f6b6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:17.330392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7a4a0be9-0b98-427a-8e2a-5d3c2061f6b6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:17.332272 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-67d232d0-e3eb-41c5-95fd-de0fb37f1e6c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:17.332728 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-67d232d0-e3eb-41c5-95fd-de0fb37f1e6c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:17.333506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-67d232d0-e3eb-41c5-95fd-de0fb37f1e6c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:17.333926 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-67d232d0-e3eb-41c5-95fd-de0fb37f1e6c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:17.337266 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a4a0be9-0b98-427a-8e2a-5d3c2061f6b6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:17.337723 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a4a0be9-0b98-427a-8e2a-5d3c2061f6b6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:17.338511 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a4a0be9-0b98-427a-8e2a-5d3c2061f6b6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:17.338940 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a4a0be9-0b98-427a-8e2a-5d3c2061f6b6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:17.363597 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-67d232d0-e3eb-41c5-95fd-de0fb37f1e6c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047070 Apr 05 12:01:17.364452 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 768/1560] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:17 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:17.368213 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7a4a0be9-0b98-427a-8e2a-5d3c2061f6b6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044349 Apr 05 12:01:17.368789 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 793/1561] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:17 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:17.368941 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b116a904-873a-4564-9cc9-da1ab7849787 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:17.369684 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b116a904-873a-4564-9cc9-da1ab7849787 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:17.375377 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b116a904-873a-4564-9cc9-da1ab7849787 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:17.375827 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b116a904-873a-4564-9cc9-da1ab7849787 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:17.376623 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b116a904-873a-4564-9cc9-da1ab7849787 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:17.377064 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b116a904-873a-4564-9cc9-da1ab7849787 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:17.405448 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b116a904-873a-4564-9cc9-da1ab7849787 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040172 Apr 05 12:01:17.406001 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 769/1562] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:17 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:18.375583 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d34f2588-4094-43a3-95c6-3b9324e627b8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:18.376604 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d34f2588-4094-43a3-95c6-3b9324e627b8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:18.378906 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-40af56ec-3f0a-4d64-9f00-d0b72782d966 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:18.379818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-40af56ec-3f0a-4d64-9f00-d0b72782d966 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:18.383452 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d34f2588-4094-43a3-95c6-3b9324e627b8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:18.383907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d34f2588-4094-43a3-95c6-3b9324e627b8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:18.384833 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d34f2588-4094-43a3-95c6-3b9324e627b8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:18.385259 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d34f2588-4094-43a3-95c6-3b9324e627b8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:18.386239 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-40af56ec-3f0a-4d64-9f00-d0b72782d966 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:18.386683 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-40af56ec-3f0a-4d64-9f00-d0b72782d966 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:18.387439 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-40af56ec-3f0a-4d64-9f00-d0b72782d966 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:18.387864 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-40af56ec-3f0a-4d64-9f00-d0b72782d966 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:18.414291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d34f2588-4094-43a3-95c6-3b9324e627b8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042832 Apr 05 12:01:18.414875 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 794/1563] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:18 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:18.417587 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-40af56ec-3f0a-4d64-9f00-d0b72782d966 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042634 Apr 05 12:01:18.419342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9d5cfe15-db68-4b8d-b72f-e1101da3e6e8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:18.419593 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 770/1564] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:18 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:18.420249 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9d5cfe15-db68-4b8d-b72f-e1101da3e6e8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:18.426145 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9d5cfe15-db68-4b8d-b72f-e1101da3e6e8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:18.426587 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9d5cfe15-db68-4b8d-b72f-e1101da3e6e8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:18.427345 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9d5cfe15-db68-4b8d-b72f-e1101da3e6e8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:18.427770 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9d5cfe15-db68-4b8d-b72f-e1101da3e6e8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:18.456519 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9d5cfe15-db68-4b8d-b72f-e1101da3e6e8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040617 Apr 05 12:01:18.457061 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 795/1565] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:18 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:19.426364 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0550cf74-36db-4577-aaa7-8c3fc1d5d5f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:19.427272 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0550cf74-36db-4577-aaa7-8c3fc1d5d5f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:19.429165 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d6af3230-3172-4511-8d93-43009e5b7c30 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:19.430079 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d6af3230-3172-4511-8d93-43009e5b7c30 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:19.433691 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0550cf74-36db-4577-aaa7-8c3fc1d5d5f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:19.434198 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0550cf74-36db-4577-aaa7-8c3fc1d5d5f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:19.435025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0550cf74-36db-4577-aaa7-8c3fc1d5d5f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:19.435457 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0550cf74-36db-4577-aaa7-8c3fc1d5d5f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:19.436381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d6af3230-3172-4511-8d93-43009e5b7c30 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:19.436835 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d6af3230-3172-4511-8d93-43009e5b7c30 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:19.437597 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d6af3230-3172-4511-8d93-43009e5b7c30 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:19.438032 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d6af3230-3172-4511-8d93-43009e5b7c30 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:19.465528 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0550cf74-36db-4577-aaa7-8c3fc1d5d5f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043303 Apr 05 12:01:19.466094 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 771/1566] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:19 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:19.467636 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d6af3230-3172-4511-8d93-43009e5b7c30 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042382 Apr 05 12:01:19.468381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 796/1567] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:19 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:19.470617 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-30388ed2-2e55-4f37-84bd-a64eb0685561 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:19.471513 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-30388ed2-2e55-4f37-84bd-a64eb0685561 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:19.477322 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-30388ed2-2e55-4f37-84bd-a64eb0685561 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:19.477761 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-30388ed2-2e55-4f37-84bd-a64eb0685561 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:19.478513 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-30388ed2-2e55-4f37-84bd-a64eb0685561 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:19.478954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-30388ed2-2e55-4f37-84bd-a64eb0685561 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:19.509211 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-30388ed2-2e55-4f37-84bd-a64eb0685561 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042085 Apr 05 12:01:19.509825 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 772/1568] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:19 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:20.479111 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5b12cf0d-aeb7-4554-8bb2-20e52804b208 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:20.480034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5b12cf0d-aeb7-4554-8bb2-20e52804b208 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:20.480747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-dd35d8e5-87b2-4a29-9746-1a8d0848bd45 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:20.481762 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-dd35d8e5-87b2-4a29-9746-1a8d0848bd45 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:20.487105 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5b12cf0d-aeb7-4554-8bb2-20e52804b208 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:20.487555 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5b12cf0d-aeb7-4554-8bb2-20e52804b208 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:20.488347 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5b12cf0d-aeb7-4554-8bb2-20e52804b208 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:20.488738 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd35d8e5-87b2-4a29-9746-1a8d0848bd45 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:20.488905 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5b12cf0d-aeb7-4554-8bb2-20e52804b208 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:20.489183 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd35d8e5-87b2-4a29-9746-1a8d0848bd45 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:20.489945 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd35d8e5-87b2-4a29-9746-1a8d0848bd45 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:20.490350 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd35d8e5-87b2-4a29-9746-1a8d0848bd45 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:20.518980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-dd35d8e5-87b2-4a29-9746-1a8d0848bd45 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042231 Apr 05 12:01:20.519541 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 773/1569] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:20 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 12:01:20.520253 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5b12cf0d-aeb7-4554-8bb2-20e52804b208 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045086 Apr 05 12:01:20.520997 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 797/1570] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:20 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:20.524011 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-746dce22-b532-4484-9b87-7604438f28fb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:20.524928 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-746dce22-b532-4484-9b87-7604438f28fb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:20.530396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-746dce22-b532-4484-9b87-7604438f28fb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:20.530828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-746dce22-b532-4484-9b87-7604438f28fb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:20.531577 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-746dce22-b532-4484-9b87-7604438f28fb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:20.532084 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-746dce22-b532-4484-9b87-7604438f28fb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:20.560895 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-746dce22-b532-4484-9b87-7604438f28fb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040375 Apr 05 12:01:20.561405 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 774/1571] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:20 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:21.531800 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-19e0f8d5-fdf6-409f-9919-4157720cf608 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:21.532769 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-19e0f8d5-fdf6-409f-9919-4157720cf608 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:21.535453 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bb0dbcbc-6804-4682-bbec-3b802becf707 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:21.536385 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bb0dbcbc-6804-4682-bbec-3b802becf707 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:21.539476 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-19e0f8d5-fdf6-409f-9919-4157720cf608 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:21.539926 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-19e0f8d5-fdf6-409f-9919-4157720cf608 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:21.540729 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-19e0f8d5-fdf6-409f-9919-4157720cf608 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:21.541163 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-19e0f8d5-fdf6-409f-9919-4157720cf608 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:21.542868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bb0dbcbc-6804-4682-bbec-3b802becf707 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:21.543295 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bb0dbcbc-6804-4682-bbec-3b802becf707 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:21.544101 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bb0dbcbc-6804-4682-bbec-3b802becf707 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:21.544618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bb0dbcbc-6804-4682-bbec-3b802becf707 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:21.570734 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-19e0f8d5-fdf6-409f-9919-4157720cf608 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042869 Apr 05 12:01:21.571342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 798/1572] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:21 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:21.573148 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bb0dbcbc-6804-4682-bbec-3b802becf707 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041542 Apr 05 12:01:21.573944 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 775/1573] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:21 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:21.576029 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1dfa2ae2-bc90-4fa6-9c1e-5d33d1486cc5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:21.576961 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1dfa2ae2-bc90-4fa6-9c1e-5d33d1486cc5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:21.582790 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1dfa2ae2-bc90-4fa6-9c1e-5d33d1486cc5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:21.583231 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1dfa2ae2-bc90-4fa6-9c1e-5d33d1486cc5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:21.584009 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1dfa2ae2-bc90-4fa6-9c1e-5d33d1486cc5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:21.584458 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1dfa2ae2-bc90-4fa6-9c1e-5d33d1486cc5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:21.612285 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1dfa2ae2-bc90-4fa6-9c1e-5d33d1486cc5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039946 Apr 05 12:01:21.612822 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 799/1574] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:21 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:22.581743 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-de094d54-0ab6-41b2-9972-c62ce08f10f5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:22.582683 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-de094d54-0ab6-41b2-9972-c62ce08f10f5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:22.585256 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f3687703-1999-4930-b48a-b435e1e2a55a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:22.586184 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f3687703-1999-4930-b48a-b435e1e2a55a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:22.589396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-de094d54-0ab6-41b2-9972-c62ce08f10f5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:22.589900 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-de094d54-0ab6-41b2-9972-c62ce08f10f5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:22.590737 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-de094d54-0ab6-41b2-9972-c62ce08f10f5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:22.591276 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-de094d54-0ab6-41b2-9972-c62ce08f10f5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:22.592513 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f3687703-1999-4930-b48a-b435e1e2a55a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:22.592967 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f3687703-1999-4930-b48a-b435e1e2a55a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:22.593734 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f3687703-1999-4930-b48a-b435e1e2a55a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:22.594168 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f3687703-1999-4930-b48a-b435e1e2a55a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:22.621638 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-de094d54-0ab6-41b2-9972-c62ce08f10f5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044067 Apr 05 12:01:22.622206 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 776/1575] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:22 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:22.623538 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f3687703-1999-4930-b48a-b435e1e2a55a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042462 Apr 05 12:01:22.626052 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 800/1576] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:22 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:22.626779 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-098fb4cd-2e28-4987-817e-560a99c63c27 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:22.627689 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-098fb4cd-2e28-4987-817e-560a99c63c27 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:22.633853 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-098fb4cd-2e28-4987-817e-560a99c63c27 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:22.634302 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-098fb4cd-2e28-4987-817e-560a99c63c27 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:22.635067 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-098fb4cd-2e28-4987-817e-560a99c63c27 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:22.635502 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-098fb4cd-2e28-4987-817e-560a99c63c27 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:22.662891 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-098fb4cd-2e28-4987-817e-560a99c63c27 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039707 Apr 05 12:01:22.663461 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 777/1577] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:22 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:23.634750 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-15e7fd0d-223c-4423-87a7-dd3d9a5f7e30 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:23.635340 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-98228c09-6b3b-4b5c-bdcf-6c8cce70bd1c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:23.635924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-98228c09-6b3b-4b5c-bdcf-6c8cce70bd1c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:23.636954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-15e7fd0d-223c-4423-87a7-dd3d9a5f7e30 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:23.643049 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-98228c09-6b3b-4b5c-bdcf-6c8cce70bd1c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:23.643160 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-15e7fd0d-223c-4423-87a7-dd3d9a5f7e30 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:23.643296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-98228c09-6b3b-4b5c-bdcf-6c8cce70bd1c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:23.643445 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-15e7fd0d-223c-4423-87a7-dd3d9a5f7e30 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:23.644292 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-15e7fd0d-223c-4423-87a7-dd3d9a5f7e30 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:23.644556 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-98228c09-6b3b-4b5c-bdcf-6c8cce70bd1c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:23.644681 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-15e7fd0d-223c-4423-87a7-dd3d9a5f7e30 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:23.645256 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-98228c09-6b3b-4b5c-bdcf-6c8cce70bd1c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:23.674052 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-15e7fd0d-223c-4423-87a7-dd3d9a5f7e30 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043037 Apr 05 12:01:23.674660 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 778/1578] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:23 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:23.675282 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-98228c09-6b3b-4b5c-bdcf-6c8cce70bd1c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044190 Apr 05 12:01:23.676213 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 801/1579] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:23 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:23.681845 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-13dbc1c0-df79-4f7e-9ac8-5b9f0b7dc1ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:23.682834 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-13dbc1c0-df79-4f7e-9ac8-5b9f0b7dc1ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:23.688492 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13dbc1c0-df79-4f7e-9ac8-5b9f0b7dc1ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:23.688942 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13dbc1c0-df79-4f7e-9ac8-5b9f0b7dc1ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:23.689703 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13dbc1c0-df79-4f7e-9ac8-5b9f0b7dc1ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:23.690132 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13dbc1c0-df79-4f7e-9ac8-5b9f0b7dc1ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:23.717969 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-13dbc1c0-df79-4f7e-9ac8-5b9f0b7dc1ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042291 Apr 05 12:01:23.718512 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 779/1580] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:23 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:24.685201 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-092548fc-7bd6-4243-8c04-c952c58a2321 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:24.686131 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-092548fc-7bd6-4243-8c04-c952c58a2321 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:24.687438 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-00cd11d3-2b73-4979-824f-d7bf970fb988 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:24.688392 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-00cd11d3-2b73-4979-824f-d7bf970fb988 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:24.692876 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-092548fc-7bd6-4243-8c04-c952c58a2321 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:24.693328 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-092548fc-7bd6-4243-8c04-c952c58a2321 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:24.694244 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-092548fc-7bd6-4243-8c04-c952c58a2321 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:24.694500 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-092548fc-7bd6-4243-8c04-c952c58a2321 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:24.703609 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00cd11d3-2b73-4979-824f-d7bf970fb988 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:24.704110 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00cd11d3-2b73-4979-824f-d7bf970fb988 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:24.704872 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00cd11d3-2b73-4979-824f-d7bf970fb988 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:24.705305 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00cd11d3-2b73-4979-824f-d7bf970fb988 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:24.725065 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-092548fc-7bd6-4243-8c04-c952c58a2321 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043684 Apr 05 12:01:24.725638 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 802/1581] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:24 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:24.730401 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-654d044e-0951-47ea-a424-c330416e413e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:24.731313 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-654d044e-0951-47ea-a424-c330416e413e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:24.735688 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-00cd11d3-2b73-4979-824f-d7bf970fb988 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052779 Apr 05 12:01:24.736566 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 780/1582] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:24 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:24.737563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-654d044e-0951-47ea-a424-c330416e413e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:24.738066 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-654d044e-0951-47ea-a424-c330416e413e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:24.738830 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-654d044e-0951-47ea-a424-c330416e413e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:24.739262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-654d044e-0951-47ea-a424-c330416e413e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:24.768121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-654d044e-0951-47ea-a424-c330416e413e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041410 Apr 05 12:01:24.768752 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 803/1583] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:24 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:25.737121 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c2989359-cfde-41fe-b90f-9a2f230809c6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:25.738098 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c2989359-cfde-41fe-b90f-9a2f230809c6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:25.744725 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c2989359-cfde-41fe-b90f-9a2f230809c6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:25.745176 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c2989359-cfde-41fe-b90f-9a2f230809c6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:25.745945 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c2989359-cfde-41fe-b90f-9a2f230809c6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:25.746432 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c2989359-cfde-41fe-b90f-9a2f230809c6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:25.747028 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ebddb6ef-da55-405c-9c3b-c839429bc62c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:25.748798 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ebddb6ef-da55-405c-9c3b-c839429bc62c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:25.755274 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ebddb6ef-da55-405c-9c3b-c839429bc62c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:25.755750 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ebddb6ef-da55-405c-9c3b-c839429bc62c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:25.756538 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ebddb6ef-da55-405c-9c3b-c839429bc62c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:25.757158 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ebddb6ef-da55-405c-9c3b-c839429bc62c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:25.789491 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c2989359-cfde-41fe-b90f-9a2f230809c6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056618 Apr 05 12:01:25.793408 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 781/1584] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:25 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:25.793563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ebddb6ef-da55-405c-9c3b-c839429bc62c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048247 Apr 05 12:01:25.793563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 804/1585] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:25 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:25.798106 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-334e5c43-0898-4dcb-b62b-d2e3b5ed4ea0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:25.799048 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-334e5c43-0898-4dcb-b62b-d2e3b5ed4ea0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:25.804844 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-334e5c43-0898-4dcb-b62b-d2e3b5ed4ea0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:25.805295 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-334e5c43-0898-4dcb-b62b-d2e3b5ed4ea0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:25.806060 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-334e5c43-0898-4dcb-b62b-d2e3b5ed4ea0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:25.806499 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-334e5c43-0898-4dcb-b62b-d2e3b5ed4ea0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:25.825917 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1e486005-03bb-4f1b-81d3-ec8f51c55c2d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:25.826988 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1e486005-03bb-4f1b-81d3-ec8f51c55c2d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:25.832927 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1e486005-03bb-4f1b-81d3-ec8f51c55c2d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:25.833368 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1e486005-03bb-4f1b-81d3-ec8f51c55c2d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:25.834121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1e486005-03bb-4f1b-81d3-ec8f51c55c2d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:25.834551 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1e486005-03bb-4f1b-81d3-ec8f51c55c2d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:25.835700 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-334e5c43-0898-4dcb-b62b-d2e3b5ed4ea0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044623 Apr 05 12:01:25.836610 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 782/1586] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:25 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:25.862663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1e486005-03bb-4f1b-81d3-ec8f51c55c2d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040752 Apr 05 12:01:25.863273 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 805/1587] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:25 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:01:26.801422 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-deb19bcb-7668-496f-9815-6a828e5c63e4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:26.802426 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-deb19bcb-7668-496f-9815-6a828e5c63e4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:26.803096 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a846e0d7-cace-4ad8-81e1-ce699c3c41e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:26.804066 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a846e0d7-cace-4ad8-81e1-ce699c3c41e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:26.809073 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-deb19bcb-7668-496f-9815-6a828e5c63e4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:26.809517 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-deb19bcb-7668-496f-9815-6a828e5c63e4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:26.810278 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-deb19bcb-7668-496f-9815-6a828e5c63e4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:26.810419 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a846e0d7-cace-4ad8-81e1-ce699c3c41e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:26.810707 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-deb19bcb-7668-496f-9815-6a828e5c63e4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:26.810849 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a846e0d7-cace-4ad8-81e1-ce699c3c41e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:26.811564 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a846e0d7-cace-4ad8-81e1-ce699c3c41e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:26.811996 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a846e0d7-cace-4ad8-81e1-ce699c3c41e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:26.840234 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a846e0d7-cace-4ad8-81e1-ce699c3c41e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041219 Apr 05 12:01:26.841322 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-deb19bcb-7668-496f-9815-6a828e5c63e4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042809 Apr 05 12:01:26.841322 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 783/1589] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:26 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:26.841531 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 806/1589] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:26 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:26.848962 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3e071891-ccac-4120-a51a-f5162aa24ff2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:26.849869 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3e071891-ccac-4120-a51a-f5162aa24ff2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:26.855858 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e071891-ccac-4120-a51a-f5162aa24ff2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:26.856460 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e071891-ccac-4120-a51a-f5162aa24ff2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:26.857241 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e071891-ccac-4120-a51a-f5162aa24ff2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:26.857672 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e071891-ccac-4120-a51a-f5162aa24ff2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:26.873928 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8dcdc1ad-821e-4595-9c73-f2ca32925d8e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:26.874907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8dcdc1ad-821e-4595-9c73-f2ca32925d8e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:26.881095 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8dcdc1ad-821e-4595-9c73-f2ca32925d8e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:26.881568 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8dcdc1ad-821e-4595-9c73-f2ca32925d8e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:26.882346 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8dcdc1ad-821e-4595-9c73-f2ca32925d8e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:26.882755 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8dcdc1ad-821e-4595-9c73-f2ca32925d8e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:26.887159 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3e071891-ccac-4120-a51a-f5162aa24ff2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041851 Apr 05 12:01:26.887744 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 784/1590] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:26 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:26.913756 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8dcdc1ad-821e-4595-9c73-f2ca32925d8e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043608 Apr 05 12:01:26.914344 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 807/1591] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:26 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:01:27.852108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3662fe1d-56e2-4c8b-ab28-3250bc575cd3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:27.852671 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a0c49447-195f-4f1c-bebe-38ed5351eca7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:27.853040 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a0c49447-195f-4f1c-bebe-38ed5351eca7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:27.853142 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3662fe1d-56e2-4c8b-ab28-3250bc575cd3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:27.859665 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3662fe1d-56e2-4c8b-ab28-3250bc575cd3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:27.860107 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3662fe1d-56e2-4c8b-ab28-3250bc575cd3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:27.860315 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a0c49447-195f-4f1c-bebe-38ed5351eca7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:27.860782 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a0c49447-195f-4f1c-bebe-38ed5351eca7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:27.860897 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3662fe1d-56e2-4c8b-ab28-3250bc575cd3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:27.861283 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3662fe1d-56e2-4c8b-ab28-3250bc575cd3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:27.861544 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a0c49447-195f-4f1c-bebe-38ed5351eca7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:27.861975 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a0c49447-195f-4f1c-bebe-38ed5351eca7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:27.890174 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3662fe1d-56e2-4c8b-ab28-3250bc575cd3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042066 Apr 05 12:01:27.890735 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 785/1592] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:27 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:27.891804 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a0c49447-195f-4f1c-bebe-38ed5351eca7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043608 Apr 05 12:01:27.893823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 808/1593] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:27 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:27.899594 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a783668a-6152-40e6-a2a1-5599bb73f9d4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:27.900576 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a783668a-6152-40e6-a2a1-5599bb73f9d4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:27.906468 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a783668a-6152-40e6-a2a1-5599bb73f9d4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:27.906917 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a783668a-6152-40e6-a2a1-5599bb73f9d4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:27.907671 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a783668a-6152-40e6-a2a1-5599bb73f9d4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:27.908120 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a783668a-6152-40e6-a2a1-5599bb73f9d4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:27.925408 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bbbe0260-3c19-4b30-a588-2abf7c20aa19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:27.926536 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bbbe0260-3c19-4b30-a588-2abf7c20aa19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:27.932465 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bbbe0260-3c19-4b30-a588-2abf7c20aa19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:27.932911 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bbbe0260-3c19-4b30-a588-2abf7c20aa19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:27.933675 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bbbe0260-3c19-4b30-a588-2abf7c20aa19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:27.934104 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bbbe0260-3c19-4b30-a588-2abf7c20aa19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:27.936326 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a783668a-6152-40e6-a2a1-5599bb73f9d4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040540 Apr 05 12:01:27.936868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 786/1594] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:27 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:27.962308 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bbbe0260-3c19-4b30-a588-2abf7c20aa19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040811 Apr 05 12:01:27.963065 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 809/1595] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:27 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:01:28.902739 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-42044591-e621-49ce-8ead-79de38792194 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:28.903490 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9ce58d7a-3958-4473-a1d5-6c91d920c2ba tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:28.903917 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-42044591-e621-49ce-8ead-79de38792194 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:28.904597 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9ce58d7a-3958-4473-a1d5-6c91d920c2ba tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:28.910445 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-42044591-e621-49ce-8ead-79de38792194 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:28.910903 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-42044591-e621-49ce-8ead-79de38792194 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:28.911339 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9ce58d7a-3958-4473-a1d5-6c91d920c2ba tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:28.911779 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-42044591-e621-49ce-8ead-79de38792194 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:28.911942 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9ce58d7a-3958-4473-a1d5-6c91d920c2ba tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:28.912351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-42044591-e621-49ce-8ead-79de38792194 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:28.912655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9ce58d7a-3958-4473-a1d5-6c91d920c2ba tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:28.913107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9ce58d7a-3958-4473-a1d5-6c91d920c2ba tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:28.944635 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-42044591-e621-49ce-8ead-79de38792194 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046111 Apr 05 12:01:28.945239 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 787/1596] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:28 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:28.945660 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9ce58d7a-3958-4473-a1d5-6c91d920c2ba tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046141 Apr 05 12:01:28.946462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 810/1597] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:28 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:28.955090 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ac9589a1-44df-4344-bd2e-613e4ab3c9b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:28.956575 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ac9589a1-44df-4344-bd2e-613e4ab3c9b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:28.963906 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ac9589a1-44df-4344-bd2e-613e4ab3c9b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:28.964489 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ac9589a1-44df-4344-bd2e-613e4ab3c9b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:28.965260 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ac9589a1-44df-4344-bd2e-613e4ab3c9b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:28.965727 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ac9589a1-44df-4344-bd2e-613e4ab3c9b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:28.974116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ea795cc9-b61a-4ceb-bcd2-5a10760bfd82 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:28.975055 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ea795cc9-b61a-4ceb-bcd2-5a10760bfd82 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:28.981128 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea795cc9-b61a-4ceb-bcd2-5a10760bfd82 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:28.981580 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea795cc9-b61a-4ceb-bcd2-5a10760bfd82 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:28.982334 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea795cc9-b61a-4ceb-bcd2-5a10760bfd82 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:28.982765 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea795cc9-b61a-4ceb-bcd2-5a10760bfd82 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:28.995752 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ac9589a1-44df-4344-bd2e-613e4ab3c9b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049447 Apr 05 12:01:28.996347 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 788/1598] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:28 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:29.022232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ea795cc9-b61a-4ceb-bcd2-5a10760bfd82 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051719 Apr 05 12:01:29.022830 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 811/1599] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:28 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:01:29.961295 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-36cfe55b-31f1-4132-b2e0-1454ce305816 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:29.962341 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c95417a6-4cdd-4fcd-bb68-a26341f12dcb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:29.962939 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-36cfe55b-31f1-4132-b2e0-1454ce305816 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:29.963111 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c95417a6-4cdd-4fcd-bb68-a26341f12dcb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:29.973708 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c95417a6-4cdd-4fcd-bb68-a26341f12dcb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:29.974053 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-36cfe55b-31f1-4132-b2e0-1454ce305816 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:29.974391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-36cfe55b-31f1-4132-b2e0-1454ce305816 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:29.974593 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c95417a6-4cdd-4fcd-bb68-a26341f12dcb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:29.975483 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-36cfe55b-31f1-4132-b2e0-1454ce305816 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:29.975629 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c95417a6-4cdd-4fcd-bb68-a26341f12dcb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:29.975918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c95417a6-4cdd-4fcd-bb68-a26341f12dcb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:29.976098 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-36cfe55b-31f1-4132-b2e0-1454ce305816 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:30.006364 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-36cfe55b-31f1-4132-b2e0-1454ce305816 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051589 Apr 05 12:01:30.006932 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 812/1600] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:29 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:30.007847 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c95417a6-4cdd-4fcd-bb68-a26341f12dcb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053120 Apr 05 12:01:30.008647 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 789/1601] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:29 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:30.011551 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-71cbef63-e8bc-4f47-9a4d-63dc0d406179 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:30.012485 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-71cbef63-e8bc-4f47-9a4d-63dc0d406179 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:30.018457 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71cbef63-e8bc-4f47-9a4d-63dc0d406179 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:30.018900 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71cbef63-e8bc-4f47-9a4d-63dc0d406179 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:30.019624 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71cbef63-e8bc-4f47-9a4d-63dc0d406179 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:30.020057 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71cbef63-e8bc-4f47-9a4d-63dc0d406179 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:30.033888 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cf843c95-182c-470f-8a1c-5fce8a03cedd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:30.034835 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cf843c95-182c-470f-8a1c-5fce8a03cedd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:30.041164 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cf843c95-182c-470f-8a1c-5fce8a03cedd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:30.041620 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cf843c95-182c-470f-8a1c-5fce8a03cedd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:30.042387 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cf843c95-182c-470f-8a1c-5fce8a03cedd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:30.042820 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cf843c95-182c-470f-8a1c-5fce8a03cedd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:30.048855 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-71cbef63-e8bc-4f47-9a4d-63dc0d406179 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040920 Apr 05 12:01:30.049416 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 813/1602] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:30 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:30.071637 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cf843c95-182c-470f-8a1c-5fce8a03cedd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041599 Apr 05 12:01:30.072213 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 790/1603] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:30 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:31.021844 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9b539ea8-3dad-4644-b464-c12116fadb2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:31.022770 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-27954d91-a9d3-4682-961d-5c589942e5ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:31.023171 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9b539ea8-3dad-4644-b464-c12116fadb2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:31.023691 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-27954d91-a9d3-4682-961d-5c589942e5ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:31.030020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9b539ea8-3dad-4644-b464-c12116fadb2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:31.030181 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-27954d91-a9d3-4682-961d-5c589942e5ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:31.030449 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9b539ea8-3dad-4644-b464-c12116fadb2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:31.030618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-27954d91-a9d3-4682-961d-5c589942e5ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:31.031235 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9b539ea8-3dad-4644-b464-c12116fadb2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:31.031382 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-27954d91-a9d3-4682-961d-5c589942e5ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:31.031666 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9b539ea8-3dad-4644-b464-c12116fadb2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:31.031830 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-27954d91-a9d3-4682-961d-5c589942e5ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:31.060589 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9b539ea8-3dad-4644-b464-c12116fadb2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045367 Apr 05 12:01:31.061336 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 814/1604] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:31 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:31.061502 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-27954d91-a9d3-4682-961d-5c589942e5ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044976 Apr 05 12:01:31.065098 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 791/1605] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:31 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:31.068652 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-89ea037c-691c-4f2e-930e-a0d0d9793c7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:31.069555 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-89ea037c-691c-4f2e-930e-a0d0d9793c7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:31.075405 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-89ea037c-691c-4f2e-930e-a0d0d9793c7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:31.075849 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-89ea037c-691c-4f2e-930e-a0d0d9793c7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:31.076635 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-89ea037c-691c-4f2e-930e-a0d0d9793c7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:31.077066 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-89ea037c-691c-4f2e-930e-a0d0d9793c7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:31.082854 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9805fbc3-a4c4-459e-9f8f-56f87db76bbc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:31.083794 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9805fbc3-a4c4-459e-9f8f-56f87db76bbc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:31.089790 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9805fbc3-a4c4-459e-9f8f-56f87db76bbc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:31.090241 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9805fbc3-a4c4-459e-9f8f-56f87db76bbc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:31.090998 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9805fbc3-a4c4-459e-9f8f-56f87db76bbc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:31.091401 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9805fbc3-a4c4-459e-9f8f-56f87db76bbc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:31.105629 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-89ea037c-691c-4f2e-930e-a0d0d9793c7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043414 Apr 05 12:01:31.106195 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 815/1606] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:31 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:31.120219 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9805fbc3-a4c4-459e-9f8f-56f87db76bbc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041265 Apr 05 12:01:31.120770 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 792/1607] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:31 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:31.985366 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0869331b-d558-4b72-9206-29670fa02f58 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:31.985854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0869331b-d558-4b72-9206-29670fa02f58 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:31.992389 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0869331b-d558-4b72-9206-29670fa02f58 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:31.992839 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0869331b-d558-4b72-9206-29670fa02f58 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:31.993586 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0869331b-d558-4b72-9206-29670fa02f58 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:31.994010 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0869331b-d558-4b72-9206-29670fa02f58 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:32.073038 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-623b5784-3d80-425f-90c5-a4c6a52d35dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:32.074194 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-623b5784-3d80-425f-90c5-a4c6a52d35dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:32.080809 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-623b5784-3d80-425f-90c5-a4c6a52d35dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:32.081257 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-623b5784-3d80-425f-90c5-a4c6a52d35dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:32.082035 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-623b5784-3d80-425f-90c5-a4c6a52d35dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:32.082470 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-623b5784-3d80-425f-90c5-a4c6a52d35dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:32.111838 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-623b5784-3d80-425f-90c5-a4c6a52d35dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042941 Apr 05 12:01:32.115699 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 793/1608] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:32 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:32.120338 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e7bf889f-2b99-4377-9de6-011ed665954d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:32.121221 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e7bf889f-2b99-4377-9de6-011ed665954d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:32.127306 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e7bf889f-2b99-4377-9de6-011ed665954d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:32.127760 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e7bf889f-2b99-4377-9de6-011ed665954d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:32.128562 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e7bf889f-2b99-4377-9de6-011ed665954d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:32.128667 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.objects.instance [None req-0869331b-d558-4b72-9206-29670fa02f58 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lazy-loading 'services' on Instance uuid 2874529b-88ea-4b6d-b42a-a242dc948ccf {{(pid=123358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 12:01:32.129109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e7bf889f-2b99-4377-9de6-011ed665954d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:32.157511 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e7bf889f-2b99-4377-9de6-011ed665954d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040757 Apr 05 12:01:32.158080 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 794/1609] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:32 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:32.162784 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-56e5d42d-0cd0-430b-be8d-9dcc7510ab48 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:32.163728 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-56e5d42d-0cd0-430b-be8d-9dcc7510ab48 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:32.169233 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56e5d42d-0cd0-430b-be8d-9dcc7510ab48 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:32.169691 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56e5d42d-0cd0-430b-be8d-9dcc7510ab48 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:32.170453 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56e5d42d-0cd0-430b-be8d-9dcc7510ab48 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:32.170885 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56e5d42d-0cd0-430b-be8d-9dcc7510ab48 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:32.200177 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-56e5d42d-0cd0-430b-be8d-9dcc7510ab48 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041007 Apr 05 12:01:32.200971 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 795/1610] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:32 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:32.201115 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0869331b-d558-4b72-9206-29670fa02f58 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf/os-volume_attachments/5e620b30-befa-41cb-9d6d-541dc1914771" status: 202 len: 0 microversion: 2.1 time: 0.219411 Apr 05 12:01:32.201709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 816/1611] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Apr 5 12:01:31 2022] DELETE /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf/os-volume_attachments/5e620b30-befa-41cb-9d6d-541dc1914771 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:01:32.205545 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1f9edccc-ea3e-464e-9ac7-f3f7b4b54468 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:32.206473 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1f9edccc-ea3e-464e-9ac7-f3f7b4b54468 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:32.212655 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1f9edccc-ea3e-464e-9ac7-f3f7b4b54468 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:32.213080 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1f9edccc-ea3e-464e-9ac7-f3f7b4b54468 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:32.213826 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1f9edccc-ea3e-464e-9ac7-f3f7b4b54468 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:32.214293 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1f9edccc-ea3e-464e-9ac7-f3f7b4b54468 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:32.243967 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1f9edccc-ea3e-464e-9ac7-f3f7b4b54468 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042103 Apr 05 12:01:32.244783 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 796/1612] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:32 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:33.129440 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-952cf3cb-b18f-450c-b608-0de31fe79ef0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:33.131044 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-952cf3cb-b18f-450c-b608-0de31fe79ef0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:33.138595 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-952cf3cb-b18f-450c-b608-0de31fe79ef0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:33.139062 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-952cf3cb-b18f-450c-b608-0de31fe79ef0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:33.139860 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-952cf3cb-b18f-450c-b608-0de31fe79ef0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:33.140357 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-952cf3cb-b18f-450c-b608-0de31fe79ef0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:33.169655 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a4257aa4-5544-4679-91b7-c3a325a0b20f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:33.170168 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-952cf3cb-b18f-450c-b608-0de31fe79ef0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048769 Apr 05 12:01:33.170663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 817/1613] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:33 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:33.170829 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a4257aa4-5544-4679-91b7-c3a325a0b20f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:33.177360 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a4257aa4-5544-4679-91b7-c3a325a0b20f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:33.177808 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a4257aa4-5544-4679-91b7-c3a325a0b20f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:33.178577 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a4257aa4-5544-4679-91b7-c3a325a0b20f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:33.178988 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a4257aa4-5544-4679-91b7-c3a325a0b20f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:33.207861 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a4257aa4-5544-4679-91b7-c3a325a0b20f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042185 Apr 05 12:01:33.208457 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 797/1614] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:33 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 12:01:33.211984 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-542880ae-7839-4d72-b904-36c9024cd1d4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:33.212931 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-542880ae-7839-4d72-b904-36c9024cd1d4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:33.218926 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-542880ae-7839-4d72-b904-36c9024cd1d4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:33.219375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-542880ae-7839-4d72-b904-36c9024cd1d4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:33.220152 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-542880ae-7839-4d72-b904-36c9024cd1d4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:33.220590 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-542880ae-7839-4d72-b904-36c9024cd1d4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:33.249808 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-542880ae-7839-4d72-b904-36c9024cd1d4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041775 Apr 05 12:01:33.250320 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 818/1615] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:33 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:33.255598 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7bcc8006-7af2-47e6-8c05-85105acbeea4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:33.256976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7bcc8006-7af2-47e6-8c05-85105acbeea4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:33.264026 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7bcc8006-7af2-47e6-8c05-85105acbeea4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:33.264347 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7bcc8006-7af2-47e6-8c05-85105acbeea4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:33.265105 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7bcc8006-7af2-47e6-8c05-85105acbeea4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:33.265536 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7bcc8006-7af2-47e6-8c05-85105acbeea4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:33.294815 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7bcc8006-7af2-47e6-8c05-85105acbeea4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043808 Apr 05 12:01:33.295371 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 798/1616] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:33 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:34.186384 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6e31970a-643e-42ed-a7cf-1b81d6a3e4fe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:34.187879 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6e31970a-643e-42ed-a7cf-1b81d6a3e4fe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:34.198737 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6e31970a-643e-42ed-a7cf-1b81d6a3e4fe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:34.199480 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6e31970a-643e-42ed-a7cf-1b81d6a3e4fe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:34.200801 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6e31970a-643e-42ed-a7cf-1b81d6a3e4fe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:34.201523 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6e31970a-643e-42ed-a7cf-1b81d6a3e4fe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:34.219477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-202e4cea-61c9-43db-8aea-f8e3f3685314 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:34.220456 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-202e4cea-61c9-43db-8aea-f8e3f3685314 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:34.226952 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-202e4cea-61c9-43db-8aea-f8e3f3685314 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:34.227394 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-202e4cea-61c9-43db-8aea-f8e3f3685314 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:34.228181 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-202e4cea-61c9-43db-8aea-f8e3f3685314 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:34.228614 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-202e4cea-61c9-43db-8aea-f8e3f3685314 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:34.234262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6e31970a-643e-42ed-a7cf-1b81d6a3e4fe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054652 Apr 05 12:01:34.235199 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 819/1617] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:34 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:34.257201 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-202e4cea-61c9-43db-8aea-f8e3f3685314 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042030 Apr 05 12:01:34.257912 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 799/1618] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:34 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:34.260813 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1f9c079e-9113-4346-8aa0-b8712f4c1f79 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:34.261751 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1f9c079e-9113-4346-8aa0-b8712f4c1f79 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:34.268140 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1f9c079e-9113-4346-8aa0-b8712f4c1f79 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:34.268587 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1f9c079e-9113-4346-8aa0-b8712f4c1f79 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:34.269344 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1f9c079e-9113-4346-8aa0-b8712f4c1f79 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:34.269770 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1f9c079e-9113-4346-8aa0-b8712f4c1f79 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:34.298916 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1f9c079e-9113-4346-8aa0-b8712f4c1f79 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042058 Apr 05 12:01:34.299474 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 820/1619] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:34 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:34.306809 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a25e6a2e-7db6-4422-a161-1bd53e3f145b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:34.307723 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a25e6a2e-7db6-4422-a161-1bd53e3f145b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:34.314228 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a25e6a2e-7db6-4422-a161-1bd53e3f145b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:34.314678 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a25e6a2e-7db6-4422-a161-1bd53e3f145b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:34.315720 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a25e6a2e-7db6-4422-a161-1bd53e3f145b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:34.315823 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a25e6a2e-7db6-4422-a161-1bd53e3f145b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:34.345039 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a25e6a2e-7db6-4422-a161-1bd53e3f145b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042243 Apr 05 12:01:34.345622 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 800/1620] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:34 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:01:35.250745 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3033536e-ca98-4265-b37b-cf1225a8a780 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:35.252316 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3033536e-ca98-4265-b37b-cf1225a8a780 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:35.260707 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3033536e-ca98-4265-b37b-cf1225a8a780 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:35.261156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3033536e-ca98-4265-b37b-cf1225a8a780 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:35.261916 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3033536e-ca98-4265-b37b-cf1225a8a780 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:35.262350 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3033536e-ca98-4265-b37b-cf1225a8a780 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:35.269835 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0eb145e0-156a-434f-ab73-c52f9a28c75a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:35.270747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0eb145e0-156a-434f-ab73-c52f9a28c75a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:35.277338 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0eb145e0-156a-434f-ab73-c52f9a28c75a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:35.277783 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0eb145e0-156a-434f-ab73-c52f9a28c75a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:35.278562 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0eb145e0-156a-434f-ab73-c52f9a28c75a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:35.278976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0eb145e0-156a-434f-ab73-c52f9a28c75a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:35.292173 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3033536e-ca98-4265-b37b-cf1225a8a780 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048210 Apr 05 12:01:35.293360 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 821/1621] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:35 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:35.310447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-60d596cf-9cd6-4f8a-994a-6745e3a8c4a9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:35.310662 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0eb145e0-156a-434f-ab73-c52f9a28c75a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044721 Apr 05 12:01:35.311073 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 801/1622] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:35 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:35.311394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-60d596cf-9cd6-4f8a-994a-6745e3a8c4a9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:35.317598 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-60d596cf-9cd6-4f8a-994a-6745e3a8c4a9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:35.318049 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-60d596cf-9cd6-4f8a-994a-6745e3a8c4a9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:35.318815 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-60d596cf-9cd6-4f8a-994a-6745e3a8c4a9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:35.319400 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-60d596cf-9cd6-4f8a-994a-6745e3a8c4a9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:35.347234 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-60d596cf-9cd6-4f8a-994a-6745e3a8c4a9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040659 Apr 05 12:01:35.347788 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 822/1623] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:35 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:35.359637 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a1c981ba-b340-4403-b921-074fc16ad2cd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:35.361530 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a1c981ba-b340-4403-b921-074fc16ad2cd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:35.368545 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a1c981ba-b340-4403-b921-074fc16ad2cd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:35.368976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a1c981ba-b340-4403-b921-074fc16ad2cd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:35.369733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a1c981ba-b340-4403-b921-074fc16ad2cd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:35.370162 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a1c981ba-b340-4403-b921-074fc16ad2cd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:35.398356 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a1c981ba-b340-4403-b921-074fc16ad2cd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045193 Apr 05 12:01:35.398918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 802/1624] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:35 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:36.308674 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6459a35d-58fd-4d8b-9438-2b69946960d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:36.310354 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6459a35d-58fd-4d8b-9438-2b69946960d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:36.321161 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6459a35d-58fd-4d8b-9438-2b69946960d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:36.321910 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6459a35d-58fd-4d8b-9438-2b69946960d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:36.323232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6459a35d-58fd-4d8b-9438-2b69946960d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:36.323958 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6459a35d-58fd-4d8b-9438-2b69946960d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:36.326298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2e6966cf-9173-45c4-ae26-827744ca3ece tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:36.327771 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2e6966cf-9173-45c4-ae26-827744ca3ece tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:36.337153 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2e6966cf-9173-45c4-ae26-827744ca3ece tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:36.337601 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2e6966cf-9173-45c4-ae26-827744ca3ece tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:36.338370 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2e6966cf-9173-45c4-ae26-827744ca3ece tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:36.338801 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2e6966cf-9173-45c4-ae26-827744ca3ece tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:36.358539 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6459a35d-58fd-4d8b-9438-2b69946960d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056664 Apr 05 12:01:36.359114 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 823/1625] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:36 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:36.364267 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3802d3e0-593e-444b-8fe9-dc420b251624 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:36.365181 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3802d3e0-593e-444b-8fe9-dc420b251624 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:36.368392 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2e6966cf-9173-45c4-ae26-827744ca3ece tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048588 Apr 05 12:01:36.368958 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 803/1626] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:36 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:36.371016 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3802d3e0-593e-444b-8fe9-dc420b251624 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:36.371466 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3802d3e0-593e-444b-8fe9-dc420b251624 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:36.372270 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3802d3e0-593e-444b-8fe9-dc420b251624 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:36.372706 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3802d3e0-593e-444b-8fe9-dc420b251624 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:36.400853 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3802d3e0-593e-444b-8fe9-dc420b251624 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040761 Apr 05 12:01:36.401404 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 824/1627] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:36 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:36.410012 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-df862131-fe3d-4497-9715-db28f86c1257 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:36.410940 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-df862131-fe3d-4497-9715-db28f86c1257 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:36.416879 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-df862131-fe3d-4497-9715-db28f86c1257 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:36.417318 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-df862131-fe3d-4497-9715-db28f86c1257 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:36.418096 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-df862131-fe3d-4497-9715-db28f86c1257 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:36.418530 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-df862131-fe3d-4497-9715-db28f86c1257 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:36.449019 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-df862131-fe3d-4497-9715-db28f86c1257 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042858 Apr 05 12:01:36.449664 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 804/1628] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:36 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:37.375043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1aaf992d-e4ff-4f5a-8d94-640aca5ee824 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:37.376584 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1aaf992d-e4ff-4f5a-8d94-640aca5ee824 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:37.383399 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ff214dcf-b5e1-46da-8deb-94cd4a2fd52b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:37.384415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ff214dcf-b5e1-46da-8deb-94cd4a2fd52b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:37.385415 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1aaf992d-e4ff-4f5a-8d94-640aca5ee824 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:37.385856 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1aaf992d-e4ff-4f5a-8d94-640aca5ee824 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:37.386617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1aaf992d-e4ff-4f5a-8d94-640aca5ee824 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:37.387058 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1aaf992d-e4ff-4f5a-8d94-640aca5ee824 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:37.390856 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff214dcf-b5e1-46da-8deb-94cd4a2fd52b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:37.391307 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff214dcf-b5e1-46da-8deb-94cd4a2fd52b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:37.392098 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff214dcf-b5e1-46da-8deb-94cd4a2fd52b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:37.392516 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff214dcf-b5e1-46da-8deb-94cd4a2fd52b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:37.415797 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1aaf992d-e4ff-4f5a-8d94-640aca5ee824 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047436 Apr 05 12:01:37.416787 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 825/1629] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:37 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:37.420848 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-834600f8-c167-4e26-900d-2eb6d9b32d66 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:37.421739 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-834600f8-c167-4e26-900d-2eb6d9b32d66 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:37.422008 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ff214dcf-b5e1-46da-8deb-94cd4a2fd52b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044581 Apr 05 12:01:37.422539 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 805/1630] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:37 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:37.427466 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-834600f8-c167-4e26-900d-2eb6d9b32d66 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:37.427906 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-834600f8-c167-4e26-900d-2eb6d9b32d66 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:37.428685 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-834600f8-c167-4e26-900d-2eb6d9b32d66 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:37.429120 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-834600f8-c167-4e26-900d-2eb6d9b32d66 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:37.457808 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-834600f8-c167-4e26-900d-2eb6d9b32d66 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040406 Apr 05 12:01:37.458357 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 826/1631] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:37 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:37.461029 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ee1cd003-246d-4867-8819-ee2133c31f24 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:37.461948 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ee1cd003-246d-4867-8819-ee2133c31f24 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:37.467866 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee1cd003-246d-4867-8819-ee2133c31f24 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:37.468347 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee1cd003-246d-4867-8819-ee2133c31f24 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:37.469105 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee1cd003-246d-4867-8819-ee2133c31f24 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:37.469536 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee1cd003-246d-4867-8819-ee2133c31f24 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:37.498683 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ee1cd003-246d-4867-8819-ee2133c31f24 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041713 Apr 05 12:01:37.499259 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 806/1632] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:37 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:38.431167 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ac055d2f-47dc-49ac-a729-89dfb7f3bd78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:38.432685 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ac055d2f-47dc-49ac-a729-89dfb7f3bd78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:38.437768 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e3a8694c-d9a3-42ce-a169-935386ff97ee tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:38.439264 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e3a8694c-d9a3-42ce-a169-935386ff97ee tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:38.443620 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ac055d2f-47dc-49ac-a729-89dfb7f3bd78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:38.444716 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ac055d2f-47dc-49ac-a729-89dfb7f3bd78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:38.445528 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ac055d2f-47dc-49ac-a729-89dfb7f3bd78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:38.445993 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ac055d2f-47dc-49ac-a729-89dfb7f3bd78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:38.447772 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e3a8694c-d9a3-42ce-a169-935386ff97ee tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:38.448256 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e3a8694c-d9a3-42ce-a169-935386ff97ee tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:38.449029 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e3a8694c-d9a3-42ce-a169-935386ff97ee tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:38.449474 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e3a8694c-d9a3-42ce-a169-935386ff97ee tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:38.475959 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ac055d2f-47dc-49ac-a729-89dfb7f3bd78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051356 Apr 05 12:01:38.476564 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 827/1633] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:38 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:38.479417 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e3a8694c-d9a3-42ce-a169-935386ff97ee tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048298 Apr 05 12:01:38.480108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 807/1634] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:38 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:38.481020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5457353d-46ce-41b1-bfb5-cf1da4b23492 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:38.481937 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5457353d-46ce-41b1-bfb5-cf1da4b23492 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:38.488481 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5457353d-46ce-41b1-bfb5-cf1da4b23492 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:38.488935 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5457353d-46ce-41b1-bfb5-cf1da4b23492 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:38.489715 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5457353d-46ce-41b1-bfb5-cf1da4b23492 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:38.490143 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5457353d-46ce-41b1-bfb5-cf1da4b23492 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:38.510444 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-704cbaa7-cb09-4f17-b087-649eb8b348d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:38.511389 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-704cbaa7-cb09-4f17-b087-649eb8b348d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:38.517470 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-704cbaa7-cb09-4f17-b087-649eb8b348d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:38.517923 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-704cbaa7-cb09-4f17-b087-649eb8b348d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:38.518694 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-704cbaa7-cb09-4f17-b087-649eb8b348d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:38.518878 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5457353d-46ce-41b1-bfb5-cf1da4b23492 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041323 Apr 05 12:01:38.519127 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-704cbaa7-cb09-4f17-b087-649eb8b348d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:38.519445 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 828/1635] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:38 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:38.548452 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-704cbaa7-cb09-4f17-b087-649eb8b348d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041872 Apr 05 12:01:38.549003 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 808/1636] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:38 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:39.488669 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ae9fc023-14b3-4e4e-b733-30a457d2cd4e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:39.489590 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ae9fc023-14b3-4e4e-b733-30a457d2cd4e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:39.492018 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-964af3e5-7a7f-4ea6-945b-27f15eb8ec3f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:39.494143 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-964af3e5-7a7f-4ea6-945b-27f15eb8ec3f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:39.495913 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ae9fc023-14b3-4e4e-b733-30a457d2cd4e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:39.496396 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ae9fc023-14b3-4e4e-b733-30a457d2cd4e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:39.497254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ae9fc023-14b3-4e4e-b733-30a457d2cd4e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:39.497850 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ae9fc023-14b3-4e4e-b733-30a457d2cd4e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:39.501565 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-964af3e5-7a7f-4ea6-945b-27f15eb8ec3f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:39.501976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-964af3e5-7a7f-4ea6-945b-27f15eb8ec3f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:39.503022 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-964af3e5-7a7f-4ea6-945b-27f15eb8ec3f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:39.503691 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-964af3e5-7a7f-4ea6-945b-27f15eb8ec3f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:39.528116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ae9fc023-14b3-4e4e-b733-30a457d2cd4e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043993 Apr 05 12:01:39.528704 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 829/1637] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:39 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:39.533169 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-31bda1da-75b2-46bc-9909-22c1b294b17a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:39.534026 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-964af3e5-7a7f-4ea6-945b-27f15eb8ec3f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046352 Apr 05 12:01:39.534148 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-31bda1da-75b2-46bc-9909-22c1b294b17a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:39.534595 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 809/1638] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:39 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:39.539996 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-31bda1da-75b2-46bc-9909-22c1b294b17a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:39.540477 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-31bda1da-75b2-46bc-9909-22c1b294b17a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:39.541234 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-31bda1da-75b2-46bc-9909-22c1b294b17a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:39.541664 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-31bda1da-75b2-46bc-9909-22c1b294b17a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:39.560327 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-acda714f-1a4b-444d-a1f8-f1dd9c50cec8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:39.561369 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-acda714f-1a4b-444d-a1f8-f1dd9c50cec8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:39.567669 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-acda714f-1a4b-444d-a1f8-f1dd9c50cec8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:39.568125 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-acda714f-1a4b-444d-a1f8-f1dd9c50cec8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:39.569628 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-acda714f-1a4b-444d-a1f8-f1dd9c50cec8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:39.570001 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-31bda1da-75b2-46bc-9909-22c1b294b17a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040226 Apr 05 12:01:39.570150 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-acda714f-1a4b-444d-a1f8-f1dd9c50cec8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:39.570568 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 830/1639] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:39 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:39.599369 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-acda714f-1a4b-444d-a1f8-f1dd9c50cec8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042900 Apr 05 12:01:39.599955 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 810/1640] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:39 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:40.539606 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ba4840df-e679-4c9b-9a95-d6fa825cee79 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:40.540537 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ba4840df-e679-4c9b-9a95-d6fa825cee79 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:40.545765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1ab9e352-49fa-41e8-a250-626ef320c32a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:40.546706 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1ab9e352-49fa-41e8-a250-626ef320c32a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:40.547263 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ba4840df-e679-4c9b-9a95-d6fa825cee79 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:40.547709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ba4840df-e679-4c9b-9a95-d6fa825cee79 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:40.548521 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ba4840df-e679-4c9b-9a95-d6fa825cee79 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:40.548946 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ba4840df-e679-4c9b-9a95-d6fa825cee79 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:40.553950 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ab9e352-49fa-41e8-a250-626ef320c32a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:40.554408 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ab9e352-49fa-41e8-a250-626ef320c32a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:40.555201 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ab9e352-49fa-41e8-a250-626ef320c32a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:40.555663 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ab9e352-49fa-41e8-a250-626ef320c32a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:40.578685 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ba4840df-e679-4c9b-9a95-d6fa825cee79 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043284 Apr 05 12:01:40.579249 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 831/1641] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:40 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:40.584680 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1ab9e352-49fa-41e8-a250-626ef320c32a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042862 Apr 05 12:01:40.585243 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 811/1642] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:40 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:40.586100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7d6a10cf-154e-42f6-9f85-077c2bd7f93d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:40.587005 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7d6a10cf-154e-42f6-9f85-077c2bd7f93d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:40.592836 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7d6a10cf-154e-42f6-9f85-077c2bd7f93d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:40.593274 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7d6a10cf-154e-42f6-9f85-077c2bd7f93d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:40.594024 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7d6a10cf-154e-42f6-9f85-077c2bd7f93d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:40.594453 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7d6a10cf-154e-42f6-9f85-077c2bd7f93d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:40.611058 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-55d18cb2-cf2e-49cf-93fa-55b46ef00575 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:40.611968 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-55d18cb2-cf2e-49cf-93fa-55b46ef00575 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:40.617922 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-55d18cb2-cf2e-49cf-93fa-55b46ef00575 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:40.618331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-55d18cb2-cf2e-49cf-93fa-55b46ef00575 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:40.619103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-55d18cb2-cf2e-49cf-93fa-55b46ef00575 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:40.619746 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-55d18cb2-cf2e-49cf-93fa-55b46ef00575 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:40.623562 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7d6a10cf-154e-42f6-9f85-077c2bd7f93d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043333 Apr 05 12:01:40.624312 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 832/1643] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:40 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:40.648537 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-55d18cb2-cf2e-49cf-93fa-55b46ef00575 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041487 Apr 05 12:01:40.649093 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 812/1644] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:40 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:01:41.594793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-770752dd-c7ef-408d-906f-153a8c8c3a3c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:41.596337 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-770752dd-c7ef-408d-906f-153a8c8c3a3c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:41.600250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-275bb28e-2607-473c-bc5b-097daf0eb959 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:41.601747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-275bb28e-2607-473c-bc5b-097daf0eb959 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:41.606926 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-770752dd-c7ef-408d-906f-153a8c8c3a3c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:41.607669 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-770752dd-c7ef-408d-906f-153a8c8c3a3c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:41.609009 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-770752dd-c7ef-408d-906f-153a8c8c3a3c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:41.609724 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-770752dd-c7ef-408d-906f-153a8c8c3a3c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:41.612384 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-275bb28e-2607-473c-bc5b-097daf0eb959 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:41.613130 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-275bb28e-2607-473c-bc5b-097daf0eb959 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:41.614380 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-275bb28e-2607-473c-bc5b-097daf0eb959 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:41.615095 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-275bb28e-2607-473c-bc5b-097daf0eb959 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:41.643220 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-770752dd-c7ef-408d-906f-153a8c8c3a3c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055017 Apr 05 12:01:41.643789 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 833/1645] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:41 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:41.644952 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-275bb28e-2607-473c-bc5b-097daf0eb959 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051286 Apr 05 12:01:41.645605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 813/1646] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:41 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:41.648402 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d2e304b4-0bda-47ee-a159-0fc30b4e4ba8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:41.649323 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d2e304b4-0bda-47ee-a159-0fc30b4e4ba8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:41.655261 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d2e304b4-0bda-47ee-a159-0fc30b4e4ba8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:41.655748 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d2e304b4-0bda-47ee-a159-0fc30b4e4ba8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:41.656557 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d2e304b4-0bda-47ee-a159-0fc30b4e4ba8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:41.656995 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d2e304b4-0bda-47ee-a159-0fc30b4e4ba8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:41.660337 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-214a89af-adf8-4cf4-8556-01fdaf0f6167 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:41.661292 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-214a89af-adf8-4cf4-8556-01fdaf0f6167 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:41.667630 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-214a89af-adf8-4cf4-8556-01fdaf0f6167 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:41.668055 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-214a89af-adf8-4cf4-8556-01fdaf0f6167 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:41.668862 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-214a89af-adf8-4cf4-8556-01fdaf0f6167 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:41.669297 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-214a89af-adf8-4cf4-8556-01fdaf0f6167 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:41.685373 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d2e304b4-0bda-47ee-a159-0fc30b4e4ba8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040455 Apr 05 12:01:41.685844 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 834/1647] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:41 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:41.701725 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-214a89af-adf8-4cf4-8556-01fdaf0f6167 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045320 Apr 05 12:01:41.702945 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 814/1648] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:41 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:42.656431 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-da6808b2-1faa-4750-975f-60d7635b3ae7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:42.657540 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-da6808b2-1faa-4750-975f-60d7635b3ae7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:42.657746 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4c92e728-2456-4187-a9e4-2b9a3dd91efc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:42.658806 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4c92e728-2456-4187-a9e4-2b9a3dd91efc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:42.665273 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-da6808b2-1faa-4750-975f-60d7635b3ae7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:42.665721 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-da6808b2-1faa-4750-975f-60d7635b3ae7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:42.666446 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c92e728-2456-4187-a9e4-2b9a3dd91efc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:42.666610 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-da6808b2-1faa-4750-975f-60d7635b3ae7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:42.666889 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c92e728-2456-4187-a9e4-2b9a3dd91efc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:42.667046 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-da6808b2-1faa-4750-975f-60d7635b3ae7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:42.667652 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c92e728-2456-4187-a9e4-2b9a3dd91efc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:42.668117 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c92e728-2456-4187-a9e4-2b9a3dd91efc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:42.697487 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4c92e728-2456-4187-a9e4-2b9a3dd91efc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044364 Apr 05 12:01:42.697812 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-da6808b2-1faa-4750-975f-60d7635b3ae7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046203 Apr 05 12:01:42.698312 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 815/1649] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:42 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:42.701060 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 835/1650] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:42 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:42.705217 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-989ba35b-14aa-4766-b2ec-66c89d6d7ef0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:42.706127 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-989ba35b-14aa-4766-b2ec-66c89d6d7ef0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:42.711950 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a8831873-2ac4-459c-a2df-8f259f66ebbb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:42.712388 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-989ba35b-14aa-4766-b2ec-66c89d6d7ef0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:42.712841 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-989ba35b-14aa-4766-b2ec-66c89d6d7ef0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:42.712961 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a8831873-2ac4-459c-a2df-8f259f66ebbb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:42.713614 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-989ba35b-14aa-4766-b2ec-66c89d6d7ef0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:42.714050 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-989ba35b-14aa-4766-b2ec-66c89d6d7ef0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:42.718952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a8831873-2ac4-459c-a2df-8f259f66ebbb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:42.719398 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a8831873-2ac4-459c-a2df-8f259f66ebbb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:42.720193 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a8831873-2ac4-459c-a2df-8f259f66ebbb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:42.720632 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a8831873-2ac4-459c-a2df-8f259f66ebbb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:42.743447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-989ba35b-14aa-4766-b2ec-66c89d6d7ef0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044028 Apr 05 12:01:42.744299 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 816/1651] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:42 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:42.749549 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a8831873-2ac4-459c-a2df-8f259f66ebbb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041247 Apr 05 12:01:42.750373 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 836/1652] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:42 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:43.712781 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-831660b0-7100-4e2b-a338-e438ca4ae262 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:43.713388 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b66ea08c-d601-43f1-8325-3787dbf7f2b2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:43.713760 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b66ea08c-d601-43f1-8325-3787dbf7f2b2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:43.713863 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-831660b0-7100-4e2b-a338-e438ca4ae262 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:43.720373 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-831660b0-7100-4e2b-a338-e438ca4ae262 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:43.720803 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-831660b0-7100-4e2b-a338-e438ca4ae262 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:43.721230 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b66ea08c-d601-43f1-8325-3787dbf7f2b2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:43.721565 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-831660b0-7100-4e2b-a338-e438ca4ae262 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:43.721727 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b66ea08c-d601-43f1-8325-3787dbf7f2b2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:43.721991 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-831660b0-7100-4e2b-a338-e438ca4ae262 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:43.722553 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b66ea08c-d601-43f1-8325-3787dbf7f2b2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:43.722982 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b66ea08c-d601-43f1-8325-3787dbf7f2b2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:43.751281 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-831660b0-7100-4e2b-a338-e438ca4ae262 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044238 Apr 05 12:01:43.755209 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 817/1653] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:43 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:43.755361 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b66ea08c-d601-43f1-8325-3787dbf7f2b2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045483 Apr 05 12:01:43.755361 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 837/1654] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:43 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:43.756401 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4472f69b-13a8-42a3-a5e3-74c4b05df695 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:43.757301 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4472f69b-13a8-42a3-a5e3-74c4b05df695 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:43.761428 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bcdf2093-10a2-464f-9afb-831223b0e0d9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:43.762316 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bcdf2093-10a2-464f-9afb-831223b0e0d9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:43.763417 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4472f69b-13a8-42a3-a5e3-74c4b05df695 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:43.763867 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4472f69b-13a8-42a3-a5e3-74c4b05df695 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:43.764671 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4472f69b-13a8-42a3-a5e3-74c4b05df695 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:43.765105 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4472f69b-13a8-42a3-a5e3-74c4b05df695 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:43.768104 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bcdf2093-10a2-464f-9afb-831223b0e0d9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:43.768564 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bcdf2093-10a2-464f-9afb-831223b0e0d9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:43.769314 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bcdf2093-10a2-464f-9afb-831223b0e0d9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:43.769742 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bcdf2093-10a2-464f-9afb-831223b0e0d9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:43.795346 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4472f69b-13a8-42a3-a5e3-74c4b05df695 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042501 Apr 05 12:01:43.796107 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 818/1655] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:43 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:43.801365 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bcdf2093-10a2-464f-9afb-831223b0e0d9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043688 Apr 05 12:01:43.802133 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 838/1656] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:43 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:44.767275 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d5379880-00dc-4363-8de4-8552e44b0bda tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:44.768136 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c9a043ef-f062-4110-b682-bee5286f20bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:44.768782 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d5379880-00dc-4363-8de4-8552e44b0bda tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:44.769264 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c9a043ef-f062-4110-b682-bee5286f20bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:44.777364 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d5379880-00dc-4363-8de4-8552e44b0bda tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:44.777538 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9a043ef-f062-4110-b682-bee5286f20bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:44.777807 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d5379880-00dc-4363-8de4-8552e44b0bda tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:44.777953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9a043ef-f062-4110-b682-bee5286f20bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:44.778574 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d5379880-00dc-4363-8de4-8552e44b0bda tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:44.778720 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9a043ef-f062-4110-b682-bee5286f20bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:44.779005 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d5379880-00dc-4363-8de4-8552e44b0bda tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:44.779190 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9a043ef-f062-4110-b682-bee5286f20bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:44.808605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d5379880-00dc-4363-8de4-8552e44b0bda tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048028 Apr 05 12:01:44.809166 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 819/1657] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:44 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:44.810277 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c9a043ef-f062-4110-b682-bee5286f20bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049051 Apr 05 12:01:44.814207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 839/1658] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:44 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:44.814375 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-50d0637b-4bb5-4fa8-b83e-8ed4df534ba9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:44.815255 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-50d0637b-4bb5-4fa8-b83e-8ed4df534ba9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:44.816216 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7f10008d-08af-4bdf-961c-8f588b93d220 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:44.817115 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7f10008d-08af-4bdf-961c-8f588b93d220 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:44.821687 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-50d0637b-4bb5-4fa8-b83e-8ed4df534ba9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:44.822149 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-50d0637b-4bb5-4fa8-b83e-8ed4df534ba9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:44.822904 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-50d0637b-4bb5-4fa8-b83e-8ed4df534ba9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:44.823288 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7f10008d-08af-4bdf-961c-8f588b93d220 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:44.823396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-50d0637b-4bb5-4fa8-b83e-8ed4df534ba9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:44.823744 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7f10008d-08af-4bdf-961c-8f588b93d220 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:44.824543 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7f10008d-08af-4bdf-961c-8f588b93d220 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:44.824967 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7f10008d-08af-4bdf-961c-8f588b93d220 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:44.852598 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-50d0637b-4bb5-4fa8-b83e-8ed4df534ba9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042399 Apr 05 12:01:44.853500 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7f10008d-08af-4bdf-961c-8f588b93d220 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041517 Apr 05 12:01:44.853624 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 820/1659] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:44 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:44.853987 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 840/1660] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:44 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:45.823841 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bdf1162d-8f03-42a5-ac71-734465c7b31c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:45.824471 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0aba4423-8648-4fad-b674-49e4b5c985de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:45.824914 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bdf1162d-8f03-42a5-ac71-734465c7b31c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:45.825579 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0aba4423-8648-4fad-b674-49e4b5c985de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:45.832611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bdf1162d-8f03-42a5-ac71-734465c7b31c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:45.833137 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bdf1162d-8f03-42a5-ac71-734465c7b31c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:45.833328 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0aba4423-8648-4fad-b674-49e4b5c985de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:45.833767 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0aba4423-8648-4fad-b674-49e4b5c985de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:45.834014 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bdf1162d-8f03-42a5-ac71-734465c7b31c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:45.834522 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bdf1162d-8f03-42a5-ac71-734465c7b31c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:45.834651 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0aba4423-8648-4fad-b674-49e4b5c985de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:45.835153 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0aba4423-8648-4fad-b674-49e4b5c985de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:45.866603 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0aba4423-8648-4fad-b674-49e4b5c985de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047285 Apr 05 12:01:45.867141 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 841/1661] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:45 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:45.867820 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bdf1162d-8f03-42a5-ac71-734465c7b31c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049766 Apr 05 12:01:45.871768 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 821/1662] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:45 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:45.871902 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-36766276-bbd2-48e1-a7c0-3cc8a497671a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:45.872691 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-36766276-bbd2-48e1-a7c0-3cc8a497671a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:45.875225 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e6f484fb-112f-471d-ace5-c5e8e5a29883 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:45.876114 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e6f484fb-112f-471d-ace5-c5e8e5a29883 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:45.878580 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-36766276-bbd2-48e1-a7c0-3cc8a497671a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:45.879049 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-36766276-bbd2-48e1-a7c0-3cc8a497671a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:45.879797 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-36766276-bbd2-48e1-a7c0-3cc8a497671a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:45.880263 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-36766276-bbd2-48e1-a7c0-3cc8a497671a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:45.881994 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6f484fb-112f-471d-ace5-c5e8e5a29883 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:45.882436 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6f484fb-112f-471d-ace5-c5e8e5a29883 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:45.883235 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6f484fb-112f-471d-ace5-c5e8e5a29883 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:45.883684 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6f484fb-112f-471d-ace5-c5e8e5a29883 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:45.911968 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e6f484fb-112f-471d-ace5-c5e8e5a29883 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042282 Apr 05 12:01:45.912248 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-36766276-bbd2-48e1-a7c0-3cc8a497671a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044000 Apr 05 12:01:45.915772 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 842/1664] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:45 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:45.915970 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 822/1664] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:45 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:46.883121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6ca30424-c89b-47a1-8cfb-42db2c05399a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:46.883995 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-84cbbbe8-c889-42b9-8a78-8466377af084 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:46.884662 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6ca30424-c89b-47a1-8cfb-42db2c05399a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:46.885250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-84cbbbe8-c889-42b9-8a78-8466377af084 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:46.895194 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6ca30424-c89b-47a1-8cfb-42db2c05399a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:46.895949 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6ca30424-c89b-47a1-8cfb-42db2c05399a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:46.896272 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-84cbbbe8-c889-42b9-8a78-8466377af084 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:46.896962 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-84cbbbe8-c889-42b9-8a78-8466377af084 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:46.897531 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6ca30424-c89b-47a1-8cfb-42db2c05399a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:46.898227 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-84cbbbe8-c889-42b9-8a78-8466377af084 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:46.898468 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6ca30424-c89b-47a1-8cfb-42db2c05399a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:46.899008 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-84cbbbe8-c889-42b9-8a78-8466377af084 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:46.927925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6ca30424-c89b-47a1-8cfb-42db2c05399a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051673 Apr 05 12:01:46.928509 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 843/1665] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:46 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:46.928845 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-84cbbbe8-c889-42b9-8a78-8466377af084 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051694 Apr 05 12:01:46.932873 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 823/1666] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:46 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:46.933740 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d7e2a3fc-594c-4415-8133-01aa7751f339 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:46.933902 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fc3261c0-337d-4d5a-9ff2-b1a8478fa9ed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:46.934812 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fc3261c0-337d-4d5a-9ff2-b1a8478fa9ed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:46.935095 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d7e2a3fc-594c-4415-8133-01aa7751f339 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:46.941722 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fc3261c0-337d-4d5a-9ff2-b1a8478fa9ed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:46.942163 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fc3261c0-337d-4d5a-9ff2-b1a8478fa9ed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:46.942616 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d7e2a3fc-594c-4415-8133-01aa7751f339 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:46.942924 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fc3261c0-337d-4d5a-9ff2-b1a8478fa9ed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:46.943048 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d7e2a3fc-594c-4415-8133-01aa7751f339 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:46.943342 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fc3261c0-337d-4d5a-9ff2-b1a8478fa9ed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:46.943809 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d7e2a3fc-594c-4415-8133-01aa7751f339 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:46.944288 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d7e2a3fc-594c-4415-8133-01aa7751f339 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:46.972779 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fc3261c0-337d-4d5a-9ff2-b1a8478fa9ed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042310 Apr 05 12:01:46.973634 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 824/1667] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:46 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:46.973890 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d7e2a3fc-594c-4415-8133-01aa7751f339 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044239 Apr 05 12:01:46.977591 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 844/1668] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:46 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:47.940554 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2bf31406-399d-48a9-8241-a674d21bdc0d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:47.941226 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d75fed7c-0165-45c4-a7bb-3c7545d16bc8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:47.941752 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d75fed7c-0165-45c4-a7bb-3c7545d16bc8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:47.942588 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2bf31406-399d-48a9-8241-a674d21bdc0d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:47.948990 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d75fed7c-0165-45c4-a7bb-3c7545d16bc8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:47.949541 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2bf31406-399d-48a9-8241-a674d21bdc0d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:47.949660 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d75fed7c-0165-45c4-a7bb-3c7545d16bc8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:47.949857 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2bf31406-399d-48a9-8241-a674d21bdc0d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:47.950827 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d75fed7c-0165-45c4-a7bb-3c7545d16bc8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:47.950827 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d75fed7c-0165-45c4-a7bb-3c7545d16bc8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:47.951107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2bf31406-399d-48a9-8241-a674d21bdc0d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:47.951551 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2bf31406-399d-48a9-8241-a674d21bdc0d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:47.982575 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d75fed7c-0165-45c4-a7bb-3c7545d16bc8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046015 Apr 05 12:01:47.983168 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 825/1669] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:47 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:47.983356 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2bf31406-399d-48a9-8241-a674d21bdc0d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046523 Apr 05 12:01:47.987408 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 845/1670] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:47 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:47.989022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-86b36d28-ddcb-49c9-85e9-86ec7a163cc3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:47.989933 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-86b36d28-ddcb-49c9-85e9-86ec7a163cc3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:47.991412 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-62336d22-e0dc-4488-b3e6-a11191691bad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:47.992385 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-62336d22-e0dc-4488-b3e6-a11191691bad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:47.996363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-86b36d28-ddcb-49c9-85e9-86ec7a163cc3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:47.996823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-86b36d28-ddcb-49c9-85e9-86ec7a163cc3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:47.997635 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-86b36d28-ddcb-49c9-85e9-86ec7a163cc3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:47.998245 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-86b36d28-ddcb-49c9-85e9-86ec7a163cc3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:47.998437 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-62336d22-e0dc-4488-b3e6-a11191691bad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:47.998947 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-62336d22-e0dc-4488-b3e6-a11191691bad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:47.999655 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-62336d22-e0dc-4488-b3e6-a11191691bad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:48.000121 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-62336d22-e0dc-4488-b3e6-a11191691bad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:48.030889 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-62336d22-e0dc-4488-b3e6-a11191691bad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046692 Apr 05 12:01:48.031819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 826/1671] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:47 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:48.033844 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-86b36d28-ddcb-49c9-85e9-86ec7a163cc3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048670 Apr 05 12:01:48.034712 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 846/1672] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:47 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:48.997035 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3957bcbf-244f-49c1-b235-d7b28ce6035b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:48.997782 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-74b55d84-a00e-4b87-8037-fa847217bb7e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:48.998163 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-74b55d84-a00e-4b87-8037-fa847217bb7e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:48.999305 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3957bcbf-244f-49c1-b235-d7b28ce6035b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:49.004303 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-74b55d84-a00e-4b87-8037-fa847217bb7e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:49.004759 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-74b55d84-a00e-4b87-8037-fa847217bb7e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:49.005534 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-74b55d84-a00e-4b87-8037-fa847217bb7e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:49.005670 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3957bcbf-244f-49c1-b235-d7b28ce6035b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:49.005937 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-74b55d84-a00e-4b87-8037-fa847217bb7e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:49.006188 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3957bcbf-244f-49c1-b235-d7b28ce6035b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:49.006983 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3957bcbf-244f-49c1-b235-d7b28ce6035b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:49.007553 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3957bcbf-244f-49c1-b235-d7b28ce6035b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:49.035564 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-74b55d84-a00e-4b87-8037-fa847217bb7e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043185 Apr 05 12:01:49.039596 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 827/1673] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:48 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:49.039773 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3957bcbf-244f-49c1-b235-d7b28ce6035b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045820 Apr 05 12:01:49.039773 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 847/1674] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:48 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:49.043419 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a6c7923d-01dc-49e1-8ac6-e273379b1fa3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:49.044372 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a6c7923d-01dc-49e1-8ac6-e273379b1fa3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:49.045198 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8e777e3e-ff7c-47d2-bcf1-208c5bad4a42 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:49.046132 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8e777e3e-ff7c-47d2-bcf1-208c5bad4a42 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:49.050408 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a6c7923d-01dc-49e1-8ac6-e273379b1fa3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:49.050860 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a6c7923d-01dc-49e1-8ac6-e273379b1fa3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:49.051637 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a6c7923d-01dc-49e1-8ac6-e273379b1fa3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:49.052068 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a6c7923d-01dc-49e1-8ac6-e273379b1fa3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:49.052267 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e777e3e-ff7c-47d2-bcf1-208c5bad4a42 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:49.052739 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e777e3e-ff7c-47d2-bcf1-208c5bad4a42 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:49.053515 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e777e3e-ff7c-47d2-bcf1-208c5bad4a42 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:49.053967 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e777e3e-ff7c-47d2-bcf1-208c5bad4a42 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:49.083307 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a6c7923d-01dc-49e1-8ac6-e273379b1fa3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044733 Apr 05 12:01:49.084808 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 828/1675] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:49 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:49.089314 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8e777e3e-ff7c-47d2-bcf1-208c5bad4a42 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047785 Apr 05 12:01:49.089882 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 848/1676] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:49 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:50.050976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7b7c1902-77fc-48c5-a79b-efa978c0c973 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:50.052534 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7b7c1902-77fc-48c5-a79b-efa978c0c973 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:50.053484 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4676e4a7-8d06-4b13-83ca-f09d723a9576 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:50.054955 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4676e4a7-8d06-4b13-83ca-f09d723a9576 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:50.060640 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7b7c1902-77fc-48c5-a79b-efa978c0c973 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:50.061083 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7b7c1902-77fc-48c5-a79b-efa978c0c973 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:50.061878 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7b7c1902-77fc-48c5-a79b-efa978c0c973 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:50.062022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4676e4a7-8d06-4b13-83ca-f09d723a9576 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:50.062303 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7b7c1902-77fc-48c5-a79b-efa978c0c973 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:50.062459 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4676e4a7-8d06-4b13-83ca-f09d723a9576 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:50.063152 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4676e4a7-8d06-4b13-83ca-f09d723a9576 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:50.063580 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4676e4a7-8d06-4b13-83ca-f09d723a9576 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:50.091096 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7b7c1902-77fc-48c5-a79b-efa978c0c973 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046651 Apr 05 12:01:50.091653 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 829/1677] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:50 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:50.092666 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4676e4a7-8d06-4b13-83ca-f09d723a9576 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045854 Apr 05 12:01:50.096699 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 849/1678] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:50 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:50.096853 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-425e0265-88ee-4e0c-9424-e7a4e5f41146 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:50.097039 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-425e0265-88ee-4e0c-9424-e7a4e5f41146 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:50.100917 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2b14d2a0-d92f-4803-8ae0-541404454f7f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:50.101858 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2b14d2a0-d92f-4803-8ae0-541404454f7f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:50.103361 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-425e0265-88ee-4e0c-9424-e7a4e5f41146 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:50.103713 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-425e0265-88ee-4e0c-9424-e7a4e5f41146 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:50.104510 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-425e0265-88ee-4e0c-9424-e7a4e5f41146 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:50.104940 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-425e0265-88ee-4e0c-9424-e7a4e5f41146 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:50.107924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2b14d2a0-d92f-4803-8ae0-541404454f7f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:50.108408 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2b14d2a0-d92f-4803-8ae0-541404454f7f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:50.109152 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2b14d2a0-d92f-4803-8ae0-541404454f7f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:50.109577 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2b14d2a0-d92f-4803-8ae0-541404454f7f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:50.136179 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-425e0265-88ee-4e0c-9424-e7a4e5f41146 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043457 Apr 05 12:01:50.136818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 830/1679] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:50 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:50.139583 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2b14d2a0-d92f-4803-8ae0-541404454f7f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042712 Apr 05 12:01:50.140317 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 850/1680] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:50 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:51.106277 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bf85b7da-de44-4c6b-8a39-695c234f2f45 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:51.107261 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ed6c7f61-c4eb-4d3f-85a7-c7ffad4d43b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:51.107791 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bf85b7da-de44-4c6b-8a39-695c234f2f45 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:51.108421 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ed6c7f61-c4eb-4d3f-85a7-c7ffad4d43b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:51.116201 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bf85b7da-de44-4c6b-8a39-695c234f2f45 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:51.116419 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ed6c7f61-c4eb-4d3f-85a7-c7ffad4d43b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:51.116659 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bf85b7da-de44-4c6b-8a39-695c234f2f45 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:51.116886 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ed6c7f61-c4eb-4d3f-85a7-c7ffad4d43b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:51.117646 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bf85b7da-de44-4c6b-8a39-695c234f2f45 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:51.117825 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ed6c7f61-c4eb-4d3f-85a7-c7ffad4d43b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:51.118192 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bf85b7da-de44-4c6b-8a39-695c234f2f45 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:51.118388 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ed6c7f61-c4eb-4d3f-85a7-c7ffad4d43b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:51.150796 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ed6c7f61-c4eb-4d3f-85a7-c7ffad4d43b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048781 Apr 05 12:01:51.151568 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 851/1681] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Apr 5 12:01:51 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:01:51.151871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bf85b7da-de44-4c6b-8a39-695c234f2f45 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051474 Apr 05 12:01:51.152822 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 831/1682] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:51 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:51.155856 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8cfef631-5f70-4d02-a589-846a2c2860e3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:51.156788 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8cfef631-5f70-4d02-a589-846a2c2860e3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:51.157299 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-561a4e06-5806-4fc3-be17-cdd66fd78a02 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:51.158198 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-561a4e06-5806-4fc3-be17-cdd66fd78a02 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:51.162638 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8cfef631-5f70-4d02-a589-846a2c2860e3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:51.163070 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8cfef631-5f70-4d02-a589-846a2c2860e3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:51.163858 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8cfef631-5f70-4d02-a589-846a2c2860e3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:51.164321 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8cfef631-5f70-4d02-a589-846a2c2860e3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:51.164470 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-561a4e06-5806-4fc3-be17-cdd66fd78a02 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:51.164865 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-561a4e06-5806-4fc3-be17-cdd66fd78a02 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:51.165673 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-561a4e06-5806-4fc3-be17-cdd66fd78a02 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:51.166104 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-561a4e06-5806-4fc3-be17-cdd66fd78a02 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:51.194591 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-561a4e06-5806-4fc3-be17-cdd66fd78a02 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040849 Apr 05 12:01:51.194807 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8cfef631-5f70-4d02-a589-846a2c2860e3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042443 Apr 05 12:01:51.195274 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 832/1683] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:51 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:51.195410 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 852/1684] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:51 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:52.167296 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2e83ce5c-c262-46c9-8dcb-5c08ac92f9bc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:01:52.168669 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2e83ce5c-c262-46c9-8dcb-5c08ac92f9bc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:52.169400 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9396bd47-a9b4-4982-ab1a-21889d009f0e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:52.171137 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9396bd47-a9b4-4982-ab1a-21889d009f0e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:52.179227 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2e83ce5c-c262-46c9-8dcb-5c08ac92f9bc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:52.179980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2e83ce5c-c262-46c9-8dcb-5c08ac92f9bc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:52.181390 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2e83ce5c-c262-46c9-8dcb-5c08ac92f9bc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:52.181649 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9396bd47-a9b4-4982-ab1a-21889d009f0e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:52.181802 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2e83ce5c-c262-46c9-8dcb-5c08ac92f9bc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:52.182099 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9396bd47-a9b4-4982-ab1a-21889d009f0e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:52.182865 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9396bd47-a9b4-4982-ab1a-21889d009f0e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:52.183317 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9396bd47-a9b4-4982-ab1a-21889d009f0e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:52.212791 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9396bd47-a9b4-4982-ab1a-21889d009f0e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049804 Apr 05 12:01:52.213363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 853/1685] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:52 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:52.217975 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-af188a05-e607-4fdb-bde6-df0ef6974473 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:52.218864 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-af188a05-e607-4fdb-bde6-df0ef6974473 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:52.225438 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-af188a05-e607-4fdb-bde6-df0ef6974473 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:52.225876 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-af188a05-e607-4fdb-bde6-df0ef6974473 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:52.226640 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-af188a05-e607-4fdb-bde6-df0ef6974473 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:52.227068 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-af188a05-e607-4fdb-bde6-df0ef6974473 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:52.255753 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-af188a05-e607-4fdb-bde6-df0ef6974473 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041346 Apr 05 12:01:52.256345 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 854/1686] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:52 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:52.260741 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2c525c64-6852-4cf1-80fe-1e2e08115d36 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:52.261637 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2c525c64-6852-4cf1-80fe-1e2e08115d36 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:52.267343 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2c525c64-6852-4cf1-80fe-1e2e08115d36 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:52.267788 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2c525c64-6852-4cf1-80fe-1e2e08115d36 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:52.268566 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2c525c64-6852-4cf1-80fe-1e2e08115d36 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:52.268996 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2c525c64-6852-4cf1-80fe-1e2e08115d36 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:52.269217 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2e83ce5c-c262-46c9-8dcb-5c08ac92f9bc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "POST /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/action" status: 200 len: 38593 microversion: 2.20 time: 0.108703 Apr 05 12:01:52.270720 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 833/1687] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Apr 5 12:01:52 2022] POST /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d/action => generated 38593 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:01:52.297161 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2c525c64-6852-4cf1-80fe-1e2e08115d36 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039805 Apr 05 12:01:52.297713 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 855/1688] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:52 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:53.229619 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-62bf7fa4-c666-496d-a08a-c2a1dfe6f79c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:53.230942 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-62bf7fa4-c666-496d-a08a-c2a1dfe6f79c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:53.240751 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-62bf7fa4-c666-496d-a08a-c2a1dfe6f79c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:53.241354 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-62bf7fa4-c666-496d-a08a-c2a1dfe6f79c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:53.242382 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-62bf7fa4-c666-496d-a08a-c2a1dfe6f79c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:53.242968 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-62bf7fa4-c666-496d-a08a-c2a1dfe6f79c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:53.267213 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a2e3e00e-3e12-4d3b-9c3f-a48e66dbce8c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:53.268130 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a2e3e00e-3e12-4d3b-9c3f-a48e66dbce8c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:53.274810 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a2e3e00e-3e12-4d3b-9c3f-a48e66dbce8c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:53.275385 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a2e3e00e-3e12-4d3b-9c3f-a48e66dbce8c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:53.276619 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a2e3e00e-3e12-4d3b-9c3f-a48e66dbce8c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:53.276725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a2e3e00e-3e12-4d3b-9c3f-a48e66dbce8c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:53.278182 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-62bf7fa4-c666-496d-a08a-c2a1dfe6f79c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055583 Apr 05 12:01:53.278939 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 834/1689] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:53 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:53.306662 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a2e3e00e-3e12-4d3b-9c3f-a48e66dbce8c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043484 Apr 05 12:01:53.307412 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 856/1690] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:53 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:53.308998 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-25406e2e-1271-4c6a-bf69-3ff62be18f3e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:53.309977 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-25406e2e-1271-4c6a-bf69-3ff62be18f3e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:53.316685 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-25406e2e-1271-4c6a-bf69-3ff62be18f3e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:53.317264 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-25406e2e-1271-4c6a-bf69-3ff62be18f3e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:53.317981 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-25406e2e-1271-4c6a-bf69-3ff62be18f3e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:53.318421 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-25406e2e-1271-4c6a-bf69-3ff62be18f3e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:53.347343 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-25406e2e-1271-4c6a-bf69-3ff62be18f3e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042435 Apr 05 12:01:53.347935 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 835/1691] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:53 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:54.295094 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5cc555aa-5dc5-4b15-b9d5-16a427b4fc5e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:54.296616 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5cc555aa-5dc5-4b15-b9d5-16a427b4fc5e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:54.308612 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5cc555aa-5dc5-4b15-b9d5-16a427b4fc5e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:54.309111 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5cc555aa-5dc5-4b15-b9d5-16a427b4fc5e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:54.309891 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5cc555aa-5dc5-4b15-b9d5-16a427b4fc5e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:54.310328 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5cc555aa-5dc5-4b15-b9d5-16a427b4fc5e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:54.318273 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-38220373-4590-466f-9ae1-d6a2c53ede78 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:54.319191 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-38220373-4590-466f-9ae1-d6a2c53ede78 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:54.325787 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-38220373-4590-466f-9ae1-d6a2c53ede78 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:54.326236 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-38220373-4590-466f-9ae1-d6a2c53ede78 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:54.327002 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-38220373-4590-466f-9ae1-d6a2c53ede78 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:54.327440 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-38220373-4590-466f-9ae1-d6a2c53ede78 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:54.341082 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5cc555aa-5dc5-4b15-b9d5-16a427b4fc5e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052908 Apr 05 12:01:54.341865 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 857/1692] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:54 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:54.359993 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-38220373-4590-466f-9ae1-d6a2c53ede78 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045557 Apr 05 12:01:54.361351 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3709d60c-fc8f-49fd-a95b-18b25b49d758 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:54.362664 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3709d60c-fc8f-49fd-a95b-18b25b49d758 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:54.364582 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 836/1693] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:54 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:54.370306 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3709d60c-fc8f-49fd-a95b-18b25b49d758 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:54.371415 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3709d60c-fc8f-49fd-a95b-18b25b49d758 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:54.371626 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3709d60c-fc8f-49fd-a95b-18b25b49d758 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:54.372116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3709d60c-fc8f-49fd-a95b-18b25b49d758 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:54.404605 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3709d60c-fc8f-49fd-a95b-18b25b49d758 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049157 Apr 05 12:01:54.405171 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 858/1694] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:54 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:55.353970 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-aa1f8ee9-6ed7-47bc-9f16-c4f16b9f9f14 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:55.354888 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-aa1f8ee9-6ed7-47bc-9f16-c4f16b9f9f14 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:55.362346 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aa1f8ee9-6ed7-47bc-9f16-c4f16b9f9f14 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:55.362769 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aa1f8ee9-6ed7-47bc-9f16-c4f16b9f9f14 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:55.363536 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aa1f8ee9-6ed7-47bc-9f16-c4f16b9f9f14 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:55.363990 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aa1f8ee9-6ed7-47bc-9f16-c4f16b9f9f14 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:55.371984 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b9e7b9c3-96f5-4b36-a4f4-db430a968658 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:55.372930 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b9e7b9c3-96f5-4b36-a4f4-db430a968658 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:55.379591 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9e7b9c3-96f5-4b36-a4f4-db430a968658 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:55.380034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9e7b9c3-96f5-4b36-a4f4-db430a968658 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:55.380863 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9e7b9c3-96f5-4b36-a4f4-db430a968658 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:55.381293 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9e7b9c3-96f5-4b36-a4f4-db430a968658 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:55.394072 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-aa1f8ee9-6ed7-47bc-9f16-c4f16b9f9f14 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044282 Apr 05 12:01:55.395211 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 837/1695] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:55 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:01:55.415530 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b9e7b9c3-96f5-4b36-a4f4-db430a968658 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047484 Apr 05 12:01:55.416112 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 859/1696] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:55 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:55.417215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-566ff551-94dd-4093-b9d8-fa1ceb150de9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:55.418285 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-566ff551-94dd-4093-b9d8-fa1ceb150de9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:55.424650 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-566ff551-94dd-4093-b9d8-fa1ceb150de9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:55.425071 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-566ff551-94dd-4093-b9d8-fa1ceb150de9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:55.425875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-566ff551-94dd-4093-b9d8-fa1ceb150de9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:55.426309 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-566ff551-94dd-4093-b9d8-fa1ceb150de9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:55.456660 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-566ff551-94dd-4093-b9d8-fa1ceb150de9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043928 Apr 05 12:01:55.457223 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 838/1697] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:55 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:01:56.410725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-af2e9f48-245d-4457-80c1-ae05dc0ae159 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:56.412191 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-af2e9f48-245d-4457-80c1-ae05dc0ae159 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:56.423447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-af2e9f48-245d-4457-80c1-ae05dc0ae159 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:56.424338 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-af2e9f48-245d-4457-80c1-ae05dc0ae159 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:56.425615 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-af2e9f48-245d-4457-80c1-ae05dc0ae159 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:56.426345 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-af2e9f48-245d-4457-80c1-ae05dc0ae159 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:56.433272 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fffc5a49-3f05-446c-9f02-a7302eb761d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:56.434605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fffc5a49-3f05-446c-9f02-a7302eb761d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:56.446670 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fffc5a49-3f05-446c-9f02-a7302eb761d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:56.447121 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fffc5a49-3f05-446c-9f02-a7302eb761d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:56.447918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fffc5a49-3f05-446c-9f02-a7302eb761d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:56.448361 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fffc5a49-3f05-446c-9f02-a7302eb761d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:56.462458 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-af2e9f48-245d-4457-80c1-ae05dc0ae159 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058390 Apr 05 12:01:56.462996 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 860/1698] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:56 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:56.468106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c3109420-cd05-40b7-9fd3-c258114016c4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:56.469022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c3109420-cd05-40b7-9fd3-c258114016c4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:56.474781 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c3109420-cd05-40b7-9fd3-c258114016c4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:56.475221 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c3109420-cd05-40b7-9fd3-c258114016c4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:56.476055 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c3109420-cd05-40b7-9fd3-c258114016c4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:56.476504 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c3109420-cd05-40b7-9fd3-c258114016c4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:56.482396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fffc5a49-3f05-446c-9f02-a7302eb761d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058404 Apr 05 12:01:56.486217 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 839/1699] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:56 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:56.505545 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c3109420-cd05-40b7-9fd3-c258114016c4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041222 Apr 05 12:01:56.506108 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 861/1700] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:56 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:57.474552 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1753d3d6-1e19-4846-b572-caf13507e2e1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:57.475468 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1753d3d6-1e19-4846-b572-caf13507e2e1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:57.482390 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1753d3d6-1e19-4846-b572-caf13507e2e1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:57.482824 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1753d3d6-1e19-4846-b572-caf13507e2e1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:57.483618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1753d3d6-1e19-4846-b572-caf13507e2e1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:57.484055 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1753d3d6-1e19-4846-b572-caf13507e2e1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:57.494053 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4e9935e7-f1c4-4757-abfa-a8b3778b3e56 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:57.494889 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4e9935e7-f1c4-4757-abfa-a8b3778b3e56 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:57.501567 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e9935e7-f1c4-4757-abfa-a8b3778b3e56 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:57.502021 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e9935e7-f1c4-4757-abfa-a8b3778b3e56 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:57.502798 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e9935e7-f1c4-4757-abfa-a8b3778b3e56 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:57.503529 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e9935e7-f1c4-4757-abfa-a8b3778b3e56 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:57.517392 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1753d3d6-1e19-4846-b572-caf13507e2e1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046858 Apr 05 12:01:57.521394 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 840/1701] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:57 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:57.525053 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ad3fb412-719d-481b-aeb7-196000faa374 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:57.525954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ad3fb412-719d-481b-aeb7-196000faa374 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:57.532188 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ad3fb412-719d-481b-aeb7-196000faa374 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:57.532640 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ad3fb412-719d-481b-aeb7-196000faa374 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:57.533284 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4e9935e7-f1c4-4757-abfa-a8b3778b3e56 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043377 Apr 05 12:01:57.533439 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ad3fb412-719d-481b-aeb7-196000faa374 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:57.533857 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 862/1702] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:57 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:57.537232 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ad3fb412-719d-481b-aeb7-196000faa374 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:57.563023 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ad3fb412-719d-481b-aeb7-196000faa374 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043633 Apr 05 12:01:57.563587 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 841/1703] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:57 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:58.530717 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-27710233-988f-443a-a3b5-7c6fbc053862 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:58.531648 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-27710233-988f-443a-a3b5-7c6fbc053862 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:58.539834 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-27710233-988f-443a-a3b5-7c6fbc053862 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:58.540296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-27710233-988f-443a-a3b5-7c6fbc053862 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:58.541084 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-27710233-988f-443a-a3b5-7c6fbc053862 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:58.541519 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-27710233-988f-443a-a3b5-7c6fbc053862 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:58.545086 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2011d76c-6ac4-44a6-8715-156cd1625fae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:58.546000 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2011d76c-6ac4-44a6-8715-156cd1625fae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:58.552765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2011d76c-6ac4-44a6-8715-156cd1625fae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:58.553204 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2011d76c-6ac4-44a6-8715-156cd1625fae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:58.553975 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2011d76c-6ac4-44a6-8715-156cd1625fae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:58.554411 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2011d76c-6ac4-44a6-8715-156cd1625fae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:58.573110 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-27710233-988f-443a-a3b5-7c6fbc053862 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047189 Apr 05 12:01:58.577139 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 863/1704] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:58 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:58.578309 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6b67268f-5fba-40e5-9725-8f781a65ce35 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:58.579207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6b67268f-5fba-40e5-9725-8f781a65ce35 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:58.585114 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6b67268f-5fba-40e5-9725-8f781a65ce35 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:58.585395 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6b67268f-5fba-40e5-9725-8f781a65ce35 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:58.586164 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6b67268f-5fba-40e5-9725-8f781a65ce35 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:58.586594 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6b67268f-5fba-40e5-9725-8f781a65ce35 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:58.590333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2011d76c-6ac4-44a6-8715-156cd1625fae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049261 Apr 05 12:01:58.591095 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 842/1705] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:58 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:58.616864 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6b67268f-5fba-40e5-9725-8f781a65ce35 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042170 Apr 05 12:01:58.617426 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 864/1706] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:58 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:59.588388 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8efd8ca6-0a02-4aef-990b-517621501cba tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:59.589919 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8efd8ca6-0a02-4aef-990b-517621501cba tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:59.597726 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8efd8ca6-0a02-4aef-990b-517621501cba tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:59.598176 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8efd8ca6-0a02-4aef-990b-517621501cba tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:59.598942 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8efd8ca6-0a02-4aef-990b-517621501cba tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:59.599374 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8efd8ca6-0a02-4aef-990b-517621501cba tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:59.602092 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-53c57b29-7eb2-4e4b-b5b6-9730f1920a79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:59.603020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-53c57b29-7eb2-4e4b-b5b6-9730f1920a79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:59.609546 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-53c57b29-7eb2-4e4b-b5b6-9730f1920a79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:59.610013 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-53c57b29-7eb2-4e4b-b5b6-9730f1920a79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:59.610772 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-53c57b29-7eb2-4e4b-b5b6-9730f1920a79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:59.613004 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-53c57b29-7eb2-4e4b-b5b6-9730f1920a79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:59.632964 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8efd8ca6-0a02-4aef-990b-517621501cba tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051295 Apr 05 12:01:59.633780 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 843/1707] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:59 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:59.638183 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-61630b3b-e9f3-435d-a465-a279a55d674f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:01:59.639418 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-61630b3b-e9f3-435d-a465-a279a55d674f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:01:59.643801 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-53c57b29-7eb2-4e4b-b5b6-9730f1920a79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045673 Apr 05 12:01:59.644419 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 865/1708] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:59 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:59.644903 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-61630b3b-e9f3-435d-a465-a279a55d674f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:59.645346 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-61630b3b-e9f3-435d-a465-a279a55d674f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:59.646104 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-61630b3b-e9f3-435d-a465-a279a55d674f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:01:59.646532 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-61630b3b-e9f3-435d-a465-a279a55d674f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:01:59.677765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-61630b3b-e9f3-435d-a465-a279a55d674f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043155 Apr 05 12:01:59.678331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 844/1709] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:01:59 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:00.646915 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5067230b-0de1-426a-ab6b-65507d10cf4e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:00.647995 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5067230b-0de1-426a-ab6b-65507d10cf4e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:00.655876 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5067230b-0de1-426a-ab6b-65507d10cf4e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:00.656305 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9ef49692-c846-4fb2-8d98-d0b49313cfb5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:00.656855 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5067230b-0de1-426a-ab6b-65507d10cf4e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:00.657404 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9ef49692-c846-4fb2-8d98-d0b49313cfb5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:00.657585 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5067230b-0de1-426a-ab6b-65507d10cf4e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:00.658727 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5067230b-0de1-426a-ab6b-65507d10cf4e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:00.665322 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9ef49692-c846-4fb2-8d98-d0b49313cfb5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:00.665856 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9ef49692-c846-4fb2-8d98-d0b49313cfb5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:00.666752 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9ef49692-c846-4fb2-8d98-d0b49313cfb5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:00.667939 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9ef49692-c846-4fb2-8d98-d0b49313cfb5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:00.693983 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5067230b-0de1-426a-ab6b-65507d10cf4e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051716 Apr 05 12:02:00.695376 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 866/1710] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:00 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:00.701397 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b0d28369-cf83-4226-84a7-8b91077a0b2a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:00.702425 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9ef49692-c846-4fb2-8d98-d0b49313cfb5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050712 Apr 05 12:02:00.702805 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b0d28369-cf83-4226-84a7-8b91077a0b2a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:00.706318 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 845/1711] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:00 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:00.709140 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b0d28369-cf83-4226-84a7-8b91077a0b2a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:00.709589 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b0d28369-cf83-4226-84a7-8b91077a0b2a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:00.710376 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b0d28369-cf83-4226-84a7-8b91077a0b2a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:00.710798 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b0d28369-cf83-4226-84a7-8b91077a0b2a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:00.739911 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b0d28369-cf83-4226-84a7-8b91077a0b2a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043287 Apr 05 12:02:00.740664 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 867/1712] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:00 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:01.710663 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8c0f1b6e-ef51-436a-afc6-23ab437ef03c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:01.712198 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8c0f1b6e-ef51-436a-afc6-23ab437ef03c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:01.719054 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f00d5d79-0e15-4435-9d7c-ff3c1a90b19d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:01.720429 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f00d5d79-0e15-4435-9d7c-ff3c1a90b19d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:01.721832 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c0f1b6e-ef51-436a-afc6-23ab437ef03c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:01.722289 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c0f1b6e-ef51-436a-afc6-23ab437ef03c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:01.723048 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c0f1b6e-ef51-436a-afc6-23ab437ef03c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:01.723488 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c0f1b6e-ef51-436a-afc6-23ab437ef03c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:01.726968 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f00d5d79-0e15-4435-9d7c-ff3c1a90b19d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:01.727413 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f00d5d79-0e15-4435-9d7c-ff3c1a90b19d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:01.728209 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f00d5d79-0e15-4435-9d7c-ff3c1a90b19d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:01.728637 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f00d5d79-0e15-4435-9d7c-ff3c1a90b19d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:01.753792 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8c0f1b6e-ef51-436a-afc6-23ab437ef03c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049697 Apr 05 12:02:01.754477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 846/1713] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:01 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:01.758993 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5a5dab10-783d-419e-8f27-8a5ab0a31e21 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:01.759896 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5a5dab10-783d-419e-8f27-8a5ab0a31e21 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:01.762805 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f00d5d79-0e15-4435-9d7c-ff3c1a90b19d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050619 Apr 05 12:02:01.763975 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 868/1714] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:01 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:01.765636 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5a5dab10-783d-419e-8f27-8a5ab0a31e21 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:01.766205 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5a5dab10-783d-419e-8f27-8a5ab0a31e21 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:01.768525 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5a5dab10-783d-419e-8f27-8a5ab0a31e21 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:01.769101 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5a5dab10-783d-419e-8f27-8a5ab0a31e21 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:01.798194 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5a5dab10-783d-419e-8f27-8a5ab0a31e21 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042812 Apr 05 12:02:01.798986 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 847/1715] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:01 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:02.770974 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a117bfcb-d53f-4c23-9e89-8e67a23d590e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:02.772444 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a117bfcb-d53f-4c23-9e89-8e67a23d590e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:02.779023 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8d769f87-ceed-4b24-bcc7-388480553b63 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:02.780908 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8d769f87-ceed-4b24-bcc7-388480553b63 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:02.783034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a117bfcb-d53f-4c23-9e89-8e67a23d590e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:02.783796 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a117bfcb-d53f-4c23-9e89-8e67a23d590e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:02.785086 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a117bfcb-d53f-4c23-9e89-8e67a23d590e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:02.785869 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a117bfcb-d53f-4c23-9e89-8e67a23d590e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:02.791179 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8d769f87-ceed-4b24-bcc7-388480553b63 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:02.791874 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8d769f87-ceed-4b24-bcc7-388480553b63 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:02.793173 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8d769f87-ceed-4b24-bcc7-388480553b63 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:02.793928 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8d769f87-ceed-4b24-bcc7-388480553b63 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:02.820053 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a117bfcb-d53f-4c23-9e89-8e67a23d590e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056848 Apr 05 12:02:02.824434 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 869/1716] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:02 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:02.827230 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9fd62e44-3284-4b9b-8f98-dd1c64c1f418 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:02.828194 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9fd62e44-3284-4b9b-8f98-dd1c64c1f418 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:02.828852 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8d769f87-ceed-4b24-bcc7-388480553b63 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056565 Apr 05 12:02:02.830989 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 848/1717] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:02 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:02.834231 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fd62e44-3284-4b9b-8f98-dd1c64c1f418 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:02.834676 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fd62e44-3284-4b9b-8f98-dd1c64c1f418 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:02.835432 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fd62e44-3284-4b9b-8f98-dd1c64c1f418 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:02.835862 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fd62e44-3284-4b9b-8f98-dd1c64c1f418 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:02.864531 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9fd62e44-3284-4b9b-8f98-dd1c64c1f418 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042479 Apr 05 12:02:02.865191 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 870/1718] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:02 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:03.833259 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fcf38bb6-2abf-4b2c-a14a-b34e2fb1008d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:03.834087 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fcf38bb6-2abf-4b2c-a14a-b34e2fb1008d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:03.840145 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a718a8af-95cf-4d1b-86f5-8d4614be6427 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:03.840919 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fcf38bb6-2abf-4b2c-a14a-b34e2fb1008d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:03.841087 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a718a8af-95cf-4d1b-86f5-8d4614be6427 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:03.841375 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fcf38bb6-2abf-4b2c-a14a-b34e2fb1008d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:03.842137 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fcf38bb6-2abf-4b2c-a14a-b34e2fb1008d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:03.842566 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fcf38bb6-2abf-4b2c-a14a-b34e2fb1008d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:03.850091 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a718a8af-95cf-4d1b-86f5-8d4614be6427 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:03.850091 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a718a8af-95cf-4d1b-86f5-8d4614be6427 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:03.850858 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a718a8af-95cf-4d1b-86f5-8d4614be6427 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:03.851298 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a718a8af-95cf-4d1b-86f5-8d4614be6427 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:03.879212 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fcf38bb6-2abf-4b2c-a14a-b34e2fb1008d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050377 Apr 05 12:02:03.880051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 849/1719] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:03 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:03.883374 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a718a8af-95cf-4d1b-86f5-8d4614be6427 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047431 Apr 05 12:02:03.884135 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 871/1720] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:03 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:03.884361 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-884e138f-0d71-4569-b460-97f4e02de4e7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:03.885364 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-884e138f-0d71-4569-b460-97f4e02de4e7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:03.892848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-884e138f-0d71-4569-b460-97f4e02de4e7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:03.893291 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-884e138f-0d71-4569-b460-97f4e02de4e7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:03.894069 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-884e138f-0d71-4569-b460-97f4e02de4e7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:03.894508 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-884e138f-0d71-4569-b460-97f4e02de4e7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:03.922844 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-884e138f-0d71-4569-b460-97f4e02de4e7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041956 Apr 05 12:02:03.923444 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 850/1721] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:03 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:04.896269 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-dfc81ae5-1c5e-48a6-8c93-7b741ccdac9d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:04.897971 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-dfc81ae5-1c5e-48a6-8c93-7b741ccdac9d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:04.898682 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-403994e7-7d10-41f0-841b-707d2263df5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:04.900431 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-403994e7-7d10-41f0-841b-707d2263df5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:04.908420 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dfc81ae5-1c5e-48a6-8c93-7b741ccdac9d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:04.908868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dfc81ae5-1c5e-48a6-8c93-7b741ccdac9d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:04.909473 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-403994e7-7d10-41f0-841b-707d2263df5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:04.909637 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dfc81ae5-1c5e-48a6-8c93-7b741ccdac9d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:04.909917 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-403994e7-7d10-41f0-841b-707d2263df5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:04.910075 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dfc81ae5-1c5e-48a6-8c93-7b741ccdac9d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:04.910670 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-403994e7-7d10-41f0-841b-707d2263df5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:04.911100 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-403994e7-7d10-41f0-841b-707d2263df5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:04.940197 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-dfc81ae5-1c5e-48a6-8c93-7b741ccdac9d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050491 Apr 05 12:02:04.940775 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 872/1722] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:04 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:04.941599 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-403994e7-7d10-41f0-841b-707d2263df5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049368 Apr 05 12:02:04.945322 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b5b392df-4874-4cbb-96e6-1703e413bd03 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:04.945995 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 851/1723] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:04 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:04.946233 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b5b392df-4874-4cbb-96e6-1703e413bd03 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:04.951898 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b5b392df-4874-4cbb-96e6-1703e413bd03 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:04.952368 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b5b392df-4874-4cbb-96e6-1703e413bd03 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:04.953125 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b5b392df-4874-4cbb-96e6-1703e413bd03 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:04.953613 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b5b392df-4874-4cbb-96e6-1703e413bd03 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:04.981704 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b5b392df-4874-4cbb-96e6-1703e413bd03 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039904 Apr 05 12:02:04.982258 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 873/1724] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:04 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:05.955147 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2db6871e-8ce0-45d5-b06c-70b637d35d5d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:05.956104 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2db6871e-8ce0-45d5-b06c-70b637d35d5d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:05.956467 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cb126f51-7749-4740-953c-e04f8d1e85d5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:05.957403 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cb126f51-7749-4740-953c-e04f8d1e85d5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:05.962847 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2db6871e-8ce0-45d5-b06c-70b637d35d5d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:05.963323 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2db6871e-8ce0-45d5-b06c-70b637d35d5d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:05.963976 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cb126f51-7749-4740-953c-e04f8d1e85d5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:05.964145 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2db6871e-8ce0-45d5-b06c-70b637d35d5d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:05.964453 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cb126f51-7749-4740-953c-e04f8d1e85d5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:05.964598 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2db6871e-8ce0-45d5-b06c-70b637d35d5d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:05.965208 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cb126f51-7749-4740-953c-e04f8d1e85d5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:05.965634 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cb126f51-7749-4740-953c-e04f8d1e85d5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:05.994685 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2db6871e-8ce0-45d5-b06c-70b637d35d5d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046102 Apr 05 12:02:06.000281 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cb126f51-7749-4740-953c-e04f8d1e85d5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044440 Apr 05 12:02:06.000467 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 852/1725] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:05 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:06.000577 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 874/1726] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:05 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:06.000675 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-49fee019-1729-4327-80df-1bbade916c92 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:06.000675 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-49fee019-1729-4327-80df-1bbade916c92 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:06.006333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-49fee019-1729-4327-80df-1bbade916c92 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:06.006782 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-49fee019-1729-4327-80df-1bbade916c92 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:06.007537 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-49fee019-1729-4327-80df-1bbade916c92 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:06.007965 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-49fee019-1729-4327-80df-1bbade916c92 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:06.037073 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-49fee019-1729-4327-80df-1bbade916c92 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040768 Apr 05 12:02:06.037623 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 853/1727] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:05 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:07.011281 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e6d1ba61-3708-4646-8a74-7d9b943874e5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:07.012493 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-41d96dc9-9d52-4bc1-a5b1-d64f98094ef8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:07.013263 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e6d1ba61-3708-4646-8a74-7d9b943874e5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:07.013974 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-41d96dc9-9d52-4bc1-a5b1-d64f98094ef8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:07.023481 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6d1ba61-3708-4646-8a74-7d9b943874e5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:07.024292 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6d1ba61-3708-4646-8a74-7d9b943874e5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:07.024607 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-41d96dc9-9d52-4bc1-a5b1-d64f98094ef8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:07.025071 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-41d96dc9-9d52-4bc1-a5b1-d64f98094ef8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:07.025568 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6d1ba61-3708-4646-8a74-7d9b943874e5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:07.026298 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6d1ba61-3708-4646-8a74-7d9b943874e5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:07.026546 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-41d96dc9-9d52-4bc1-a5b1-d64f98094ef8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:07.027007 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-41d96dc9-9d52-4bc1-a5b1-d64f98094ef8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:07.059733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-41d96dc9-9d52-4bc1-a5b1-d64f98094ef8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053866 Apr 05 12:02:07.066775 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 854/1728] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:07 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:07.067097 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e6d1ba61-3708-4646-8a74-7d9b943874e5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057107 Apr 05 12:02:07.067097 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 875/1729] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:07 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:07.067295 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-865af6f8-582c-4680-a289-bf0f457a21ed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:07.067295 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-865af6f8-582c-4680-a289-bf0f457a21ed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:07.071619 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-865af6f8-582c-4680-a289-bf0f457a21ed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:07.072067 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-865af6f8-582c-4680-a289-bf0f457a21ed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:07.072838 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-865af6f8-582c-4680-a289-bf0f457a21ed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:07.073251 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-865af6f8-582c-4680-a289-bf0f457a21ed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:07.101050 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-865af6f8-582c-4680-a289-bf0f457a21ed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039692 Apr 05 12:02:07.101600 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 855/1730] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:07 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:08.077314 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-015c5164-10a1-438c-af0d-0a883eb619ae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:08.078252 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e0963cd4-0923-40f2-a18a-cbec90a50f8d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:08.078878 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-015c5164-10a1-438c-af0d-0a883eb619ae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:08.079791 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e0963cd4-0923-40f2-a18a-cbec90a50f8d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:08.085998 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-015c5164-10a1-438c-af0d-0a883eb619ae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:08.086298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0963cd4-0923-40f2-a18a-cbec90a50f8d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:08.086429 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-015c5164-10a1-438c-af0d-0a883eb619ae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:08.086721 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0963cd4-0923-40f2-a18a-cbec90a50f8d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:08.087177 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-015c5164-10a1-438c-af0d-0a883eb619ae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:08.087466 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0963cd4-0923-40f2-a18a-cbec90a50f8d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:08.087621 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-015c5164-10a1-438c-af0d-0a883eb619ae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:08.087904 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0963cd4-0923-40f2-a18a-cbec90a50f8d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:08.117667 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-015c5164-10a1-438c-af0d-0a883eb619ae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047012 Apr 05 12:02:08.118229 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 876/1731] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:08 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:08.121150 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e0963cd4-0923-40f2-a18a-cbec90a50f8d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049367 Apr 05 12:02:08.122162 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 856/1732] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:08 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:08.122795 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-023f557f-a6c1-4fc5-a299-29317f55d9d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:08.123911 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-023f557f-a6c1-4fc5-a299-29317f55d9d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:08.129706 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-023f557f-a6c1-4fc5-a299-29317f55d9d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:08.130145 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-023f557f-a6c1-4fc5-a299-29317f55d9d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:08.130916 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-023f557f-a6c1-4fc5-a299-29317f55d9d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:08.131335 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-023f557f-a6c1-4fc5-a299-29317f55d9d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:08.159302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-023f557f-a6c1-4fc5-a299-29317f55d9d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040069 Apr 05 12:02:08.160044 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 877/1733] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:08 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:09.134168 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c4b02f38-52ae-41cf-863d-779dcc1a4a2c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:09.135639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c4b02f38-52ae-41cf-863d-779dcc1a4a2c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:09.137255 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-31870fe8-4794-42cc-9a49-b6c11f36cf0a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:09.138738 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-31870fe8-4794-42cc-9a49-b6c11f36cf0a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:09.146552 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c4b02f38-52ae-41cf-863d-779dcc1a4a2c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:09.147289 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c4b02f38-52ae-41cf-863d-779dcc1a4a2c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:09.148787 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c4b02f38-52ae-41cf-863d-779dcc1a4a2c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:09.149298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c4b02f38-52ae-41cf-863d-779dcc1a4a2c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:09.151007 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-31870fe8-4794-42cc-9a49-b6c11f36cf0a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:09.152415 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-31870fe8-4794-42cc-9a49-b6c11f36cf0a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:09.153190 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-31870fe8-4794-42cc-9a49-b6c11f36cf0a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:09.153713 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-31870fe8-4794-42cc-9a49-b6c11f36cf0a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:09.183144 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c4b02f38-52ae-41cf-863d-779dcc1a4a2c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055581 Apr 05 12:02:09.183713 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 857/1734] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:09 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:09.184777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-31870fe8-4794-42cc-9a49-b6c11f36cf0a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054386 Apr 05 12:02:09.185462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 878/1735] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:09 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:09.188777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-19976f7c-fe88-451c-8940-535ec11bbb0a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:09.189792 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-19976f7c-fe88-451c-8940-535ec11bbb0a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:09.195516 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-19976f7c-fe88-451c-8940-535ec11bbb0a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:09.195969 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-19976f7c-fe88-451c-8940-535ec11bbb0a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:09.196780 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-19976f7c-fe88-451c-8940-535ec11bbb0a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:09.197218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-19976f7c-fe88-451c-8940-535ec11bbb0a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:09.230617 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-19976f7c-fe88-451c-8940-535ec11bbb0a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045851 Apr 05 12:02:09.231180 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 858/1736] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:09 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:10.199465 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4f230b5c-c5bc-46df-9132-664f9625c986 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:10.200396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-991d9f27-d665-41b9-974a-bf0a0986573c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:10.200986 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4f230b5c-c5bc-46df-9132-664f9625c986 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:10.201711 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-991d9f27-d665-41b9-974a-bf0a0986573c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:10.209112 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f230b5c-c5bc-46df-9132-664f9625c986 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:10.209569 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f230b5c-c5bc-46df-9132-664f9625c986 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:10.209703 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-991d9f27-d665-41b9-974a-bf0a0986573c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:10.210083 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-991d9f27-d665-41b9-974a-bf0a0986573c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:10.210418 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f230b5c-c5bc-46df-9132-664f9625c986 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:10.210851 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-991d9f27-d665-41b9-974a-bf0a0986573c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:10.210968 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f230b5c-c5bc-46df-9132-664f9625c986 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:10.211281 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-991d9f27-d665-41b9-974a-bf0a0986573c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:10.243465 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4f230b5c-c5bc-46df-9132-664f9625c986 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050834 Apr 05 12:02:10.244047 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 879/1737] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:10 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:10.244364 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-991d9f27-d665-41b9-974a-bf0a0986573c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050545 Apr 05 12:02:10.245335 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 859/1738] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:10 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:10.250937 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-04e4dd32-44b6-490d-bcc0-b7d89f9e087a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:10.251844 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-04e4dd32-44b6-490d-bcc0-b7d89f9e087a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:10.257960 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-04e4dd32-44b6-490d-bcc0-b7d89f9e087a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:10.258286 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-04e4dd32-44b6-490d-bcc0-b7d89f9e087a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:10.259040 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-04e4dd32-44b6-490d-bcc0-b7d89f9e087a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:10.259467 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-04e4dd32-44b6-490d-bcc0-b7d89f9e087a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:10.287602 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-04e4dd32-44b6-490d-bcc0-b7d89f9e087a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042505 Apr 05 12:02:10.288223 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 880/1739] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:10 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:11.259525 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1c609386-16ed-45fd-b657-4d9002f82e9d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:11.260524 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-00754160-5a6c-4661-952a-d35fe05afdc0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:11.261143 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1c609386-16ed-45fd-b657-4d9002f82e9d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:11.261299 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-00754160-5a6c-4661-952a-d35fe05afdc0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:11.270396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1c609386-16ed-45fd-b657-4d9002f82e9d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:11.270595 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-00754160-5a6c-4661-952a-d35fe05afdc0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:11.270895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-00754160-5a6c-4661-952a-d35fe05afdc0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:11.271241 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1c609386-16ed-45fd-b657-4d9002f82e9d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:11.272017 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-00754160-5a6c-4661-952a-d35fe05afdc0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:11.272141 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-00754160-5a6c-4661-952a-d35fe05afdc0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:11.272251 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1c609386-16ed-45fd-b657-4d9002f82e9d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:11.272620 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1c609386-16ed-45fd-b657-4d9002f82e9d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:11.304764 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-00754160-5a6c-4661-952a-d35fe05afdc0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052136 Apr 05 12:02:11.304951 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1c609386-16ed-45fd-b657-4d9002f82e9d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052229 Apr 05 12:02:11.311580 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 881/1740] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:11 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:11.311779 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 860/1741] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:11 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:11.311885 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a3657703-26fd-474f-be43-95fc9c52d19d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:11.311885 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a3657703-26fd-474f-be43-95fc9c52d19d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:11.316846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a3657703-26fd-474f-be43-95fc9c52d19d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:11.317292 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a3657703-26fd-474f-be43-95fc9c52d19d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:11.318052 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a3657703-26fd-474f-be43-95fc9c52d19d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:11.318481 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a3657703-26fd-474f-be43-95fc9c52d19d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:11.346827 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a3657703-26fd-474f-be43-95fc9c52d19d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040438 Apr 05 12:02:11.347388 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 882/1742] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:11 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:12.319043 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d4d34fa6-6269-4da3-9fce-16460804b9f2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:12.319962 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d4d34fa6-6269-4da3-9fce-16460804b9f2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:12.320128 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-85f07e7d-284b-42df-a020-bf6bebe89fa5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:12.320945 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-85f07e7d-284b-42df-a020-bf6bebe89fa5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:12.326706 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d4d34fa6-6269-4da3-9fce-16460804b9f2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:12.327401 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d4d34fa6-6269-4da3-9fce-16460804b9f2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:12.328191 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d4d34fa6-6269-4da3-9fce-16460804b9f2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:12.328636 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d4d34fa6-6269-4da3-9fce-16460804b9f2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:12.328799 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-85f07e7d-284b-42df-a020-bf6bebe89fa5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:12.329262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-85f07e7d-284b-42df-a020-bf6bebe89fa5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:12.330033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-85f07e7d-284b-42df-a020-bf6bebe89fa5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:12.330462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-85f07e7d-284b-42df-a020-bf6bebe89fa5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:12.358419 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d4d34fa6-6269-4da3-9fce-16460804b9f2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044303 Apr 05 12:02:12.359197 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 861/1743] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:12 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:12.364290 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8977b9b7-360f-4304-81c1-b76c18909476 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:12.365213 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8977b9b7-360f-4304-81c1-b76c18909476 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:12.369704 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-85f07e7d-284b-42df-a020-bf6bebe89fa5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053570 Apr 05 12:02:12.370443 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 883/1744] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:12 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:12.371328 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8977b9b7-360f-4304-81c1-b76c18909476 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:12.371753 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8977b9b7-360f-4304-81c1-b76c18909476 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:12.372570 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8977b9b7-360f-4304-81c1-b76c18909476 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:12.373008 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8977b9b7-360f-4304-81c1-b76c18909476 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:12.408115 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8977b9b7-360f-4304-81c1-b76c18909476 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048051 Apr 05 12:02:12.408689 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 862/1745] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:12 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:13.376204 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c5076287-171b-40a5-a180-ea32aa19dd76 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:13.377709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c5076287-171b-40a5-a180-ea32aa19dd76 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:13.385902 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9562f140-e3ab-4cf8-a456-3790fed1b155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:13.388941 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c5076287-171b-40a5-a180-ea32aa19dd76 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:13.389533 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9562f140-e3ab-4cf8-a456-3790fed1b155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:13.389806 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c5076287-171b-40a5-a180-ea32aa19dd76 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:13.390829 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c5076287-171b-40a5-a180-ea32aa19dd76 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:13.391922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c5076287-171b-40a5-a180-ea32aa19dd76 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:13.397713 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9562f140-e3ab-4cf8-a456-3790fed1b155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:13.398228 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9562f140-e3ab-4cf8-a456-3790fed1b155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:13.399958 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9562f140-e3ab-4cf8-a456-3790fed1b155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:13.399958 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9562f140-e3ab-4cf8-a456-3790fed1b155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:13.423190 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c5076287-171b-40a5-a180-ea32aa19dd76 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054717 Apr 05 12:02:13.425399 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 884/1746] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:13 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:13.429001 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5be7c3df-32ec-42fb-b871-c4a97ab47852 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:13.429916 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5be7c3df-32ec-42fb-b871-c4a97ab47852 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:13.435841 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5be7c3df-32ec-42fb-b871-c4a97ab47852 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:13.436307 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5be7c3df-32ec-42fb-b871-c4a97ab47852 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:13.440828 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5be7c3df-32ec-42fb-b871-c4a97ab47852 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:13.440828 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5be7c3df-32ec-42fb-b871-c4a97ab47852 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:13.441313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9562f140-e3ab-4cf8-a456-3790fed1b155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053656 Apr 05 12:02:13.442276 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 863/1747] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:13 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:13.470752 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5be7c3df-32ec-42fb-b871-c4a97ab47852 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045969 Apr 05 12:02:13.471510 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 885/1748] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:13 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:14.440586 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-96e4af95-a242-4fab-982a-13cb29e25b2d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:14.441508 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-96e4af95-a242-4fab-982a-13cb29e25b2d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:14.448310 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-96e4af95-a242-4fab-982a-13cb29e25b2d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:14.449392 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-96e4af95-a242-4fab-982a-13cb29e25b2d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:14.450733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-96e4af95-a242-4fab-982a-13cb29e25b2d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:14.451400 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-96e4af95-a242-4fab-982a-13cb29e25b2d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:14.451766 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fe4ac09e-53b6-4e88-b00d-9726bc11d937 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:14.453242 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fe4ac09e-53b6-4e88-b00d-9726bc11d937 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:14.460322 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fe4ac09e-53b6-4e88-b00d-9726bc11d937 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:14.460966 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fe4ac09e-53b6-4e88-b00d-9726bc11d937 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:14.461925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fe4ac09e-53b6-4e88-b00d-9726bc11d937 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:14.462510 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fe4ac09e-53b6-4e88-b00d-9726bc11d937 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:14.481172 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-96e4af95-a242-4fab-982a-13cb29e25b2d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048725 Apr 05 12:02:14.481964 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 864/1749] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:14 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:14.489248 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-633c5d44-8df0-4cb8-8a13-8915893a9861 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:14.490187 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-633c5d44-8df0-4cb8-8a13-8915893a9861 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:14.498656 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-633c5d44-8df0-4cb8-8a13-8915893a9861 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:14.499103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-633c5d44-8df0-4cb8-8a13-8915893a9861 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:14.500156 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-633c5d44-8df0-4cb8-8a13-8915893a9861 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:14.500680 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-633c5d44-8df0-4cb8-8a13-8915893a9861 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:14.507348 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fe4ac09e-53b6-4e88-b00d-9726bc11d937 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059375 Apr 05 12:02:14.507930 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 886/1750] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:14 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:14.531936 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-633c5d44-8df0-4cb8-8a13-8915893a9861 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047654 Apr 05 12:02:14.532531 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 865/1751] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:14 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:15.497384 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cf564b47-2e42-4410-b923-2be45c57e6a8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:15.498796 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cf564b47-2e42-4410-b923-2be45c57e6a8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:15.509369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cf564b47-2e42-4410-b923-2be45c57e6a8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:15.510088 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cf564b47-2e42-4410-b923-2be45c57e6a8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:15.511432 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cf564b47-2e42-4410-b923-2be45c57e6a8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:15.512152 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cf564b47-2e42-4410-b923-2be45c57e6a8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:15.521326 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-aefa279b-ff2d-4638-a27a-8fcf4467f1de tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:15.522813 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-aefa279b-ff2d-4638-a27a-8fcf4467f1de tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:15.528864 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aefa279b-ff2d-4638-a27a-8fcf4467f1de tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:15.529538 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aefa279b-ff2d-4638-a27a-8fcf4467f1de tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:15.530295 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aefa279b-ff2d-4638-a27a-8fcf4467f1de tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:15.530747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aefa279b-ff2d-4638-a27a-8fcf4467f1de tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:15.546727 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cf564b47-2e42-4410-b923-2be45c57e6a8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054717 Apr 05 12:02:15.546727 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 887/1752] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:15 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:15.550922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-82a1aec0-7c18-4884-840e-107dcc2c9fd1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:15.551968 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-82a1aec0-7c18-4884-840e-107dcc2c9fd1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:15.557876 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-82a1aec0-7c18-4884-840e-107dcc2c9fd1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:15.558374 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-82a1aec0-7c18-4884-840e-107dcc2c9fd1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:15.559089 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-82a1aec0-7c18-4884-840e-107dcc2c9fd1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:15.559531 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-82a1aec0-7c18-4884-840e-107dcc2c9fd1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:15.572998 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-aefa279b-ff2d-4638-a27a-8fcf4467f1de tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056724 Apr 05 12:02:15.573576 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 866/1753] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:15 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:02:15.588772 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-82a1aec0-7c18-4884-840e-107dcc2c9fd1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041589 Apr 05 12:02:15.589519 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 888/1754] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:15 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:16.561536 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e5deefeb-65cb-4cd1-88ad-b551e59c3605 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:16.563023 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e5deefeb-65cb-4cd1-88ad-b551e59c3605 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:16.570889 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e5deefeb-65cb-4cd1-88ad-b551e59c3605 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:16.571283 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e5deefeb-65cb-4cd1-88ad-b551e59c3605 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:16.572185 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e5deefeb-65cb-4cd1-88ad-b551e59c3605 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:16.572527 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e5deefeb-65cb-4cd1-88ad-b551e59c3605 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:16.585140 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f8a5e060-362b-487e-bc7f-fe7d13e4644f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:16.586022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f8a5e060-362b-487e-bc7f-fe7d13e4644f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:16.592980 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f8a5e060-362b-487e-bc7f-fe7d13e4644f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:16.593408 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f8a5e060-362b-487e-bc7f-fe7d13e4644f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:16.594375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f8a5e060-362b-487e-bc7f-fe7d13e4644f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:16.595000 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f8a5e060-362b-487e-bc7f-fe7d13e4644f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:16.603728 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e5deefeb-65cb-4cd1-88ad-b551e59c3605 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048967 Apr 05 12:02:16.607496 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 867/1755] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:16 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:16.609307 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-64dcf5ae-eec6-4d20-ace9-79e4e82bd666 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:16.610852 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-64dcf5ae-eec6-4d20-ace9-79e4e82bd666 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:16.623431 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64dcf5ae-eec6-4d20-ace9-79e4e82bd666 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:16.623431 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64dcf5ae-eec6-4d20-ace9-79e4e82bd666 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:16.623431 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64dcf5ae-eec6-4d20-ace9-79e4e82bd666 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:16.623431 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64dcf5ae-eec6-4d20-ace9-79e4e82bd666 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:16.626907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f8a5e060-362b-487e-bc7f-fe7d13e4644f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045674 Apr 05 12:02:16.627498 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 889/1756] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:16 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:16.655821 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-64dcf5ae-eec6-4d20-ace9-79e4e82bd666 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050042 Apr 05 12:02:16.656364 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 868/1757] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:16 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:17.619628 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b6753c02-0993-457e-b314-b2be509d09d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:17.621135 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b6753c02-0993-457e-b314-b2be509d09d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:17.630662 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6753c02-0993-457e-b314-b2be509d09d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:17.631111 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6753c02-0993-457e-b314-b2be509d09d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:17.631876 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6753c02-0993-457e-b314-b2be509d09d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:17.632339 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6753c02-0993-457e-b314-b2be509d09d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:17.638092 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c449149f-d2cd-493e-b61a-271c0c07c411 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:17.639101 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c449149f-d2cd-493e-b61a-271c0c07c411 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:17.645912 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c449149f-d2cd-493e-b61a-271c0c07c411 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:17.646364 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c449149f-d2cd-493e-b61a-271c0c07c411 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:17.647136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c449149f-d2cd-493e-b61a-271c0c07c411 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:17.647594 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c449149f-d2cd-493e-b61a-271c0c07c411 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:17.671618 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b6753c02-0993-457e-b314-b2be509d09d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059127 Apr 05 12:02:17.672694 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 890/1758] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:17 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:17.677046 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-71572b34-d57c-45a6-8355-b6a1f78e73f6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:17.677960 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-71572b34-d57c-45a6-8355-b6a1f78e73f6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:17.678747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c449149f-d2cd-493e-b61a-271c0c07c411 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044499 Apr 05 12:02:17.679481 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 869/1759] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:17 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:17.683787 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71572b34-d57c-45a6-8355-b6a1f78e73f6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:17.684283 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71572b34-d57c-45a6-8355-b6a1f78e73f6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:17.685022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71572b34-d57c-45a6-8355-b6a1f78e73f6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:17.685455 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71572b34-d57c-45a6-8355-b6a1f78e73f6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:17.714906 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-71572b34-d57c-45a6-8355-b6a1f78e73f6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041598 Apr 05 12:02:17.715495 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 891/1760] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:17 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:18.688118 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d41e8638-4081-4288-a75c-efc2eb92d788 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:18.689588 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d41e8638-4081-4288-a75c-efc2eb92d788 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:18.693731 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7c7bb078-2030-4b58-8ee7-d8a7e6839a2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:18.696453 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7c7bb078-2030-4b58-8ee7-d8a7e6839a2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:18.701098 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d41e8638-4081-4288-a75c-efc2eb92d788 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:18.701838 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d41e8638-4081-4288-a75c-efc2eb92d788 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:18.703159 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d41e8638-4081-4288-a75c-efc2eb92d788 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:18.703951 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d41e8638-4081-4288-a75c-efc2eb92d788 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:18.708404 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7c7bb078-2030-4b58-8ee7-d8a7e6839a2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:18.708852 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7c7bb078-2030-4b58-8ee7-d8a7e6839a2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:18.709988 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7c7bb078-2030-4b58-8ee7-d8a7e6839a2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:18.710428 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7c7bb078-2030-4b58-8ee7-d8a7e6839a2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:18.737215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d41e8638-4081-4288-a75c-efc2eb92d788 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056095 Apr 05 12:02:18.737964 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 870/1761] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:18 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:18.741872 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7c7bb078-2030-4b58-8ee7-d8a7e6839a2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054790 Apr 05 12:02:18.742725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 892/1762] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:18 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:18.749550 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f775ed39-4bac-4c72-883e-8e04a7cd645d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:18.750480 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f775ed39-4bac-4c72-883e-8e04a7cd645d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:18.756670 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f775ed39-4bac-4c72-883e-8e04a7cd645d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:18.757136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f775ed39-4bac-4c72-883e-8e04a7cd645d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:18.757913 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f775ed39-4bac-4c72-883e-8e04a7cd645d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:18.758335 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f775ed39-4bac-4c72-883e-8e04a7cd645d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:18.786362 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f775ed39-4bac-4c72-883e-8e04a7cd645d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043841 Apr 05 12:02:18.786911 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 871/1763] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:18 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:19.753730 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-76a850f1-1256-4705-ae09-01b9332f2aa3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:19.755247 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-76a850f1-1256-4705-ae09-01b9332f2aa3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:19.758537 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-98bce7f1-d2d7-401a-9083-31b6f4dbc4a2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:19.759605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-98bce7f1-d2d7-401a-9083-31b6f4dbc4a2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:19.762087 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-76a850f1-1256-4705-ae09-01b9332f2aa3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:19.762479 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-76a850f1-1256-4705-ae09-01b9332f2aa3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:19.763404 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-76a850f1-1256-4705-ae09-01b9332f2aa3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:19.763819 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-76a850f1-1256-4705-ae09-01b9332f2aa3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:19.772604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-98bce7f1-d2d7-401a-9083-31b6f4dbc4a2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:19.773020 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-98bce7f1-d2d7-401a-9083-31b6f4dbc4a2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:19.773819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-98bce7f1-d2d7-401a-9083-31b6f4dbc4a2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:19.774220 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-98bce7f1-d2d7-401a-9083-31b6f4dbc4a2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:19.800639 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-76a850f1-1256-4705-ae09-01b9332f2aa3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053640 Apr 05 12:02:19.801181 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 893/1764] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:19 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:19.805875 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0b2e3f2b-17f1-459f-8ed0-affc6b3b6836 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:19.806894 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0b2e3f2b-17f1-459f-8ed0-affc6b3b6836 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:19.807977 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-98bce7f1-d2d7-401a-9083-31b6f4dbc4a2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058383 Apr 05 12:02:19.809004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 872/1765] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:19 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:19.814701 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0b2e3f2b-17f1-459f-8ed0-affc6b3b6836 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:19.815360 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0b2e3f2b-17f1-459f-8ed0-affc6b3b6836 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:19.816120 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0b2e3f2b-17f1-459f-8ed0-affc6b3b6836 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:19.816570 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0b2e3f2b-17f1-459f-8ed0-affc6b3b6836 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:19.845307 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0b2e3f2b-17f1-459f-8ed0-affc6b3b6836 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043147 Apr 05 12:02:19.846461 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 894/1766] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:19 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:20.815717 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-868ba5a7-55e7-413f-93b4-6ce454652da1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:20.817337 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-868ba5a7-55e7-413f-93b4-6ce454652da1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:20.823383 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-85c92cd3-137f-4c6e-8229-bbc794a27e9e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:20.824776 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-85c92cd3-137f-4c6e-8229-bbc794a27e9e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:20.826947 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-868ba5a7-55e7-413f-93b4-6ce454652da1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:20.827475 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-868ba5a7-55e7-413f-93b4-6ce454652da1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:20.828568 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-868ba5a7-55e7-413f-93b4-6ce454652da1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:20.829301 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-868ba5a7-55e7-413f-93b4-6ce454652da1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:20.836502 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-85c92cd3-137f-4c6e-8229-bbc794a27e9e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:20.836954 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-85c92cd3-137f-4c6e-8229-bbc794a27e9e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:20.837720 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-85c92cd3-137f-4c6e-8229-bbc794a27e9e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:20.838156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-85c92cd3-137f-4c6e-8229-bbc794a27e9e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:20.864977 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-868ba5a7-55e7-413f-93b4-6ce454652da1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055280 Apr 05 12:02:20.865693 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 873/1767] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:20 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:20.870967 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-63955ae5-f882-4e0c-852c-2878675a607a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:20.871954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-63955ae5-f882-4e0c-852c-2878675a607a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:20.879210 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-85c92cd3-137f-4c6e-8229-bbc794a27e9e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063213 Apr 05 12:02:20.879762 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 895/1768] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:20 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:20.880107 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63955ae5-f882-4e0c-852c-2878675a607a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:20.880669 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63955ae5-f882-4e0c-852c-2878675a607a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:20.881546 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63955ae5-f882-4e0c-852c-2878675a607a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:20.882087 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63955ae5-f882-4e0c-852c-2878675a607a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:20.910624 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-63955ae5-f882-4e0c-852c-2878675a607a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043841 Apr 05 12:02:20.911224 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 874/1769] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:20 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:21.880562 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fba54e41-42ab-4357-93fd-9b6bea6e73be tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:21.881869 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fba54e41-42ab-4357-93fd-9b6bea6e73be tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:21.888232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fba54e41-42ab-4357-93fd-9b6bea6e73be tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:21.888676 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fba54e41-42ab-4357-93fd-9b6bea6e73be tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:21.889461 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fba54e41-42ab-4357-93fd-9b6bea6e73be tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:21.889887 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fba54e41-42ab-4357-93fd-9b6bea6e73be tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:21.890545 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8c0d823b-32d6-4397-9fb9-481fb9378de3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:21.891608 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8c0d823b-32d6-4397-9fb9-481fb9378de3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:21.898186 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c0d823b-32d6-4397-9fb9-481fb9378de3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:21.898715 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c0d823b-32d6-4397-9fb9-481fb9378de3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:21.899536 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c0d823b-32d6-4397-9fb9-481fb9378de3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:21.900196 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c0d823b-32d6-4397-9fb9-481fb9378de3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:21.920243 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fba54e41-42ab-4357-93fd-9b6bea6e73be tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045685 Apr 05 12:02:21.920992 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 896/1770] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:21 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:21.925406 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fa7cb6b4-1432-43de-a12e-ab81bd8b4b3f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:21.926309 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fa7cb6b4-1432-43de-a12e-ab81bd8b4b3f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:21.937664 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8c0d823b-32d6-4397-9fb9-481fb9378de3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043739 Apr 05 12:02:21.937664 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 875/1771] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:21 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:21.940716 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fa7cb6b4-1432-43de-a12e-ab81bd8b4b3f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:21.941182 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fa7cb6b4-1432-43de-a12e-ab81bd8b4b3f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:21.941946 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fa7cb6b4-1432-43de-a12e-ab81bd8b4b3f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:21.942382 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fa7cb6b4-1432-43de-a12e-ab81bd8b4b3f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:21.971017 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fa7cb6b4-1432-43de-a12e-ab81bd8b4b3f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049199 Apr 05 12:02:21.971575 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 897/1772] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:21 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:22.931922 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-94a5fcc1-b712-4349-b7af-f2bfe3d45778 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:22.932977 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-94a5fcc1-b712-4349-b7af-f2bfe3d45778 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:22.939728 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-94a5fcc1-b712-4349-b7af-f2bfe3d45778 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:22.940297 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-94a5fcc1-b712-4349-b7af-f2bfe3d45778 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:22.940899 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3a1b30bf-bd9f-4055-b051-630427e5f62d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:22.941349 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-94a5fcc1-b712-4349-b7af-f2bfe3d45778 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:22.941437 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-94a5fcc1-b712-4349-b7af-f2bfe3d45778 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:22.941835 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3a1b30bf-bd9f-4055-b051-630427e5f62d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:22.948680 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a1b30bf-bd9f-4055-b051-630427e5f62d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:22.949157 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a1b30bf-bd9f-4055-b051-630427e5f62d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:22.949914 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a1b30bf-bd9f-4055-b051-630427e5f62d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:22.950343 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a1b30bf-bd9f-4055-b051-630427e5f62d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:22.973636 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-94a5fcc1-b712-4349-b7af-f2bfe3d45778 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045794 Apr 05 12:02:22.974419 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 876/1773] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:22 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:22.980444 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3a1b30bf-bd9f-4055-b051-630427e5f62d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043340 Apr 05 12:02:22.981261 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 898/1774] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:22 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:22.985994 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5cca0942-c308-46b3-a28b-8985255c94cd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:22.986906 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5cca0942-c308-46b3-a28b-8985255c94cd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:22.993163 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5cca0942-c308-46b3-a28b-8985255c94cd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:22.993594 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5cca0942-c308-46b3-a28b-8985255c94cd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:22.994351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5cca0942-c308-46b3-a28b-8985255c94cd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:22.994779 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5cca0942-c308-46b3-a28b-8985255c94cd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:23.022664 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5cca0942-c308-46b3-a28b-8985255c94cd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043849 Apr 05 12:02:23.023244 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 877/1775] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:22 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:02:23.990140 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e34f4b36-618c-45a6-9f48-a939a2f00d82 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:23.991672 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e34f4b36-618c-45a6-9f48-a939a2f00d82 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:23.998371 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f1fd66f0-29bd-47cf-9cac-02cb1711a338 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:02:23.999974 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f1fd66f0-29bd-47cf-9cac-02cb1711a338 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:24.002261 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e34f4b36-618c-45a6-9f48-a939a2f00d82 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:24.003033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e34f4b36-618c-45a6-9f48-a939a2f00d82 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:24.004377 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e34f4b36-618c-45a6-9f48-a939a2f00d82 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:24.005094 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e34f4b36-618c-45a6-9f48-a939a2f00d82 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:24.008397 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f1fd66f0-29bd-47cf-9cac-02cb1711a338 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:24.008849 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f1fd66f0-29bd-47cf-9cac-02cb1711a338 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:24.009628 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f1fd66f0-29bd-47cf-9cac-02cb1711a338 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:24.010034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f1fd66f0-29bd-47cf-9cac-02cb1711a338 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:24.035083 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e34f4b36-618c-45a6-9f48-a939a2f00d82 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051948 Apr 05 12:02:24.035678 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 899/1776] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:23 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:24.040575 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-26754257-2e45-4d3a-b451-ac1488bc3929 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:24.041465 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-26754257-2e45-4d3a-b451-ac1488bc3929 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:24.047368 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-26754257-2e45-4d3a-b451-ac1488bc3929 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:24.047868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-26754257-2e45-4d3a-b451-ac1488bc3929 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:24.048673 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-26754257-2e45-4d3a-b451-ac1488bc3929 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:24.049117 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-26754257-2e45-4d3a-b451-ac1488bc3929 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:24.077347 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-26754257-2e45-4d3a-b451-ac1488bc3929 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040631 Apr 05 12:02:24.078140 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 900/1777] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:24 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:24.088285 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f1fd66f0-29bd-47cf-9cac-02cb1711a338 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "POST /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/action" status: 200 len: 41623 microversion: 2.1 time: 0.098822 Apr 05 12:02:24.089776 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 878/1778] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Apr 5 12:02:23 2022] POST /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8/action => generated 41623 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:02:25.047087 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-11a7fd58-68e6-4d0a-b292-73c915674179 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:25.048664 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-11a7fd58-68e6-4d0a-b292-73c915674179 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:25.055420 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-11a7fd58-68e6-4d0a-b292-73c915674179 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:25.055860 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-11a7fd58-68e6-4d0a-b292-73c915674179 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:25.056663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-11a7fd58-68e6-4d0a-b292-73c915674179 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:25.057083 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-11a7fd58-68e6-4d0a-b292-73c915674179 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:25.089733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ae3c8781-4034-4ff8-b615-8bd11b575768 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:25.090255 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-11a7fd58-68e6-4d0a-b292-73c915674179 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046877 Apr 05 12:02:25.090746 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ae3c8781-4034-4ff8-b615-8bd11b575768 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:25.094365 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 901/1779] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:25 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:25.101314 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae3c8781-4034-4ff8-b615-8bd11b575768 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:25.101753 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae3c8781-4034-4ff8-b615-8bd11b575768 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:25.102523 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae3c8781-4034-4ff8-b615-8bd11b575768 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:25.102950 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae3c8781-4034-4ff8-b615-8bd11b575768 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:25.134914 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ae3c8781-4034-4ff8-b615-8bd11b575768 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049414 Apr 05 12:02:25.135639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 879/1780] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:25 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:26.106134 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1162eb07-bec1-422c-b887-c930d296b69f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:26.107607 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1162eb07-bec1-422c-b887-c930d296b69f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:26.117687 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1162eb07-bec1-422c-b887-c930d296b69f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:26.118124 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1162eb07-bec1-422c-b887-c930d296b69f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:26.118998 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1162eb07-bec1-422c-b887-c930d296b69f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:26.119292 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1162eb07-bec1-422c-b887-c930d296b69f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:26.146883 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e6b1fc3a-9fcf-4ce3-831d-dc7e9f7d1278 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:26.147829 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e6b1fc3a-9fcf-4ce3-831d-dc7e9f7d1278 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:26.148492 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1162eb07-bec1-422c-b887-c930d296b69f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049214 Apr 05 12:02:26.150198 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 902/1781] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:26 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:26.155317 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6b1fc3a-9fcf-4ce3-831d-dc7e9f7d1278 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:26.155768 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6b1fc3a-9fcf-4ce3-831d-dc7e9f7d1278 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:26.156572 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6b1fc3a-9fcf-4ce3-831d-dc7e9f7d1278 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:26.157008 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6b1fc3a-9fcf-4ce3-831d-dc7e9f7d1278 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:26.194149 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e6b1fc3a-9fcf-4ce3-831d-dc7e9f7d1278 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051301 Apr 05 12:02:26.194806 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 880/1782] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:26 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:27.164660 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ceb93d8e-c638-4886-9409-2062931c1788 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:27.166156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ceb93d8e-c638-4886-9409-2062931c1788 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:27.177447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ceb93d8e-c638-4886-9409-2062931c1788 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:27.178246 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ceb93d8e-c638-4886-9409-2062931c1788 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:27.179506 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ceb93d8e-c638-4886-9409-2062931c1788 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:27.180361 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ceb93d8e-c638-4886-9409-2062931c1788 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:27.206063 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9dfba176-d12f-4898-b442-a9043a8f18d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:27.207113 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9dfba176-d12f-4898-b442-a9043a8f18d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:27.213954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9dfba176-d12f-4898-b442-a9043a8f18d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:27.214393 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9dfba176-d12f-4898-b442-a9043a8f18d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:27.215403 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9dfba176-d12f-4898-b442-a9043a8f18d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:27.215851 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9dfba176-d12f-4898-b442-a9043a8f18d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:27.216036 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ceb93d8e-c638-4886-9409-2062931c1788 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058311 Apr 05 12:02:27.216864 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 903/1783] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:27 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:27.245880 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9dfba176-d12f-4898-b442-a9043a8f18d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044260 Apr 05 12:02:27.246639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 881/1784] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:27 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:28.232690 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8e99c633-23a9-4cc7-95d5-bf1cdc1a96fb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:28.234262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8e99c633-23a9-4cc7-95d5-bf1cdc1a96fb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:28.243986 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e99c633-23a9-4cc7-95d5-bf1cdc1a96fb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:28.244473 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e99c633-23a9-4cc7-95d5-bf1cdc1a96fb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:28.245202 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e99c633-23a9-4cc7-95d5-bf1cdc1a96fb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:28.245638 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e99c633-23a9-4cc7-95d5-bf1cdc1a96fb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:28.257429 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4ae55a0e-d60f-4ed8-beb2-5220195837c5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:28.258528 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4ae55a0e-d60f-4ed8-beb2-5220195837c5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:28.265280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4ae55a0e-d60f-4ed8-beb2-5220195837c5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:28.265788 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4ae55a0e-d60f-4ed8-beb2-5220195837c5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:28.266637 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4ae55a0e-d60f-4ed8-beb2-5220195837c5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:28.267075 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4ae55a0e-d60f-4ed8-beb2-5220195837c5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:28.275796 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8e99c633-23a9-4cc7-95d5-bf1cdc1a96fb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049875 Apr 05 12:02:28.276414 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 904/1785] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:28 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:28.299605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4ae55a0e-d60f-4ed8-beb2-5220195837c5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045842 Apr 05 12:02:28.300230 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 882/1786] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:28 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:29.290640 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ef4d6e67-d047-4965-9fdd-3680d320cf19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:29.291549 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ef4d6e67-d047-4965-9fdd-3680d320cf19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:29.298370 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ef4d6e67-d047-4965-9fdd-3680d320cf19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:29.298666 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ef4d6e67-d047-4965-9fdd-3680d320cf19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:29.299425 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ef4d6e67-d047-4965-9fdd-3680d320cf19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:29.299850 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ef4d6e67-d047-4965-9fdd-3680d320cf19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:29.311061 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a8f953ca-94ea-4bf0-801c-37e983e36062 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:29.311990 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a8f953ca-94ea-4bf0-801c-37e983e36062 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:29.318264 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a8f953ca-94ea-4bf0-801c-37e983e36062 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:29.318750 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a8f953ca-94ea-4bf0-801c-37e983e36062 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:29.319786 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a8f953ca-94ea-4bf0-801c-37e983e36062 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:29.320359 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a8f953ca-94ea-4bf0-801c-37e983e36062 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:29.335411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ef4d6e67-d047-4965-9fdd-3680d320cf19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048641 Apr 05 12:02:29.335716 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 905/1787] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:29 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:29.369642 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a8f953ca-94ea-4bf0-801c-37e983e36062 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062490 Apr 05 12:02:29.370359 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 883/1788] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:29 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:30.349760 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1cd5f019-6d95-45ca-ac76-16b170277496 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:30.350793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1cd5f019-6d95-45ca-ac76-16b170277496 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:30.357383 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1cd5f019-6d95-45ca-ac76-16b170277496 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:30.357827 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1cd5f019-6d95-45ca-ac76-16b170277496 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:30.358601 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1cd5f019-6d95-45ca-ac76-16b170277496 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:30.359033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1cd5f019-6d95-45ca-ac76-16b170277496 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:30.381552 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5b701cc3-a44b-452c-a307-1361b25256b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:30.382482 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5b701cc3-a44b-452c-a307-1361b25256b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:30.388807 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5b701cc3-a44b-452c-a307-1361b25256b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:30.389238 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5b701cc3-a44b-452c-a307-1361b25256b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:30.390220 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5b701cc3-a44b-452c-a307-1361b25256b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:30.390655 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5b701cc3-a44b-452c-a307-1361b25256b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:30.392009 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1cd5f019-6d95-45ca-ac76-16b170277496 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047960 Apr 05 12:02:30.393386 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 906/1789] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:30 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:30.422964 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5b701cc3-a44b-452c-a307-1361b25256b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045372 Apr 05 12:02:30.423540 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 884/1790] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:30 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:31.408574 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-eff93f7b-515c-4a68-bbfa-db892dac6f74 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:31.410099 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-eff93f7b-515c-4a68-bbfa-db892dac6f74 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:31.420632 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eff93f7b-515c-4a68-bbfa-db892dac6f74 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:31.421379 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eff93f7b-515c-4a68-bbfa-db892dac6f74 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:31.422641 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eff93f7b-515c-4a68-bbfa-db892dac6f74 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:31.423361 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eff93f7b-515c-4a68-bbfa-db892dac6f74 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:31.435079 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fe4b2f1a-3c4f-4c30-821d-1fac0c4a37b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:31.435955 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fe4b2f1a-3c4f-4c30-821d-1fac0c4a37b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:31.443857 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe4b2f1a-3c4f-4c30-821d-1fac0c4a37b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:31.444669 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe4b2f1a-3c4f-4c30-821d-1fac0c4a37b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:31.445645 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe4b2f1a-3c4f-4c30-821d-1fac0c4a37b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:31.446271 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe4b2f1a-3c4f-4c30-821d-1fac0c4a37b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:31.456215 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-eff93f7b-515c-4a68-bbfa-db892dac6f74 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054324 Apr 05 12:02:31.456975 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 907/1791] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:31 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:31.475191 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fe4b2f1a-3c4f-4c30-821d-1fac0c4a37b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043934 Apr 05 12:02:31.475749 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 885/1792] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:31 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:02:32.468331 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2d216009-ffde-4a2b-889f-3487a7d9dce5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:32.469322 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2d216009-ffde-4a2b-889f-3487a7d9dce5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:32.476821 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2d216009-ffde-4a2b-889f-3487a7d9dce5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:32.477254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2d216009-ffde-4a2b-889f-3487a7d9dce5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:32.478014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2d216009-ffde-4a2b-889f-3487a7d9dce5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:32.478450 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2d216009-ffde-4a2b-889f-3487a7d9dce5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:32.486779 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-662a8db1-aa1e-4850-80c8-1da74f7d6919 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:32.488402 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-662a8db1-aa1e-4850-80c8-1da74f7d6919 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:32.495429 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-662a8db1-aa1e-4850-80c8-1da74f7d6919 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:32.495881 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-662a8db1-aa1e-4850-80c8-1da74f7d6919 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:32.496653 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-662a8db1-aa1e-4850-80c8-1da74f7d6919 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:32.497327 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-662a8db1-aa1e-4850-80c8-1da74f7d6919 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:32.509214 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2d216009-ffde-4a2b-889f-3487a7d9dce5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045785 Apr 05 12:02:32.509994 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 908/1793] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:32 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:32.526437 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-662a8db1-aa1e-4850-80c8-1da74f7d6919 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043513 Apr 05 12:02:32.527148 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 886/1794] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:32 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:33.522788 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-db627f9b-049e-44cf-b15f-0dd1ae3ff5f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:33.523710 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-db627f9b-049e-44cf-b15f-0dd1ae3ff5f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:33.530473 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-db627f9b-049e-44cf-b15f-0dd1ae3ff5f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:33.530925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-db627f9b-049e-44cf-b15f-0dd1ae3ff5f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:33.531720 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-db627f9b-049e-44cf-b15f-0dd1ae3ff5f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:33.532187 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-db627f9b-049e-44cf-b15f-0dd1ae3ff5f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:33.538115 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ed334094-c094-4097-b86b-00283f9dad66 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:33.539144 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ed334094-c094-4097-b86b-00283f9dad66 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:33.545897 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ed334094-c094-4097-b86b-00283f9dad66 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:33.546686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ed334094-c094-4097-b86b-00283f9dad66 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:33.547109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ed334094-c094-4097-b86b-00283f9dad66 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:33.547531 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ed334094-c094-4097-b86b-00283f9dad66 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:33.562557 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-db627f9b-049e-44cf-b15f-0dd1ae3ff5f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044822 Apr 05 12:02:33.563595 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 909/1795] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:33 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:33.576328 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ed334094-c094-4097-b86b-00283f9dad66 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042069 Apr 05 12:02:33.576900 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 887/1796] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:33 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:34.578843 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-17c6d304-aaca-403b-8385-6bc9e90d2009 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:34.580480 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-17c6d304-aaca-403b-8385-6bc9e90d2009 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:34.590932 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d61388a3-4c7c-4957-aa34-8afd2dda2825 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:34.591674 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-17c6d304-aaca-403b-8385-6bc9e90d2009 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:34.591674 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-17c6d304-aaca-403b-8385-6bc9e90d2009 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:34.592542 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d61388a3-4c7c-4957-aa34-8afd2dda2825 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:34.593129 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-17c6d304-aaca-403b-8385-6bc9e90d2009 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:34.593856 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-17c6d304-aaca-403b-8385-6bc9e90d2009 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:34.602215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d61388a3-4c7c-4957-aa34-8afd2dda2825 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:34.602673 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d61388a3-4c7c-4957-aa34-8afd2dda2825 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:34.603376 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d61388a3-4c7c-4957-aa34-8afd2dda2825 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:34.603801 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d61388a3-4c7c-4957-aa34-8afd2dda2825 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:34.626079 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-17c6d304-aaca-403b-8385-6bc9e90d2009 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053906 Apr 05 12:02:34.630334 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 910/1797] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:34 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:34.636789 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d61388a3-4c7c-4957-aa34-8afd2dda2825 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052268 Apr 05 12:02:34.637332 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 888/1798] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:34 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:35.642431 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f343a66c-0b8c-483b-a822-dd66c67cbe9f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:35.643991 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f343a66c-0b8c-483b-a822-dd66c67cbe9f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:35.650656 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ee409fb5-7aa1-4728-b0d0-bcff06585bb4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:35.651797 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ee409fb5-7aa1-4728-b0d0-bcff06585bb4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:35.651894 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f343a66c-0b8c-483b-a822-dd66c67cbe9f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:35.652354 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f343a66c-0b8c-483b-a822-dd66c67cbe9f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:35.653147 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f343a66c-0b8c-483b-a822-dd66c67cbe9f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:35.653559 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f343a66c-0b8c-483b-a822-dd66c67cbe9f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:35.658351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee409fb5-7aa1-4728-b0d0-bcff06585bb4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:35.658794 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee409fb5-7aa1-4728-b0d0-bcff06585bb4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:35.659586 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee409fb5-7aa1-4728-b0d0-bcff06585bb4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:35.660096 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee409fb5-7aa1-4728-b0d0-bcff06585bb4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:35.683646 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f343a66c-0b8c-483b-a822-dd66c67cbe9f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047835 Apr 05 12:02:35.684946 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 911/1799] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:35 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:35.690809 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ee409fb5-7aa1-4728-b0d0-bcff06585bb4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045001 Apr 05 12:02:35.691800 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 889/1800] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:35 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:36.696014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-02a7447a-2d65-4501-9b9e-5da756c58934 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:36.696957 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-02a7447a-2d65-4501-9b9e-5da756c58934 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:36.702416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8b9adf56-8e14-4410-b270-d6a612ead26b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:36.703341 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8b9adf56-8e14-4410-b270-d6a612ead26b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:36.703567 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-02a7447a-2d65-4501-9b9e-5da756c58934 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:36.704047 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-02a7447a-2d65-4501-9b9e-5da756c58934 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:36.704868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-02a7447a-2d65-4501-9b9e-5da756c58934 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:36.705234 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-02a7447a-2d65-4501-9b9e-5da756c58934 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:36.711229 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8b9adf56-8e14-4410-b270-d6a612ead26b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:36.711679 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8b9adf56-8e14-4410-b270-d6a612ead26b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:36.712642 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8b9adf56-8e14-4410-b270-d6a612ead26b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:36.713081 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8b9adf56-8e14-4410-b270-d6a612ead26b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:36.735506 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-02a7447a-2d65-4501-9b9e-5da756c58934 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043438 Apr 05 12:02:36.736495 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 912/1801] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:36 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:36.745485 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8b9adf56-8e14-4410-b270-d6a612ead26b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046922 Apr 05 12:02:36.745974 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 890/1802] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:36 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:37.751793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3f8b89a7-ec8d-47e7-90d8-109bdc681caf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:37.753342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3f8b89a7-ec8d-47e7-90d8-109bdc681caf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:37.759688 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4b0ae457-6e85-421e-a7f4-6e94ed3d9d3d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:37.760658 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4b0ae457-6e85-421e-a7f4-6e94ed3d9d3d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:37.762033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f8b89a7-ec8d-47e7-90d8-109bdc681caf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:37.762139 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f8b89a7-ec8d-47e7-90d8-109bdc681caf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:37.763081 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f8b89a7-ec8d-47e7-90d8-109bdc681caf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:37.763524 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f8b89a7-ec8d-47e7-90d8-109bdc681caf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:37.767195 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4b0ae457-6e85-421e-a7f4-6e94ed3d9d3d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:37.767641 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4b0ae457-6e85-421e-a7f4-6e94ed3d9d3d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:37.768619 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4b0ae457-6e85-421e-a7f4-6e94ed3d9d3d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:37.769089 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4b0ae457-6e85-421e-a7f4-6e94ed3d9d3d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:37.793579 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3f8b89a7-ec8d-47e7-90d8-109bdc681caf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048290 Apr 05 12:02:37.794162 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 913/1803] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:37 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:37.799955 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4b0ae457-6e85-421e-a7f4-6e94ed3d9d3d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045490 Apr 05 12:02:37.800557 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 891/1804] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:37 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:38.810031 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5710fff9-ab7d-4cba-a280-09600249ff5e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:38.811412 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5710fff9-ab7d-4cba-a280-09600249ff5e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:38.816856 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a4ed4adf-53af-40ef-b3ed-696a83766f72 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:38.818543 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a4ed4adf-53af-40ef-b3ed-696a83766f72 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:38.821632 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5710fff9-ab7d-4cba-a280-09600249ff5e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:38.822392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5710fff9-ab7d-4cba-a280-09600249ff5e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:38.823644 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5710fff9-ab7d-4cba-a280-09600249ff5e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:38.824380 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5710fff9-ab7d-4cba-a280-09600249ff5e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:38.830143 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a4ed4adf-53af-40ef-b3ed-696a83766f72 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:38.830888 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a4ed4adf-53af-40ef-b3ed-696a83766f72 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:38.832210 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a4ed4adf-53af-40ef-b3ed-696a83766f72 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:38.832975 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a4ed4adf-53af-40ef-b3ed-696a83766f72 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:38.860120 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5710fff9-ab7d-4cba-a280-09600249ff5e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057082 Apr 05 12:02:38.860701 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 914/1805] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:38 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:38.868103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a4ed4adf-53af-40ef-b3ed-696a83766f72 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058487 Apr 05 12:02:38.868690 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 892/1806] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:38 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:39.875747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-85e243f0-3491-4c8d-9873-e378d960fa2a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:39.877168 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-85e243f0-3491-4c8d-9873-e378d960fa2a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:39.884482 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-be9e7879-e364-467a-a437-d4d674486af0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:39.885957 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-be9e7879-e364-467a-a437-d4d674486af0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:39.886195 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-85e243f0-3491-4c8d-9873-e378d960fa2a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:39.886520 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-85e243f0-3491-4c8d-9873-e378d960fa2a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:39.887285 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-85e243f0-3491-4c8d-9873-e378d960fa2a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:39.887748 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-85e243f0-3491-4c8d-9873-e378d960fa2a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:39.892383 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-be9e7879-e364-467a-a437-d4d674486af0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:39.892834 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-be9e7879-e364-467a-a437-d4d674486af0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:39.893607 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-be9e7879-e364-467a-a437-d4d674486af0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:39.894035 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-be9e7879-e364-467a-a437-d4d674486af0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:39.919726 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-85e243f0-3491-4c8d-9873-e378d960fa2a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050712 Apr 05 12:02:39.920439 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 915/1807] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:39 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:39.923470 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-be9e7879-e364-467a-a437-d4d674486af0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047234 Apr 05 12:02:39.924210 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 893/1808] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:39 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:40.935324 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a5779e47-565b-4e2d-a1ff-02e4b59d0ce6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:40.936715 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a5779e47-565b-4e2d-a1ff-02e4b59d0ce6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:40.939514 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f04ac2a9-7306-422a-9432-07c78f580c80 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:40.941167 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f04ac2a9-7306-422a-9432-07c78f580c80 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:40.946595 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5779e47-565b-4e2d-a1ff-02e4b59d0ce6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:40.948378 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5779e47-565b-4e2d-a1ff-02e4b59d0ce6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:40.949651 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5779e47-565b-4e2d-a1ff-02e4b59d0ce6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:40.950351 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5779e47-565b-4e2d-a1ff-02e4b59d0ce6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:40.951565 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f04ac2a9-7306-422a-9432-07c78f580c80 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:40.952354 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f04ac2a9-7306-422a-9432-07c78f580c80 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:40.953575 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f04ac2a9-7306-422a-9432-07c78f580c80 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:40.954323 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f04ac2a9-7306-422a-9432-07c78f580c80 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:40.986453 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a5779e47-565b-4e2d-a1ff-02e4b59d0ce6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057907 Apr 05 12:02:40.986680 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f04ac2a9-7306-422a-9432-07c78f580c80 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054315 Apr 05 12:02:40.992217 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 894/1810] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:40 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:40.992316 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 916/1810] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:40 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:42.003677 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-12c10ab9-2868-438d-9fb4-4c7d04d657f8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:42.004720 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-12c10ab9-2868-438d-9fb4-4c7d04d657f8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:42.006858 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7fb78379-a7a1-4e05-b8e3-00520aee073a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:42.008068 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7fb78379-a7a1-4e05-b8e3-00520aee073a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:42.013832 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-12c10ab9-2868-438d-9fb4-4c7d04d657f8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:42.013832 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-12c10ab9-2868-438d-9fb4-4c7d04d657f8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:42.013832 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-12c10ab9-2868-438d-9fb4-4c7d04d657f8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:42.014171 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-12c10ab9-2868-438d-9fb4-4c7d04d657f8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:42.014685 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7fb78379-a7a1-4e05-b8e3-00520aee073a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:42.015134 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7fb78379-a7a1-4e05-b8e3-00520aee073a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:42.015899 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7fb78379-a7a1-4e05-b8e3-00520aee073a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:42.016371 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7fb78379-a7a1-4e05-b8e3-00520aee073a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:42.045532 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-12c10ab9-2868-438d-9fb4-4c7d04d657f8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049202 Apr 05 12:02:42.052384 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 895/1811] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:41 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:42.052938 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7fb78379-a7a1-4e05-b8e3-00520aee073a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047981 Apr 05 12:02:42.052938 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 917/1812] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:41 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:02:43.062194 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2778b51e-f2c4-4e9f-a4b7-c06b6c2c2f0b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:43.063250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2778b51e-f2c4-4e9f-a4b7-c06b6c2c2f0b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:43.066331 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c0f99f52-2b09-4f66-9ea0-16a364654198 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:43.067934 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c0f99f52-2b09-4f66-9ea0-16a364654198 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:43.073211 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2778b51e-f2c4-4e9f-a4b7-c06b6c2c2f0b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:43.073752 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2778b51e-f2c4-4e9f-a4b7-c06b6c2c2f0b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:43.074514 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2778b51e-f2c4-4e9f-a4b7-c06b6c2c2f0b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:43.074985 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2778b51e-f2c4-4e9f-a4b7-c06b6c2c2f0b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:43.076142 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c0f99f52-2b09-4f66-9ea0-16a364654198 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:43.076714 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c0f99f52-2b09-4f66-9ea0-16a364654198 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:43.077573 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c0f99f52-2b09-4f66-9ea0-16a364654198 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:43.078017 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c0f99f52-2b09-4f66-9ea0-16a364654198 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:43.106316 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2778b51e-f2c4-4e9f-a4b7-c06b6c2c2f0b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051350 Apr 05 12:02:43.106883 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 896/1813] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:43 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:43.107668 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c0f99f52-2b09-4f66-9ea0-16a364654198 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049855 Apr 05 12:02:43.108335 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 918/1814] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:43 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:02:44.121831 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1e175935-2693-450a-8632-a5896ffd6ee2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:44.122648 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-baa055bc-1a7f-44f6-b71a-d59b126cea04 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:44.123235 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1e175935-2693-450a-8632-a5896ffd6ee2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:44.123744 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-baa055bc-1a7f-44f6-b71a-d59b126cea04 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:44.130814 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1e175935-2693-450a-8632-a5896ffd6ee2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:44.131318 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1e175935-2693-450a-8632-a5896ffd6ee2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:44.131529 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-baa055bc-1a7f-44f6-b71a-d59b126cea04 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:44.132103 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-baa055bc-1a7f-44f6-b71a-d59b126cea04 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:44.132329 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1e175935-2693-450a-8632-a5896ffd6ee2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:44.132849 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1e175935-2693-450a-8632-a5896ffd6ee2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:44.133055 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-baa055bc-1a7f-44f6-b71a-d59b126cea04 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:44.133613 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-baa055bc-1a7f-44f6-b71a-d59b126cea04 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:44.168004 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-baa055bc-1a7f-44f6-b71a-d59b126cea04 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051239 Apr 05 12:02:44.169028 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 919/1815] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:44 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:44.178125 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1e175935-2693-450a-8632-a5896ffd6ee2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062457 Apr 05 12:02:44.178896 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 897/1816] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:44 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:44.623278 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:02:44.623574 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Tue Apr 5 12:02:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:02:45.181046 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-494549a2-8219-4843-8aca-576962e3b9ff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:45.182087 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-494549a2-8219-4843-8aca-576962e3b9ff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:45.189890 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-494549a2-8219-4843-8aca-576962e3b9ff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:45.190038 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-494549a2-8219-4843-8aca-576962e3b9ff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:45.190891 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-494549a2-8219-4843-8aca-576962e3b9ff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:45.191283 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-47423dc9-5b5f-46aa-a2ee-70a4209c7abb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:45.191777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-494549a2-8219-4843-8aca-576962e3b9ff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:45.193066 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-47423dc9-5b5f-46aa-a2ee-70a4209c7abb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:45.199617 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-47423dc9-5b5f-46aa-a2ee-70a4209c7abb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:45.200097 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-47423dc9-5b5f-46aa-a2ee-70a4209c7abb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:45.200872 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-47423dc9-5b5f-46aa-a2ee-70a4209c7abb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:45.201318 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-47423dc9-5b5f-46aa-a2ee-70a4209c7abb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:45.221760 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-494549a2-8219-4843-8aca-576962e3b9ff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045460 Apr 05 12:02:45.222517 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 920/1817] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:45 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:45.232333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-47423dc9-5b5f-46aa-a2ee-70a4209c7abb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045745 Apr 05 12:02:45.233071 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 898/1818] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:45 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:46.237924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9ae0683c-9469-44c6-8a68-d7a1a2465ec1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:46.239463 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9ae0683c-9469-44c6-8a68-d7a1a2465ec1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:46.246630 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c0d7ccd1-645b-43e8-b1f4-f74f0717a08c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:46.247538 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c0d7ccd1-645b-43e8-b1f4-f74f0717a08c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:46.247895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9ae0683c-9469-44c6-8a68-d7a1a2465ec1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:46.248375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9ae0683c-9469-44c6-8a68-d7a1a2465ec1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:46.249536 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9ae0683c-9469-44c6-8a68-d7a1a2465ec1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:46.250174 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9ae0683c-9469-44c6-8a68-d7a1a2465ec1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:46.254852 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0d7ccd1-645b-43e8-b1f4-f74f0717a08c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:46.255274 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0d7ccd1-645b-43e8-b1f4-f74f0717a08c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:46.256062 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0d7ccd1-645b-43e8-b1f4-f74f0717a08c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:46.256554 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0d7ccd1-645b-43e8-b1f4-f74f0717a08c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:46.288859 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9ae0683c-9469-44c6-8a68-d7a1a2465ec1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057283 Apr 05 12:02:46.289416 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 921/1819] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:46 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:46.295683 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c0d7ccd1-645b-43e8-b1f4-f74f0717a08c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054313 Apr 05 12:02:46.296278 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 899/1820] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:46 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:47.305321 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8b142cfd-9616-4a98-aead-3148e4ec8a6a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:47.306621 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8b142cfd-9616-4a98-aead-3148e4ec8a6a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:47.311078 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cb1d0de8-f648-45e4-adbc-1cf7c13f36f3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:47.312496 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cb1d0de8-f648-45e4-adbc-1cf7c13f36f3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:47.316804 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8b142cfd-9616-4a98-aead-3148e4ec8a6a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:47.317532 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8b142cfd-9616-4a98-aead-3148e4ec8a6a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:47.318753 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8b142cfd-9616-4a98-aead-3148e4ec8a6a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:47.319462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8b142cfd-9616-4a98-aead-3148e4ec8a6a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:47.323146 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cb1d0de8-f648-45e4-adbc-1cf7c13f36f3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:47.323936 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cb1d0de8-f648-45e4-adbc-1cf7c13f36f3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:47.324758 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cb1d0de8-f648-45e4-adbc-1cf7c13f36f3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:47.325197 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cb1d0de8-f648-45e4-adbc-1cf7c13f36f3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:47.350543 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8b142cfd-9616-4a98-aead-3148e4ec8a6a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052702 Apr 05 12:02:47.351118 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 922/1821] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:47 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:47.354874 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cb1d0de8-f648-45e4-adbc-1cf7c13f36f3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050585 Apr 05 12:02:47.355473 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 900/1822] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:47 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:02:48.366837 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f0d0f6e9-930d-4d02-8b7a-2c44c91ba762 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:48.368809 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f0d0f6e9-930d-4d02-8b7a-2c44c91ba762 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:48.370164 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c19d5764-9fb8-47ce-99df-b83b74b3df85 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:48.371059 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c19d5764-9fb8-47ce-99df-b83b74b3df85 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:48.375382 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f0d0f6e9-930d-4d02-8b7a-2c44c91ba762 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:48.375823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f0d0f6e9-930d-4d02-8b7a-2c44c91ba762 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:48.376739 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f0d0f6e9-930d-4d02-8b7a-2c44c91ba762 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:48.377029 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f0d0f6e9-930d-4d02-8b7a-2c44c91ba762 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:48.377374 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c19d5764-9fb8-47ce-99df-b83b74b3df85 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:48.377828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c19d5764-9fb8-47ce-99df-b83b74b3df85 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:48.378593 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c19d5764-9fb8-47ce-99df-b83b74b3df85 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:48.379021 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c19d5764-9fb8-47ce-99df-b83b74b3df85 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:48.407558 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f0d0f6e9-930d-4d02-8b7a-2c44c91ba762 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047475 Apr 05 12:02:48.408318 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 923/1823] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:48 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:48.412924 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c19d5764-9fb8-47ce-99df-b83b74b3df85 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049151 Apr 05 12:02:48.413596 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 901/1824] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:48 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:49.419597 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-86376707-bf82-45bd-acb0-b795b2745556 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:49.420436 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-86376707-bf82-45bd-acb0-b795b2745556 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:49.424526 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-02b68146-8287-46a9-93d1-a5a722e650d4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:49.425413 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-02b68146-8287-46a9-93d1-a5a722e650d4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:49.428300 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-86376707-bf82-45bd-acb0-b795b2745556 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:49.428966 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-86376707-bf82-45bd-acb0-b795b2745556 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:49.429809 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-86376707-bf82-45bd-acb0-b795b2745556 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:49.430288 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-86376707-bf82-45bd-acb0-b795b2745556 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:49.432060 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02b68146-8287-46a9-93d1-a5a722e650d4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:49.432535 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02b68146-8287-46a9-93d1-a5a722e650d4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:49.433298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02b68146-8287-46a9-93d1-a5a722e650d4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:49.433747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02b68146-8287-46a9-93d1-a5a722e650d4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:49.460368 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-86376707-bf82-45bd-acb0-b795b2745556 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044840 Apr 05 12:02:49.463996 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-02b68146-8287-46a9-93d1-a5a722e650d4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043279 Apr 05 12:02:49.464599 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 902/1825] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:49 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:49.464728 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 924/1826] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:49 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:50.475145 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c948e3a2-876b-4c6f-be69-569118432324 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:50.476306 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c948e3a2-876b-4c6f-be69-569118432324 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:50.477994 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a9232534-21a2-4671-85b3-e3a629e3c7f4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:50.479073 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a9232534-21a2-4671-85b3-e3a629e3c7f4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:50.483369 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c948e3a2-876b-4c6f-be69-569118432324 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:50.483792 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c948e3a2-876b-4c6f-be69-569118432324 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:50.484597 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c948e3a2-876b-4c6f-be69-569118432324 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:50.485028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c948e3a2-876b-4c6f-be69-569118432324 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:50.485405 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a9232534-21a2-4671-85b3-e3a629e3c7f4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:50.485881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a9232534-21a2-4671-85b3-e3a629e3c7f4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:50.486626 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a9232534-21a2-4671-85b3-e3a629e3c7f4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:50.487633 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a9232534-21a2-4671-85b3-e3a629e3c7f4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:50.514633 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c948e3a2-876b-4c6f-be69-569118432324 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044989 Apr 05 12:02:50.515463 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 903/1827] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:50 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:50.518867 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a9232534-21a2-4671-85b3-e3a629e3c7f4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045745 Apr 05 12:02:50.519448 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 925/1828] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:50 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:51.528607 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d63ab6ed-118c-4db1-8772-ccdd04e25a01 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:51.529797 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d63ab6ed-118c-4db1-8772-ccdd04e25a01 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:51.532450 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-16d26a91-5736-4a59-b758-fd2d715901b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:51.533676 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-16d26a91-5736-4a59-b758-fd2d715901b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:51.538365 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d63ab6ed-118c-4db1-8772-ccdd04e25a01 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:51.538963 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d63ab6ed-118c-4db1-8772-ccdd04e25a01 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:51.539981 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d63ab6ed-118c-4db1-8772-ccdd04e25a01 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:51.540613 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d63ab6ed-118c-4db1-8772-ccdd04e25a01 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:51.542381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-16d26a91-5736-4a59-b758-fd2d715901b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:51.542829 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-16d26a91-5736-4a59-b758-fd2d715901b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:51.543585 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-16d26a91-5736-4a59-b758-fd2d715901b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:51.543979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-16d26a91-5736-4a59-b758-fd2d715901b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:51.571819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d63ab6ed-118c-4db1-8772-ccdd04e25a01 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048551 Apr 05 12:02:51.572661 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 904/1829] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:51 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:51.574034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-16d26a91-5736-4a59-b758-fd2d715901b0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046830 Apr 05 12:02:51.578028 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 926/1830] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:51 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:52.588134 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-707cf990-77e5-49b1-9e1b-2af2826146d1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:52.589689 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-707cf990-77e5-49b1-9e1b-2af2826146d1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:52.590017 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a3e2fddd-700d-43ce-970c-147350eadb5b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:52.590980 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a3e2fddd-700d-43ce-970c-147350eadb5b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:52.596027 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-707cf990-77e5-49b1-9e1b-2af2826146d1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:52.596512 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-707cf990-77e5-49b1-9e1b-2af2826146d1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:52.597280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-707cf990-77e5-49b1-9e1b-2af2826146d1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:52.597425 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a3e2fddd-700d-43ce-970c-147350eadb5b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:52.597718 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-707cf990-77e5-49b1-9e1b-2af2826146d1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:52.597889 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a3e2fddd-700d-43ce-970c-147350eadb5b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:52.598633 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a3e2fddd-700d-43ce-970c-147350eadb5b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:52.599056 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a3e2fddd-700d-43ce-970c-147350eadb5b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:52.629826 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a3e2fddd-700d-43ce-970c-147350eadb5b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046527 Apr 05 12:02:52.633927 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-707cf990-77e5-49b1-9e1b-2af2826146d1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048948 Apr 05 12:02:52.634092 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 927/1831] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:52 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:52.634203 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 905/1832] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:52 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:53.646499 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f8c92173-d32b-4e50-9334-dcfcd77e9d15 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:53.647421 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2c5470ab-0db9-43aa-8fcd-2c90c281e3af tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:53.648021 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f8c92173-d32b-4e50-9334-dcfcd77e9d15 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:53.648411 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2c5470ab-0db9-43aa-8fcd-2c90c281e3af tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:53.658383 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2c5470ab-0db9-43aa-8fcd-2c90c281e3af tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:53.658688 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f8c92173-d32b-4e50-9334-dcfcd77e9d15 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:53.659107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f8c92173-d32b-4e50-9334-dcfcd77e9d15 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:53.659288 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2c5470ab-0db9-43aa-8fcd-2c90c281e3af tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:53.660447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f8c92173-d32b-4e50-9334-dcfcd77e9d15 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:53.661524 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2c5470ab-0db9-43aa-8fcd-2c90c281e3af tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:53.661524 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2c5470ab-0db9-43aa-8fcd-2c90c281e3af tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:53.661783 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f8c92173-d32b-4e50-9334-dcfcd77e9d15 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:53.694455 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f8c92173-d32b-4e50-9334-dcfcd77e9d15 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054717 Apr 05 12:02:53.695378 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 928/1833] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:53 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:02:53.695494 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2c5470ab-0db9-43aa-8fcd-2c90c281e3af tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055403 Apr 05 12:02:53.696123 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 906/1834] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:53 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:54.706678 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-134f9ba4-bef1-4234-89f0-a442e700570e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:54.707323 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e58504cb-cffc-4fb8-8fc4-864fbf007a92 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:54.707751 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-134f9ba4-bef1-4234-89f0-a442e700570e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:54.708331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e58504cb-cffc-4fb8-8fc4-864fbf007a92 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:54.714794 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-134f9ba4-bef1-4234-89f0-a442e700570e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:54.714963 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e58504cb-cffc-4fb8-8fc4-864fbf007a92 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:54.716729 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e58504cb-cffc-4fb8-8fc4-864fbf007a92 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:54.716729 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e58504cb-cffc-4fb8-8fc4-864fbf007a92 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:54.716729 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e58504cb-cffc-4fb8-8fc4-864fbf007a92 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:54.717735 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-134f9ba4-bef1-4234-89f0-a442e700570e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:54.719399 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-134f9ba4-bef1-4234-89f0-a442e700570e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:54.719991 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-134f9ba4-bef1-4234-89f0-a442e700570e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:54.747231 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e58504cb-cffc-4fb8-8fc4-864fbf007a92 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044129 Apr 05 12:02:54.751641 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 907/1835] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:54 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:54.755698 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-134f9ba4-bef1-4234-89f0-a442e700570e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053212 Apr 05 12:02:54.756317 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 929/1836] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:54 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:55.763533 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-17c50fc9-2486-42c1-a757-806e81d179a8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:55.765016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-17c50fc9-2486-42c1-a757-806e81d179a8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:55.769223 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-710787dd-71c2-4029-a8ac-09dff2475118 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:55.770171 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-710787dd-71c2-4029-a8ac-09dff2475118 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:55.772264 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-17c50fc9-2486-42c1-a757-806e81d179a8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:55.772709 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-17c50fc9-2486-42c1-a757-806e81d179a8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:55.773519 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-17c50fc9-2486-42c1-a757-806e81d179a8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:55.773946 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-17c50fc9-2486-42c1-a757-806e81d179a8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:55.776623 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-710787dd-71c2-4029-a8ac-09dff2475118 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:55.777082 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-710787dd-71c2-4029-a8ac-09dff2475118 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:55.777866 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-710787dd-71c2-4029-a8ac-09dff2475118 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:55.778265 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-710787dd-71c2-4029-a8ac-09dff2475118 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:55.803374 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-17c50fc9-2486-42c1-a757-806e81d179a8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046764 Apr 05 12:02:55.807395 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 908/1837] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:55 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:55.807574 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-710787dd-71c2-4029-a8ac-09dff2475118 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043123 Apr 05 12:02:55.811202 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 930/1838] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:55 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:56.817483 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-63302dba-f28c-461f-959e-7e06e0e07ccd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:56.818460 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-63302dba-f28c-461f-959e-7e06e0e07ccd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:56.819761 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2ba80de5-762d-4e57-989b-ed0b374c811e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:56.820816 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2ba80de5-762d-4e57-989b-ed0b374c811e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:56.825831 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63302dba-f28c-461f-959e-7e06e0e07ccd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:56.827920 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63302dba-f28c-461f-959e-7e06e0e07ccd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:56.827920 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63302dba-f28c-461f-959e-7e06e0e07ccd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:56.827920 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63302dba-f28c-461f-959e-7e06e0e07ccd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:56.828434 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2ba80de5-762d-4e57-989b-ed0b374c811e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:56.828434 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2ba80de5-762d-4e57-989b-ed0b374c811e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:56.829025 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2ba80de5-762d-4e57-989b-ed0b374c811e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:56.829487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2ba80de5-762d-4e57-989b-ed0b374c811e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:56.859427 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-63302dba-f28c-461f-959e-7e06e0e07ccd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047108 Apr 05 12:02:56.860183 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 909/1839] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:56 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:56.861613 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2ba80de5-762d-4e57-989b-ed0b374c811e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046263 Apr 05 12:02:56.862185 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 931/1840] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:56 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:57.081762 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:02:57.081920 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Tue Apr 5 12:02:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:02:57.871805 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-696d6390-9006-4979-8c71-4f81e983ec01 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:57.872694 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-696d6390-9006-4979-8c71-4f81e983ec01 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:57.873393 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-46a45560-b3d3-45d8-b3b5-495adcb564fc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:57.874315 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-46a45560-b3d3-45d8-b3b5-495adcb564fc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:57.879374 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-696d6390-9006-4979-8c71-4f81e983ec01 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:57.879806 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-696d6390-9006-4979-8c71-4f81e983ec01 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:57.880624 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-696d6390-9006-4979-8c71-4f81e983ec01 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:57.880943 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-46a45560-b3d3-45d8-b3b5-495adcb564fc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:57.881116 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-696d6390-9006-4979-8c71-4f81e983ec01 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:57.881389 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-46a45560-b3d3-45d8-b3b5-495adcb564fc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:57.882129 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-46a45560-b3d3-45d8-b3b5-495adcb564fc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:57.882552 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-46a45560-b3d3-45d8-b3b5-495adcb564fc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:57.911177 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-696d6390-9006-4979-8c71-4f81e983ec01 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043723 Apr 05 12:02:57.911939 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 910/1841] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:57 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:57.912107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-46a45560-b3d3-45d8-b3b5-495adcb564fc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042408 Apr 05 12:02:57.915807 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 932/1842] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:57 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:58.926257 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-56d7799d-29b9-4371-81fd-4e832f76496b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:58.926843 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-eda45dcd-26c6-4f7f-9b4a-8790cfe8cde0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:58.927254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-eda45dcd-26c6-4f7f-9b4a-8790cfe8cde0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:58.927362 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-56d7799d-29b9-4371-81fd-4e832f76496b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:58.934479 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56d7799d-29b9-4371-81fd-4e832f76496b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:58.934693 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eda45dcd-26c6-4f7f-9b4a-8790cfe8cde0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:58.934976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56d7799d-29b9-4371-81fd-4e832f76496b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:58.935155 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eda45dcd-26c6-4f7f-9b4a-8790cfe8cde0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:58.935828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56d7799d-29b9-4371-81fd-4e832f76496b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:58.935995 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eda45dcd-26c6-4f7f-9b4a-8790cfe8cde0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:58.936352 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eda45dcd-26c6-4f7f-9b4a-8790cfe8cde0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:58.936531 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56d7799d-29b9-4371-81fd-4e832f76496b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:02:58.968809 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-eda45dcd-26c6-4f7f-9b4a-8790cfe8cde0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047688 Apr 05 12:02:58.969440 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 933/1843] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:58 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:02:58.969674 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-56d7799d-29b9-4371-81fd-4e832f76496b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048868 Apr 05 12:02:58.970476 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 911/1844] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:58 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:02:59.985006 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-21ee62cc-bff1-40bf-9454-4eb7b583f4a9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:59.986026 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5e9d26c4-c4a1-4852-a6e2-96f179f4e29a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:02:59.986630 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-21ee62cc-bff1-40bf-9454-4eb7b583f4a9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:59.987415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5e9d26c4-c4a1-4852-a6e2-96f179f4e29a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:02:59.998021 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-21ee62cc-bff1-40bf-9454-4eb7b583f4a9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:02:59.998620 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-21ee62cc-bff1-40bf-9454-4eb7b583f4a9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:00.000360 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-21ee62cc-bff1-40bf-9454-4eb7b583f4a9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:00.000830 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5e9d26c4-c4a1-4852-a6e2-96f179f4e29a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:00.001061 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-21ee62cc-bff1-40bf-9454-4eb7b583f4a9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:00.002042 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5e9d26c4-c4a1-4852-a6e2-96f179f4e29a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:00.002686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5e9d26c4-c4a1-4852-a6e2-96f179f4e29a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:00.003123 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5e9d26c4-c4a1-4852-a6e2-96f179f4e29a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:00.031948 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-21ee62cc-bff1-40bf-9454-4eb7b583f4a9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053718 Apr 05 12:03:00.032754 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5e9d26c4-c4a1-4852-a6e2-96f179f4e29a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053538 Apr 05 12:03:00.033640 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 912/1845] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:59 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:00.036181 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 934/1846] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:02:59 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:01.042885 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-73a6ca0d-4f07-4476-8333-3bf18dd99b6a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:01.043824 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-73a6ca0d-4f07-4476-8333-3bf18dd99b6a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:01.044972 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-981884da-d492-48e4-afd7-fc275fe8812a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:03:01.045884 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-981884da-d492-48e4-afd7-fc275fe8812a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:01.051276 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-73a6ca0d-4f07-4476-8333-3bf18dd99b6a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:01.051760 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-73a6ca0d-4f07-4476-8333-3bf18dd99b6a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:01.052536 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-73a6ca0d-4f07-4476-8333-3bf18dd99b6a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:01.052943 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-981884da-d492-48e4-afd7-fc275fe8812a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:01.053085 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-73a6ca0d-4f07-4476-8333-3bf18dd99b6a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:01.053710 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-981884da-d492-48e4-afd7-fc275fe8812a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:01.054476 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-981884da-d492-48e4-afd7-fc275fe8812a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:01.054906 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-981884da-d492-48e4-afd7-fc275fe8812a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:01.084420 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-73a6ca0d-4f07-4476-8333-3bf18dd99b6a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045288 Apr 05 12:03:01.085303 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 913/1847] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:01 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:01.340066 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-981884da-d492-48e4-afd7-fc275fe8812a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "POST /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/action" status: 200 len: 76957 microversion: 2.1 time: 0.298728 Apr 05 12:03:01.340730 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 935/1848] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Apr 5 12:03:01 2022] POST /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d/action => generated 76957 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:03:02.100472 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5255e9e0-7491-44f3-b303-f5bc65649042 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:02.101954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5255e9e0-7491-44f3-b303-f5bc65649042 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:02.112478 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5255e9e0-7491-44f3-b303-f5bc65649042 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:02.113229 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5255e9e0-7491-44f3-b303-f5bc65649042 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:02.114464 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5255e9e0-7491-44f3-b303-f5bc65649042 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:02.115198 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5255e9e0-7491-44f3-b303-f5bc65649042 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:02.148892 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5255e9e0-7491-44f3-b303-f5bc65649042 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055202 Apr 05 12:03:02.149643 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 914/1849] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:02 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:03.165791 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e0d87f44-7299-4884-bbf1-5a47fc9b36bb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:03.167487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e0d87f44-7299-4884-bbf1-5a47fc9b36bb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:03.176995 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0d87f44-7299-4884-bbf1-5a47fc9b36bb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:03.177411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0d87f44-7299-4884-bbf1-5a47fc9b36bb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:03.178163 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0d87f44-7299-4884-bbf1-5a47fc9b36bb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:03.178592 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0d87f44-7299-4884-bbf1-5a47fc9b36bb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:03.209076 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e0d87f44-7299-4884-bbf1-5a47fc9b36bb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050676 Apr 05 12:03:03.209634 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 936/1850] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:03 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:04.225017 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bc77b8b4-dcb0-402e-83b7-fee50b642e5f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:04.226546 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bc77b8b4-dcb0-402e-83b7-fee50b642e5f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:04.236841 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bc77b8b4-dcb0-402e-83b7-fee50b642e5f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:04.237282 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bc77b8b4-dcb0-402e-83b7-fee50b642e5f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:04.238037 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bc77b8b4-dcb0-402e-83b7-fee50b642e5f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:04.238548 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bc77b8b4-dcb0-402e-83b7-fee50b642e5f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:04.267916 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bc77b8b4-dcb0-402e-83b7-fee50b642e5f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049419 Apr 05 12:03:04.268505 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 915/1851] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:04 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:04.268756 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:03:04.269205 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Tue Apr 5 12:03:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:03:05.280127 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a6797e8f-4492-430e-9beb-836d7579fb04 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:05.281155 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a6797e8f-4492-430e-9beb-836d7579fb04 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:05.287928 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a6797e8f-4492-430e-9beb-836d7579fb04 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:05.288415 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a6797e8f-4492-430e-9beb-836d7579fb04 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:05.289261 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a6797e8f-4492-430e-9beb-836d7579fb04 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:05.289699 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a6797e8f-4492-430e-9beb-836d7579fb04 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:05.319922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a6797e8f-4492-430e-9beb-836d7579fb04 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043838 Apr 05 12:03:05.320513 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 937/1852] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:05 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:06.336050 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-80a0f851-1357-47be-a4ba-d535ad64b083 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:06.337565 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-80a0f851-1357-47be-a4ba-d535ad64b083 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:06.348064 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-80a0f851-1357-47be-a4ba-d535ad64b083 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:06.348875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-80a0f851-1357-47be-a4ba-d535ad64b083 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:06.350133 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-80a0f851-1357-47be-a4ba-d535ad64b083 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:06.350866 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-80a0f851-1357-47be-a4ba-d535ad64b083 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:06.384455 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-80a0f851-1357-47be-a4ba-d535ad64b083 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055191 Apr 05 12:03:06.385020 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 916/1853] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:06 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:07.400300 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ef22fdf0-129a-4844-ae28-92c1b569babe tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:07.401772 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ef22fdf0-129a-4844-ae28-92c1b569babe tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:07.411061 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ef22fdf0-129a-4844-ae28-92c1b569babe tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:07.411511 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ef22fdf0-129a-4844-ae28-92c1b569babe tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:07.412310 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ef22fdf0-129a-4844-ae28-92c1b569babe tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:07.412745 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ef22fdf0-129a-4844-ae28-92c1b569babe tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:07.443396 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ef22fdf0-129a-4844-ae28-92c1b569babe tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049249 Apr 05 12:03:07.443788 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 938/1854] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:07 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:08.457848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b04dcf43-9567-4afa-b4d4-4852b95c8c07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:08.458742 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b04dcf43-9567-4afa-b4d4-4852b95c8c07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:08.465309 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b04dcf43-9567-4afa-b4d4-4852b95c8c07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:08.465775 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b04dcf43-9567-4afa-b4d4-4852b95c8c07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:08.466531 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b04dcf43-9567-4afa-b4d4-4852b95c8c07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:08.466951 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b04dcf43-9567-4afa-b4d4-4852b95c8c07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:08.496800 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b04dcf43-9567-4afa-b4d4-4852b95c8c07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044308 Apr 05 12:03:08.497380 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 917/1855] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:08 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:09.513031 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-345d8739-cc4b-478b-9859-9acaf58e01df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:09.514853 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-345d8739-cc4b-478b-9859-9acaf58e01df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:09.522898 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-345d8739-cc4b-478b-9859-9acaf58e01df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:09.523334 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-345d8739-cc4b-478b-9859-9acaf58e01df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:09.524103 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-345d8739-cc4b-478b-9859-9acaf58e01df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:09.524591 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-345d8739-cc4b-478b-9859-9acaf58e01df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:09.553081 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-345d8739-cc4b-478b-9859-9acaf58e01df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047007 Apr 05 12:03:09.553648 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 939/1856] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:09 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:10.569576 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ede749ad-f775-4f7b-a2f8-4b905ab3a71d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:10.571335 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ede749ad-f775-4f7b-a2f8-4b905ab3a71d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:10.581359 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ede749ad-f775-4f7b-a2f8-4b905ab3a71d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:10.581811 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ede749ad-f775-4f7b-a2f8-4b905ab3a71d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:10.582591 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ede749ad-f775-4f7b-a2f8-4b905ab3a71d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:10.583018 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ede749ad-f775-4f7b-a2f8-4b905ab3a71d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:10.611739 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ede749ad-f775-4f7b-a2f8-4b905ab3a71d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049093 Apr 05 12:03:10.612412 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 918/1857] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:10 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:11.627819 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ab9fd8e7-b5e0-4147-bf71-dc2c17b4421e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:11.629399 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ab9fd8e7-b5e0-4147-bf71-dc2c17b4421e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:11.636125 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ab9fd8e7-b5e0-4147-bf71-dc2c17b4421e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:11.636642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ab9fd8e7-b5e0-4147-bf71-dc2c17b4421e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:11.637523 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ab9fd8e7-b5e0-4147-bf71-dc2c17b4421e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:11.638007 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ab9fd8e7-b5e0-4147-bf71-dc2c17b4421e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:11.668938 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ab9fd8e7-b5e0-4147-bf71-dc2c17b4421e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047680 Apr 05 12:03:11.669493 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 940/1858] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:11 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:12.685403 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d45ff3fe-a29c-45cd-968c-9a73944a6f4e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:12.686794 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d45ff3fe-a29c-45cd-968c-9a73944a6f4e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:12.697303 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d45ff3fe-a29c-45cd-968c-9a73944a6f4e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:12.698054 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d45ff3fe-a29c-45cd-968c-9a73944a6f4e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:12.699330 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d45ff3fe-a29c-45cd-968c-9a73944a6f4e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:12.700170 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d45ff3fe-a29c-45cd-968c-9a73944a6f4e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:12.731409 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d45ff3fe-a29c-45cd-968c-9a73944a6f4e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052840 Apr 05 12:03:12.731972 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 919/1859] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:12 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:13.747862 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-514d573e-ccd6-42cb-a1b8-b2a0125290d6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:13.748696 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-514d573e-ccd6-42cb-a1b8-b2a0125290d6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:13.755711 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-514d573e-ccd6-42cb-a1b8-b2a0125290d6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:13.756190 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-514d573e-ccd6-42cb-a1b8-b2a0125290d6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:13.756973 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-514d573e-ccd6-42cb-a1b8-b2a0125290d6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:13.757428 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-514d573e-ccd6-42cb-a1b8-b2a0125290d6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:13.789628 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-514d573e-ccd6-42cb-a1b8-b2a0125290d6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049100 Apr 05 12:03:13.790194 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 941/1860] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:13 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:14.805479 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b870d0e7-d594-4c5c-addf-893278a720eb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:14.806960 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b870d0e7-d594-4c5c-addf-893278a720eb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:14.816808 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b870d0e7-d594-4c5c-addf-893278a720eb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:14.817255 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b870d0e7-d594-4c5c-addf-893278a720eb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:14.818031 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b870d0e7-d594-4c5c-addf-893278a720eb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:14.818466 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b870d0e7-d594-4c5c-addf-893278a720eb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:14.847601 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b870d0e7-d594-4c5c-addf-893278a720eb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048853 Apr 05 12:03:14.848199 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 920/1861] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:14 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:15.861243 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5c8bdc85-e01f-4c31-b191-85877eaea787 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:15.862490 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5c8bdc85-e01f-4c31-b191-85877eaea787 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:15.868850 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5c8bdc85-e01f-4c31-b191-85877eaea787 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:15.869611 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5c8bdc85-e01f-4c31-b191-85877eaea787 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:15.870369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5c8bdc85-e01f-4c31-b191-85877eaea787 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:15.870797 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5c8bdc85-e01f-4c31-b191-85877eaea787 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:15.899880 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5c8bdc85-e01f-4c31-b191-85877eaea787 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043494 Apr 05 12:03:15.900474 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 942/1862] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:15 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:16.916686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-be4a6ea2-f901-470f-a374-78717163b2fe tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:16.917643 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-be4a6ea2-f901-470f-a374-78717163b2fe tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:16.928526 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-be4a6ea2-f901-470f-a374-78717163b2fe tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:16.929267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-be4a6ea2-f901-470f-a374-78717163b2fe tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:16.930574 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-be4a6ea2-f901-470f-a374-78717163b2fe tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:16.931330 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-be4a6ea2-f901-470f-a374-78717163b2fe tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:16.964962 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-be4a6ea2-f901-470f-a374-78717163b2fe tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055678 Apr 05 12:03:16.965639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 921/1863] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:16 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:17.981260 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-eb21b1fc-4017-4edd-87b2-19d63c1af75a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:17.982777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-eb21b1fc-4017-4edd-87b2-19d63c1af75a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:17.991336 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eb21b1fc-4017-4edd-87b2-19d63c1af75a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:17.991716 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eb21b1fc-4017-4edd-87b2-19d63c1af75a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:17.992538 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eb21b1fc-4017-4edd-87b2-19d63c1af75a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:17.992952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eb21b1fc-4017-4edd-87b2-19d63c1af75a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:18.022105 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-eb21b1fc-4017-4edd-87b2-19d63c1af75a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047421 Apr 05 12:03:18.022656 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 943/1864] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:17 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:19.038255 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2dd49890-9671-43d2-8ce9-9cc00007d936 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:19.039668 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2dd49890-9671-43d2-8ce9-9cc00007d936 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:19.050593 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2dd49890-9671-43d2-8ce9-9cc00007d936 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:19.051336 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2dd49890-9671-43d2-8ce9-9cc00007d936 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:19.053098 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2dd49890-9671-43d2-8ce9-9cc00007d936 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:19.054010 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2dd49890-9671-43d2-8ce9-9cc00007d936 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:19.088259 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2dd49890-9671-43d2-8ce9-9cc00007d936 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056768 Apr 05 12:03:19.089422 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 922/1865] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:19 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:20.104707 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-873d8c8e-8e66-44e0-bde4-9c928b2e4d1d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:20.106353 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-873d8c8e-8e66-44e0-bde4-9c928b2e4d1d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:20.116712 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-873d8c8e-8e66-44e0-bde4-9c928b2e4d1d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:20.117154 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-873d8c8e-8e66-44e0-bde4-9c928b2e4d1d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:20.117918 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-873d8c8e-8e66-44e0-bde4-9c928b2e4d1d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:20.118350 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-873d8c8e-8e66-44e0-bde4-9c928b2e4d1d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:20.147484 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-873d8c8e-8e66-44e0-bde4-9c928b2e4d1d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049404 Apr 05 12:03:20.148288 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 944/1866] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:20 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:21.163868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fd643df4-26d8-43da-b1ed-8b3978c6c8f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:21.165293 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fd643df4-26d8-43da-b1ed-8b3978c6c8f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:21.171569 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd643df4-26d8-43da-b1ed-8b3978c6c8f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:21.172020 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd643df4-26d8-43da-b1ed-8b3978c6c8f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:21.172810 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd643df4-26d8-43da-b1ed-8b3978c6c8f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:21.173243 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd643df4-26d8-43da-b1ed-8b3978c6c8f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:21.202018 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fd643df4-26d8-43da-b1ed-8b3978c6c8f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045160 Apr 05 12:03:21.202614 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 923/1867] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:21 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:22.218204 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d1660861-3869-4827-88cf-ee9945285bf7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:22.219956 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d1660861-3869-4827-88cf-ee9945285bf7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:22.230439 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d1660861-3869-4827-88cf-ee9945285bf7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:22.231180 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d1660861-3869-4827-88cf-ee9945285bf7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:22.232499 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d1660861-3869-4827-88cf-ee9945285bf7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:22.233214 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d1660861-3869-4827-88cf-ee9945285bf7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:22.266337 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d1660861-3869-4827-88cf-ee9945285bf7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054994 Apr 05 12:03:22.266927 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 945/1868] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:22 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:23.282438 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5e301e43-4389-483b-ace0-764a78d9e321 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:23.284449 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5e301e43-4389-483b-ace0-764a78d9e321 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:23.293865 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5e301e43-4389-483b-ace0-764a78d9e321 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:23.294389 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5e301e43-4389-483b-ace0-764a78d9e321 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:23.295220 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5e301e43-4389-483b-ace0-764a78d9e321 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:23.295650 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5e301e43-4389-483b-ace0-764a78d9e321 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:23.325367 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5e301e43-4389-483b-ace0-764a78d9e321 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049673 Apr 05 12:03:23.325963 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 924/1869] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:23 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:24.341533 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4544ff9f-954a-41bd-9f0d-0844bb4f0a8e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:24.342915 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4544ff9f-954a-41bd-9f0d-0844bb4f0a8e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:24.349972 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4544ff9f-954a-41bd-9f0d-0844bb4f0a8e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:24.350420 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4544ff9f-954a-41bd-9f0d-0844bb4f0a8e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:24.352116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4544ff9f-954a-41bd-9f0d-0844bb4f0a8e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:24.352116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4544ff9f-954a-41bd-9f0d-0844bb4f0a8e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:24.383477 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4544ff9f-954a-41bd-9f0d-0844bb4f0a8e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048723 Apr 05 12:03:24.384396 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 946/1870] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:24 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:25.395617 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-21207a31-4aa6-462d-b8cf-a2c756fd01cd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:25.396646 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-21207a31-4aa6-462d-b8cf-a2c756fd01cd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:25.402728 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-21207a31-4aa6-462d-b8cf-a2c756fd01cd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:25.403178 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-21207a31-4aa6-462d-b8cf-a2c756fd01cd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:25.403941 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-21207a31-4aa6-462d-b8cf-a2c756fd01cd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:25.404619 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-21207a31-4aa6-462d-b8cf-a2c756fd01cd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:25.436218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-21207a31-4aa6-462d-b8cf-a2c756fd01cd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045025 Apr 05 12:03:25.440335 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 925/1871] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:25 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:26.451118 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-94fe4f2b-5bba-4e5c-8c2e-b0b81080da47 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:26.452794 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-94fe4f2b-5bba-4e5c-8c2e-b0b81080da47 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:26.459438 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94fe4f2b-5bba-4e5c-8c2e-b0b81080da47 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:26.459907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94fe4f2b-5bba-4e5c-8c2e-b0b81080da47 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:26.460688 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94fe4f2b-5bba-4e5c-8c2e-b0b81080da47 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:26.461115 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94fe4f2b-5bba-4e5c-8c2e-b0b81080da47 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:26.490134 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-94fe4f2b-5bba-4e5c-8c2e-b0b81080da47 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045627 Apr 05 12:03:26.491009 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 947/1872] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:26 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:27.503322 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f8fd14c8-599d-416c-b469-11d9a4e91f25 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:27.504297 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f8fd14c8-599d-416c-b469-11d9a4e91f25 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:27.512675 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f8fd14c8-599d-416c-b469-11d9a4e91f25 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:27.512675 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f8fd14c8-599d-416c-b469-11d9a4e91f25 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:27.512675 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f8fd14c8-599d-416c-b469-11d9a4e91f25 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:27.512992 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f8fd14c8-599d-416c-b469-11d9a4e91f25 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:27.543013 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f8fd14c8-599d-416c-b469-11d9a4e91f25 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043833 Apr 05 12:03:27.543566 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 926/1873] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:27 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:28.559032 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-03c02d6d-021f-43ab-a6a2-eba960ea0f6c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:28.560549 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-03c02d6d-021f-43ab-a6a2-eba960ea0f6c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:28.571198 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-03c02d6d-021f-43ab-a6a2-eba960ea0f6c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:28.571953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-03c02d6d-021f-43ab-a6a2-eba960ea0f6c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:28.573236 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-03c02d6d-021f-43ab-a6a2-eba960ea0f6c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:28.573993 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-03c02d6d-021f-43ab-a6a2-eba960ea0f6c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:28.605577 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-03c02d6d-021f-43ab-a6a2-eba960ea0f6c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053207 Apr 05 12:03:28.606345 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 948/1874] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:28 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:29.621811 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6269949f-e380-4c2a-8aee-66e8dd487767 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:29.623295 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6269949f-e380-4c2a-8aee-66e8dd487767 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:29.631615 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6269949f-e380-4c2a-8aee-66e8dd487767 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:29.632175 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6269949f-e380-4c2a-8aee-66e8dd487767 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:29.632963 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6269949f-e380-4c2a-8aee-66e8dd487767 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:29.633375 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6269949f-e380-4c2a-8aee-66e8dd487767 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:29.662624 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6269949f-e380-4c2a-8aee-66e8dd487767 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047891 Apr 05 12:03:29.663340 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 927/1875] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:29 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:30.679016 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f84dbfad-7a85-48f8-aa31-6845796b686a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:30.680596 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f84dbfad-7a85-48f8-aa31-6845796b686a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:30.690728 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f84dbfad-7a85-48f8-aa31-6845796b686a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:30.691162 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f84dbfad-7a85-48f8-aa31-6845796b686a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:30.691951 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f84dbfad-7a85-48f8-aa31-6845796b686a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:30.692565 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f84dbfad-7a85-48f8-aa31-6845796b686a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:30.722308 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f84dbfad-7a85-48f8-aa31-6845796b686a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049855 Apr 05 12:03:30.723118 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 949/1876] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:30 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:31.738168 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7ef89732-f7d0-4282-b7a2-d5e7e67a782a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:31.739144 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7ef89732-f7d0-4282-b7a2-d5e7e67a782a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:31.746582 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7ef89732-f7d0-4282-b7a2-d5e7e67a782a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:31.747005 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7ef89732-f7d0-4282-b7a2-d5e7e67a782a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:31.747820 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7ef89732-f7d0-4282-b7a2-d5e7e67a782a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:31.748313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7ef89732-f7d0-4282-b7a2-d5e7e67a782a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:31.778717 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7ef89732-f7d0-4282-b7a2-d5e7e67a782a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047077 Apr 05 12:03:31.779288 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 928/1877] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:31 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:32.795130 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-92f66eda-4cbd-4bc1-9675-702c72f31b1a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:32.796647 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-92f66eda-4cbd-4bc1-9675-702c72f31b1a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:32.807806 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92f66eda-4cbd-4bc1-9675-702c72f31b1a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:32.808268 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92f66eda-4cbd-4bc1-9675-702c72f31b1a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:32.809535 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92f66eda-4cbd-4bc1-9675-702c72f31b1a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:32.810264 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92f66eda-4cbd-4bc1-9675-702c72f31b1a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:32.841432 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-92f66eda-4cbd-4bc1-9675-702c72f31b1a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053088 Apr 05 12:03:32.841992 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 950/1878] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:32 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:33.853231 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c74baa81-7da2-4732-991a-08504502f743 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:33.854237 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c74baa81-7da2-4732-991a-08504502f743 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:33.863684 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c74baa81-7da2-4732-991a-08504502f743 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:33.864311 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c74baa81-7da2-4732-991a-08504502f743 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:33.865078 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c74baa81-7da2-4732-991a-08504502f743 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:33.865514 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c74baa81-7da2-4732-991a-08504502f743 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:33.904559 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c74baa81-7da2-4732-991a-08504502f743 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055695 Apr 05 12:03:33.905120 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 929/1879] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:33 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:34.918269 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ea94b5d9-cdb4-49e3-9a91-40e082599ca2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:34.919206 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ea94b5d9-cdb4-49e3-9a91-40e082599ca2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:34.925990 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea94b5d9-cdb4-49e3-9a91-40e082599ca2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:34.926445 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea94b5d9-cdb4-49e3-9a91-40e082599ca2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:34.927231 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea94b5d9-cdb4-49e3-9a91-40e082599ca2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:34.927667 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea94b5d9-cdb4-49e3-9a91-40e082599ca2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:34.956325 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ea94b5d9-cdb4-49e3-9a91-40e082599ca2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042260 Apr 05 12:03:34.956865 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 951/1880] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:34 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:35.972405 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0ebef133-02bf-4b7c-8f85-3548de4702c6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:35.973907 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0ebef133-02bf-4b7c-8f85-3548de4702c6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:35.984760 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0ebef133-02bf-4b7c-8f85-3548de4702c6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:35.985516 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0ebef133-02bf-4b7c-8f85-3548de4702c6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:35.986834 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0ebef133-02bf-4b7c-8f85-3548de4702c6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:35.987565 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0ebef133-02bf-4b7c-8f85-3548de4702c6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:36.018930 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0ebef133-02bf-4b7c-8f85-3548de4702c6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053243 Apr 05 12:03:36.019471 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 930/1881] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:35 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:37.034470 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f3e7ea3b-ae6d-4bea-a5e8-98ec0ee02e9c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:37.036019 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f3e7ea3b-ae6d-4bea-a5e8-98ec0ee02e9c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:37.046754 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f3e7ea3b-ae6d-4bea-a5e8-98ec0ee02e9c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:37.047490 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f3e7ea3b-ae6d-4bea-a5e8-98ec0ee02e9c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:37.048789 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f3e7ea3b-ae6d-4bea-a5e8-98ec0ee02e9c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:37.049509 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f3e7ea3b-ae6d-4bea-a5e8-98ec0ee02e9c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:37.082303 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f3e7ea3b-ae6d-4bea-a5e8-98ec0ee02e9c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054845 Apr 05 12:03:37.082942 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 952/1882] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:37 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:38.098748 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-37277271-a13c-4f38-bab1-81d6b48646b1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:38.100297 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-37277271-a13c-4f38-bab1-81d6b48646b1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:38.110884 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37277271-a13c-4f38-bab1-81d6b48646b1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:38.111629 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37277271-a13c-4f38-bab1-81d6b48646b1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:38.112919 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37277271-a13c-4f38-bab1-81d6b48646b1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:38.113635 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37277271-a13c-4f38-bab1-81d6b48646b1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:38.146960 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-37277271-a13c-4f38-bab1-81d6b48646b1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055214 Apr 05 12:03:38.147499 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 931/1883] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:38 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:39.162972 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-dcf80b8f-de17-46e1-a358-0e682dcd91a6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:39.164563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-dcf80b8f-de17-46e1-a358-0e682dcd91a6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:39.174600 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dcf80b8f-de17-46e1-a358-0e682dcd91a6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:39.175333 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dcf80b8f-de17-46e1-a358-0e682dcd91a6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:39.176365 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dcf80b8f-de17-46e1-a358-0e682dcd91a6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:39.176795 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dcf80b8f-de17-46e1-a358-0e682dcd91a6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:39.205376 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-dcf80b8f-de17-46e1-a358-0e682dcd91a6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049355 Apr 05 12:03:39.205931 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 953/1884] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:39 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:40.221202 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0022df58-af79-4c8d-8ddb-c4d1c69d1707 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:40.222684 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0022df58-af79-4c8d-8ddb-c4d1c69d1707 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:40.229744 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0022df58-af79-4c8d-8ddb-c4d1c69d1707 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:40.230219 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0022df58-af79-4c8d-8ddb-c4d1c69d1707 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:40.230985 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0022df58-af79-4c8d-8ddb-c4d1c69d1707 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:40.231418 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0022df58-af79-4c8d-8ddb-c4d1c69d1707 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:40.260777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0022df58-af79-4c8d-8ddb-c4d1c69d1707 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046295 Apr 05 12:03:40.261328 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 932/1885] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:40 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:41.277164 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7aa40d62-52cf-49a6-bde9-5c67ec86a7da tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:41.278636 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7aa40d62-52cf-49a6-bde9-5c67ec86a7da tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:41.289359 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7aa40d62-52cf-49a6-bde9-5c67ec86a7da tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:41.290111 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7aa40d62-52cf-49a6-bde9-5c67ec86a7da tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:41.291332 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7aa40d62-52cf-49a6-bde9-5c67ec86a7da tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:41.292054 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7aa40d62-52cf-49a6-bde9-5c67ec86a7da tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:41.324533 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7aa40d62-52cf-49a6-bde9-5c67ec86a7da tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054219 Apr 05 12:03:41.325066 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 954/1886] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:41 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:42.340221 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cf04adff-6da3-42e9-a0b2-73c10ae156d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:42.341718 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cf04adff-6da3-42e9-a0b2-73c10ae156d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:42.350839 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cf04adff-6da3-42e9-a0b2-73c10ae156d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:42.351281 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cf04adff-6da3-42e9-a0b2-73c10ae156d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:42.352032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cf04adff-6da3-42e9-a0b2-73c10ae156d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:42.352493 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cf04adff-6da3-42e9-a0b2-73c10ae156d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:42.381471 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cf04adff-6da3-42e9-a0b2-73c10ae156d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047883 Apr 05 12:03:42.382009 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 933/1887] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:42 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:43.393738 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c6803c86-ea93-41e3-8eed-bfbcc240b3d5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:43.394655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c6803c86-ea93-41e3-8eed-bfbcc240b3d5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:43.401785 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c6803c86-ea93-41e3-8eed-bfbcc240b3d5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:43.402234 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c6803c86-ea93-41e3-8eed-bfbcc240b3d5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:43.402991 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c6803c86-ea93-41e3-8eed-bfbcc240b3d5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:43.403422 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c6803c86-ea93-41e3-8eed-bfbcc240b3d5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:43.434207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c6803c86-ea93-41e3-8eed-bfbcc240b3d5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044463 Apr 05 12:03:43.434862 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 955/1888] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:43 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:44.446333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a6f62d48-04fe-45ee-845a-764785aa7125 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:44.447311 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a6f62d48-04fe-45ee-845a-764785aa7125 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:44.454105 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a6f62d48-04fe-45ee-845a-764785aa7125 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:44.454555 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a6f62d48-04fe-45ee-845a-764785aa7125 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:44.455358 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a6f62d48-04fe-45ee-845a-764785aa7125 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:44.455786 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a6f62d48-04fe-45ee-845a-764785aa7125 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:44.484750 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a6f62d48-04fe-45ee-845a-764785aa7125 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042495 Apr 05 12:03:44.485308 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 934/1889] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:44 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:45.501176 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c45ce86f-f1e9-4d8d-89c6-7bccbc11a342 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:45.502710 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c45ce86f-f1e9-4d8d-89c6-7bccbc11a342 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:45.510193 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c45ce86f-f1e9-4d8d-89c6-7bccbc11a342 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:45.510647 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c45ce86f-f1e9-4d8d-89c6-7bccbc11a342 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:45.511418 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c45ce86f-f1e9-4d8d-89c6-7bccbc11a342 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:45.511854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c45ce86f-f1e9-4d8d-89c6-7bccbc11a342 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:45.540583 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c45ce86f-f1e9-4d8d-89c6-7bccbc11a342 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046428 Apr 05 12:03:45.541141 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 956/1890] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:45 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:46.554950 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e2d7590e-efcb-4103-950b-c0baa293cc42 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:46.556122 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e2d7590e-efcb-4103-950b-c0baa293cc42 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:46.564059 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e2d7590e-efcb-4103-950b-c0baa293cc42 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:46.564641 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e2d7590e-efcb-4103-950b-c0baa293cc42 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:46.565583 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e2d7590e-efcb-4103-950b-c0baa293cc42 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:46.566115 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e2d7590e-efcb-4103-950b-c0baa293cc42 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:46.598263 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e2d7590e-efcb-4103-950b-c0baa293cc42 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049011 Apr 05 12:03:46.599169 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 935/1891] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:46 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:47.610780 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9c87e721-adea-4e56-8be8-c71297b7caa9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:47.611691 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9c87e721-adea-4e56-8be8-c71297b7caa9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:47.618388 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9c87e721-adea-4e56-8be8-c71297b7caa9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:47.618836 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9c87e721-adea-4e56-8be8-c71297b7caa9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:47.619597 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9c87e721-adea-4e56-8be8-c71297b7caa9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:47.620037 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9c87e721-adea-4e56-8be8-c71297b7caa9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:47.653102 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9c87e721-adea-4e56-8be8-c71297b7caa9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046313 Apr 05 12:03:47.653665 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 957/1892] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:47 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:48.669121 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-867a8121-e6c2-44e6-8bae-220b77641bf7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:48.670588 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-867a8121-e6c2-44e6-8bae-220b77641bf7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:48.681640 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-867a8121-e6c2-44e6-8bae-220b77641bf7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:48.682397 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-867a8121-e6c2-44e6-8bae-220b77641bf7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:48.683652 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-867a8121-e6c2-44e6-8bae-220b77641bf7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:48.684534 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-867a8121-e6c2-44e6-8bae-220b77641bf7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:48.720535 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-867a8121-e6c2-44e6-8bae-220b77641bf7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058015 Apr 05 12:03:48.721107 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 936/1893] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:48 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:49.737277 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-20a5d194-c043-417a-9353-2a4566734e32 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:49.738960 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-20a5d194-c043-417a-9353-2a4566734e32 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:49.746144 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-20a5d194-c043-417a-9353-2a4566734e32 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:49.746970 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-20a5d194-c043-417a-9353-2a4566734e32 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:49.747689 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-20a5d194-c043-417a-9353-2a4566734e32 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:49.748114 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-20a5d194-c043-417a-9353-2a4566734e32 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:49.777111 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-20a5d194-c043-417a-9353-2a4566734e32 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046905 Apr 05 12:03:49.777653 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 958/1894] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:49 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:50.789156 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6f7f3468-55e7-4dec-a6ff-e60d251454e5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:50.789990 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6f7f3468-55e7-4dec-a6ff-e60d251454e5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:50.796505 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6f7f3468-55e7-4dec-a6ff-e60d251454e5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:50.796955 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6f7f3468-55e7-4dec-a6ff-e60d251454e5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:50.797724 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6f7f3468-55e7-4dec-a6ff-e60d251454e5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:50.798159 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6f7f3468-55e7-4dec-a6ff-e60d251454e5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:50.827887 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6f7f3468-55e7-4dec-a6ff-e60d251454e5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042926 Apr 05 12:03:50.828595 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 937/1895] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:50 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:51.840367 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8e1f391e-924d-41c2-9d45-2eb965a7d9d8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:51.841304 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8e1f391e-924d-41c2-9d45-2eb965a7d9d8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:51.847957 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e1f391e-924d-41c2-9d45-2eb965a7d9d8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:51.848431 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e1f391e-924d-41c2-9d45-2eb965a7d9d8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:51.849185 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e1f391e-924d-41c2-9d45-2eb965a7d9d8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:51.849684 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e1f391e-924d-41c2-9d45-2eb965a7d9d8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:51.878492 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8e1f391e-924d-41c2-9d45-2eb965a7d9d8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042211 Apr 05 12:03:51.879033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 959/1896] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:51 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:52.890015 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d18d5c36-8ea3-41a6-8a79-58603d5d7135 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:52.890969 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d18d5c36-8ea3-41a6-8a79-58603d5d7135 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:52.898150 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d18d5c36-8ea3-41a6-8a79-58603d5d7135 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:52.899218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d18d5c36-8ea3-41a6-8a79-58603d5d7135 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:52.899405 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d18d5c36-8ea3-41a6-8a79-58603d5d7135 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:52.899845 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d18d5c36-8ea3-41a6-8a79-58603d5d7135 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:52.929406 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d18d5c36-8ea3-41a6-8a79-58603d5d7135 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043428 Apr 05 12:03:52.930004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 938/1897] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:52 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:53.945965 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-72fb520e-5aea-401e-a261-48488e688a6f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:53.947337 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-72fb520e-5aea-401e-a261-48488e688a6f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:53.958172 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-72fb520e-5aea-401e-a261-48488e688a6f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:53.958924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-72fb520e-5aea-401e-a261-48488e688a6f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:53.960193 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-72fb520e-5aea-401e-a261-48488e688a6f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:53.960936 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-72fb520e-5aea-401e-a261-48488e688a6f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:53.991184 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-72fb520e-5aea-401e-a261-48488e688a6f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052325 Apr 05 12:03:53.991725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 960/1898] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:53 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:55.006729 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3e2cc7c4-a1d6-4caf-b130-c232b200aff1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:55.008153 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3e2cc7c4-a1d6-4caf-b130-c232b200aff1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:55.015586 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e2cc7c4-a1d6-4caf-b130-c232b200aff1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:55.016033 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e2cc7c4-a1d6-4caf-b130-c232b200aff1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:55.016824 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e2cc7c4-a1d6-4caf-b130-c232b200aff1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:55.017262 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e2cc7c4-a1d6-4caf-b130-c232b200aff1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:55.047684 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3e2cc7c4-a1d6-4caf-b130-c232b200aff1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047512 Apr 05 12:03:55.048312 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 939/1899] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:54 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:56.062150 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fa80003e-f3f0-483c-95c6-9ee89eaf8404 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:56.063057 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fa80003e-f3f0-483c-95c6-9ee89eaf8404 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:56.069831 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fa80003e-f3f0-483c-95c6-9ee89eaf8404 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:56.070277 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fa80003e-f3f0-483c-95c6-9ee89eaf8404 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:56.071067 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fa80003e-f3f0-483c-95c6-9ee89eaf8404 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:56.071496 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fa80003e-f3f0-483c-95c6-9ee89eaf8404 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:56.100994 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fa80003e-f3f0-483c-95c6-9ee89eaf8404 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042965 Apr 05 12:03:56.101540 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 961/1900] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:56 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:57.117774 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0e50378a-0350-4b26-a562-78366df6cb9d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:57.119106 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0e50378a-0350-4b26-a562-78366df6cb9d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:57.129875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0e50378a-0350-4b26-a562-78366df6cb9d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:57.130611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0e50378a-0350-4b26-a562-78366df6cb9d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:57.131851 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0e50378a-0350-4b26-a562-78366df6cb9d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:57.132659 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0e50378a-0350-4b26-a562-78366df6cb9d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:57.165492 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0e50378a-0350-4b26-a562-78366df6cb9d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054967 Apr 05 12:03:57.166040 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 940/1901] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:57 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:58.180621 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4372152c-c1cd-4795-b810-6c1e78f7cbb7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:58.182126 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4372152c-c1cd-4795-b810-6c1e78f7cbb7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:58.192286 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4372152c-c1cd-4795-b810-6c1e78f7cbb7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:58.192736 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4372152c-c1cd-4795-b810-6c1e78f7cbb7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:58.193477 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4372152c-c1cd-4795-b810-6c1e78f7cbb7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:58.193906 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4372152c-c1cd-4795-b810-6c1e78f7cbb7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:58.222691 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4372152c-c1cd-4795-b810-6c1e78f7cbb7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048759 Apr 05 12:03:58.223235 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 962/1902] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:58 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:03:59.239025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-736c4def-0484-47a4-bf2e-a6f9e8a0d4e6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:03:59.240542 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-736c4def-0484-47a4-bf2e-a6f9e8a0d4e6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:03:59.251452 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-736c4def-0484-47a4-bf2e-a6f9e8a0d4e6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:59.252270 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-736c4def-0484-47a4-bf2e-a6f9e8a0d4e6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:59.253508 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-736c4def-0484-47a4-bf2e-a6f9e8a0d4e6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:03:59.254233 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-736c4def-0484-47a4-bf2e-a6f9e8a0d4e6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:03:59.283479 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-736c4def-0484-47a4-bf2e-a6f9e8a0d4e6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051342 Apr 05 12:03:59.284010 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 941/1903] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:03:59 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:00.299661 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bd9133c6-b655-4bf3-b0a8-d94c42d52ded tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:00.301210 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bd9133c6-b655-4bf3-b0a8-d94c42d52ded tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:00.311980 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bd9133c6-b655-4bf3-b0a8-d94c42d52ded tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:00.312789 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bd9133c6-b655-4bf3-b0a8-d94c42d52ded tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:00.314065 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bd9133c6-b655-4bf3-b0a8-d94c42d52ded tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:00.314788 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bd9133c6-b655-4bf3-b0a8-d94c42d52ded tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:00.345621 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bd9133c6-b655-4bf3-b0a8-d94c42d52ded tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052694 Apr 05 12:04:00.346144 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 963/1904] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:00 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:01.361810 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ab133abb-2015-48b5-9eba-d8c606a80249 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:01.363520 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ab133abb-2015-48b5-9eba-d8c606a80249 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:01.374609 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab133abb-2015-48b5-9eba-d8c606a80249 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:01.375339 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab133abb-2015-48b5-9eba-d8c606a80249 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:01.376653 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab133abb-2015-48b5-9eba-d8c606a80249 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:01.378182 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab133abb-2015-48b5-9eba-d8c606a80249 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:01.409614 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ab133abb-2015-48b5-9eba-d8c606a80249 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054535 Apr 05 12:04:01.410174 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 942/1905] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:01 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:02.422708 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ec454b45-af6c-4b3d-a547-6774b1f24b0f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:02.423772 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ec454b45-af6c-4b3d-a547-6774b1f24b0f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:02.431556 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ec454b45-af6c-4b3d-a547-6774b1f24b0f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:02.432200 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ec454b45-af6c-4b3d-a547-6774b1f24b0f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:02.432964 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ec454b45-af6c-4b3d-a547-6774b1f24b0f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:02.433394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ec454b45-af6c-4b3d-a547-6774b1f24b0f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:02.462733 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ec454b45-af6c-4b3d-a547-6774b1f24b0f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044783 Apr 05 12:04:02.463385 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 964/1906] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:02 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:03.475327 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-529b972a-c803-4185-8492-735a418bc253 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:03.476295 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-529b972a-c803-4185-8492-735a418bc253 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:03.483140 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-529b972a-c803-4185-8492-735a418bc253 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:03.483595 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-529b972a-c803-4185-8492-735a418bc253 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:03.484394 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-529b972a-c803-4185-8492-735a418bc253 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:03.484828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-529b972a-c803-4185-8492-735a418bc253 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:03.514884 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-529b972a-c803-4185-8492-735a418bc253 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043511 Apr 05 12:04:03.515437 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 943/1907] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:03 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:04.528389 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-df6ceb96-666d-4703-aac3-2bcd5cf40a52 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:04.529433 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-df6ceb96-666d-4703-aac3-2bcd5cf40a52 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:04.536504 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-df6ceb96-666d-4703-aac3-2bcd5cf40a52 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:04.536985 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-df6ceb96-666d-4703-aac3-2bcd5cf40a52 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:04.537757 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-df6ceb96-666d-4703-aac3-2bcd5cf40a52 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:04.538192 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-df6ceb96-666d-4703-aac3-2bcd5cf40a52 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:04.569454 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-df6ceb96-666d-4703-aac3-2bcd5cf40a52 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046253 Apr 05 12:04:04.570054 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 965/1908] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:04 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:05.587915 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-98b6e44d-2baf-4dd7-91d0-19d568c3db4e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:05.589579 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-98b6e44d-2baf-4dd7-91d0-19d568c3db4e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:05.601460 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-98b6e44d-2baf-4dd7-91d0-19d568c3db4e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:05.602264 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-98b6e44d-2baf-4dd7-91d0-19d568c3db4e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:05.603550 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-98b6e44d-2baf-4dd7-91d0-19d568c3db4e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:05.604415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-98b6e44d-2baf-4dd7-91d0-19d568c3db4e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:05.633732 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-98b6e44d-2baf-4dd7-91d0-19d568c3db4e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052731 Apr 05 12:04:05.634317 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 944/1909] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:05 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:06.649872 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-636e724a-381d-4a70-88d7-4fe23462b937 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:06.651400 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-636e724a-381d-4a70-88d7-4fe23462b937 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:06.658102 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-636e724a-381d-4a70-88d7-4fe23462b937 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:06.658546 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-636e724a-381d-4a70-88d7-4fe23462b937 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:06.659296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-636e724a-381d-4a70-88d7-4fe23462b937 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:06.659723 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-636e724a-381d-4a70-88d7-4fe23462b937 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:06.688509 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-636e724a-381d-4a70-88d7-4fe23462b937 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045318 Apr 05 12:04:06.689056 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 966/1910] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:06 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:07.704325 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a2431a16-3bcc-4a2b-a910-b23f3c44addd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:07.705412 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a2431a16-3bcc-4a2b-a910-b23f3c44addd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:07.715067 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a2431a16-3bcc-4a2b-a910-b23f3c44addd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:07.715524 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a2431a16-3bcc-4a2b-a910-b23f3c44addd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:07.716351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a2431a16-3bcc-4a2b-a910-b23f3c44addd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:07.716786 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a2431a16-3bcc-4a2b-a910-b23f3c44addd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:07.745239 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a2431a16-3bcc-4a2b-a910-b23f3c44addd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047444 Apr 05 12:04:07.745718 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 945/1911] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:07 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:08.758005 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-68c0fff5-f519-4209-ae24-390036b4e4ca tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:08.758863 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-68c0fff5-f519-4209-ae24-390036b4e4ca tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:08.765617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-68c0fff5-f519-4209-ae24-390036b4e4ca tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:08.766064 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-68c0fff5-f519-4209-ae24-390036b4e4ca tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:08.766852 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-68c0fff5-f519-4209-ae24-390036b4e4ca tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:08.767307 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-68c0fff5-f519-4209-ae24-390036b4e4ca tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:08.796144 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-68c0fff5-f519-4209-ae24-390036b4e4ca tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042192 Apr 05 12:04:08.796730 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 967/1912] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:08 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:09.812199 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-965d331f-9280-4794-a51f-ee80b75b9ac3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:09.813566 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-965d331f-9280-4794-a51f-ee80b75b9ac3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:09.823960 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-965d331f-9280-4794-a51f-ee80b75b9ac3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:09.824754 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-965d331f-9280-4794-a51f-ee80b75b9ac3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:09.825997 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-965d331f-9280-4794-a51f-ee80b75b9ac3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:09.826711 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-965d331f-9280-4794-a51f-ee80b75b9ac3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:09.860370 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-965d331f-9280-4794-a51f-ee80b75b9ac3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055012 Apr 05 12:04:09.860907 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 946/1913] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:09 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:10.875967 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c8ff09a5-7239-4c43-825c-6e3708036d3b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:10.877375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c8ff09a5-7239-4c43-825c-6e3708036d3b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:10.887702 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c8ff09a5-7239-4c43-825c-6e3708036d3b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:10.888174 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c8ff09a5-7239-4c43-825c-6e3708036d3b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:10.888921 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c8ff09a5-7239-4c43-825c-6e3708036d3b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:10.889347 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c8ff09a5-7239-4c43-825c-6e3708036d3b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:10.918213 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c8ff09a5-7239-4c43-825c-6e3708036d3b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049686 Apr 05 12:04:10.918762 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 968/1914] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:10 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:11.934132 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6219cd4d-4930-4f3c-9058-f4863b86b289 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:11.935140 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6219cd4d-4930-4f3c-9058-f4863b86b289 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:11.942428 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6219cd4d-4930-4f3c-9058-f4863b86b289 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:11.942927 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6219cd4d-4930-4f3c-9058-f4863b86b289 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:11.943767 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6219cd4d-4930-4f3c-9058-f4863b86b289 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:11.944293 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6219cd4d-4930-4f3c-9058-f4863b86b289 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:11.974963 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6219cd4d-4930-4f3c-9058-f4863b86b289 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047545 Apr 05 12:04:11.975508 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 947/1915] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:11 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:12.990236 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9ec25b94-d1e4-477e-8a5b-0e3f4c875955 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:12.991606 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9ec25b94-d1e4-477e-8a5b-0e3f4c875955 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:13.002468 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9ec25b94-d1e4-477e-8a5b-0e3f4c875955 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:13.003252 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9ec25b94-d1e4-477e-8a5b-0e3f4c875955 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:13.004516 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9ec25b94-d1e4-477e-8a5b-0e3f4c875955 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:13.005253 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9ec25b94-d1e4-477e-8a5b-0e3f4c875955 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:13.036945 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9ec25b94-d1e4-477e-8a5b-0e3f4c875955 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053476 Apr 05 12:04:13.037559 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 969/1916] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:12 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:13.734836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:04:13.735689 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Tue Apr 5 12:04:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:04:14.053359 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7f55fd82-59cf-4978-a925-d344ee7c369a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:14.054711 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7f55fd82-59cf-4978-a925-d344ee7c369a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:14.065481 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f55fd82-59cf-4978-a925-d344ee7c369a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:14.066224 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f55fd82-59cf-4978-a925-d344ee7c369a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:14.067492 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f55fd82-59cf-4978-a925-d344ee7c369a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:14.068188 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f55fd82-59cf-4978-a925-d344ee7c369a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:14.099680 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7f55fd82-59cf-4978-a925-d344ee7c369a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053169 Apr 05 12:04:14.100238 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 948/1917] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:14 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:15.117269 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2e937741-9ae3-4d77-9c93-1d6ae635d2eb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:15.118740 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2e937741-9ae3-4d77-9c93-1d6ae635d2eb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:15.127041 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2e937741-9ae3-4d77-9c93-1d6ae635d2eb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:15.127484 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2e937741-9ae3-4d77-9c93-1d6ae635d2eb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:15.128288 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2e937741-9ae3-4d77-9c93-1d6ae635d2eb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:15.128718 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2e937741-9ae3-4d77-9c93-1d6ae635d2eb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:15.157664 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2e937741-9ae3-4d77-9c93-1d6ae635d2eb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047031 Apr 05 12:04:15.158225 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 970/1918] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:15 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:16.173916 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5e6ba9d0-911a-437a-a81d-5d8398cef42c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:16.175441 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5e6ba9d0-911a-437a-a81d-5d8398cef42c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:16.185941 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5e6ba9d0-911a-437a-a81d-5d8398cef42c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:16.186797 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5e6ba9d0-911a-437a-a81d-5d8398cef42c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:16.187983 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5e6ba9d0-911a-437a-a81d-5d8398cef42c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:16.188755 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5e6ba9d0-911a-437a-a81d-5d8398cef42c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:16.221911 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5e6ba9d0-911a-437a-a81d-5d8398cef42c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054794 Apr 05 12:04:16.222450 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 949/1919] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:16 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:17.237969 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9ec13565-cd16-444c-b6a7-c195fe4b0908 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:17.239440 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9ec13565-cd16-444c-b6a7-c195fe4b0908 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:17.249498 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9ec13565-cd16-444c-b6a7-c195fe4b0908 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:17.249940 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9ec13565-cd16-444c-b6a7-c195fe4b0908 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:17.250690 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9ec13565-cd16-444c-b6a7-c195fe4b0908 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:17.251119 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9ec13565-cd16-444c-b6a7-c195fe4b0908 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:17.279821 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9ec13565-cd16-444c-b6a7-c195fe4b0908 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048475 Apr 05 12:04:17.280400 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 971/1920] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:17 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:18.296841 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0eba2ec8-a1a3-471c-88d0-9c30bc7e7c1d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:18.297791 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0eba2ec8-a1a3-471c-88d0-9c30bc7e7c1d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:18.304529 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0eba2ec8-a1a3-471c-88d0-9c30bc7e7c1d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:18.304977 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0eba2ec8-a1a3-471c-88d0-9c30bc7e7c1d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:18.305738 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0eba2ec8-a1a3-471c-88d0-9c30bc7e7c1d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:18.306172 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0eba2ec8-a1a3-471c-88d0-9c30bc7e7c1d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:18.335621 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0eba2ec8-a1a3-471c-88d0-9c30bc7e7c1d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044351 Apr 05 12:04:18.336150 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 950/1921] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:18 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:19.351168 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1e398baf-212c-4784-afd9-407e940ed437 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:19.352614 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1e398baf-212c-4784-afd9-407e940ed437 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:19.363100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1e398baf-212c-4784-afd9-407e940ed437 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:19.363846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1e398baf-212c-4784-afd9-407e940ed437 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:19.365158 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1e398baf-212c-4784-afd9-407e940ed437 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:19.365879 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1e398baf-212c-4784-afd9-407e940ed437 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:19.397753 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1e398baf-212c-4784-afd9-407e940ed437 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053265 Apr 05 12:04:19.398313 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 972/1922] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:19 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:20.413878 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0de32046-d0d5-4a9f-861b-ca75ae164741 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:20.415343 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0de32046-d0d5-4a9f-861b-ca75ae164741 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:20.425915 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0de32046-d0d5-4a9f-861b-ca75ae164741 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:20.426653 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0de32046-d0d5-4a9f-861b-ca75ae164741 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:20.427908 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0de32046-d0d5-4a9f-861b-ca75ae164741 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:20.428674 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0de32046-d0d5-4a9f-861b-ca75ae164741 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:20.461096 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0de32046-d0d5-4a9f-861b-ca75ae164741 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053833 Apr 05 12:04:20.461650 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 951/1923] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:20 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:21.474409 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f00d9168-9ad3-4466-ab79-7577f3ec8983 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:21.475529 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f00d9168-9ad3-4466-ab79-7577f3ec8983 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:21.483483 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f00d9168-9ad3-4466-ab79-7577f3ec8983 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:21.483926 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f00d9168-9ad3-4466-ab79-7577f3ec8983 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:21.484720 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f00d9168-9ad3-4466-ab79-7577f3ec8983 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:21.485151 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f00d9168-9ad3-4466-ab79-7577f3ec8983 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:21.514539 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f00d9168-9ad3-4466-ab79-7577f3ec8983 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045105 Apr 05 12:04:21.515094 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 973/1924] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:21 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:22.526724 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cd9f5f0e-5e00-4f00-b858-b7558e3ba4af tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:22.527769 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cd9f5f0e-5e00-4f00-b858-b7558e3ba4af tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:22.534834 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd9f5f0e-5e00-4f00-b858-b7558e3ba4af tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:22.535282 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd9f5f0e-5e00-4f00-b858-b7558e3ba4af tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:22.536053 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd9f5f0e-5e00-4f00-b858-b7558e3ba4af tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:22.536542 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd9f5f0e-5e00-4f00-b858-b7558e3ba4af tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:22.565832 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cd9f5f0e-5e00-4f00-b858-b7558e3ba4af tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043558 Apr 05 12:04:22.566382 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 952/1925] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:22 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:23.579756 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b9b9cf05-f1c5-4943-8df2-a3c659a949a2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:23.580725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b9b9cf05-f1c5-4943-8df2-a3c659a949a2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:23.587722 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9b9cf05-f1c5-4943-8df2-a3c659a949a2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:23.588202 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9b9cf05-f1c5-4943-8df2-a3c659a949a2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:23.588963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9b9cf05-f1c5-4943-8df2-a3c659a949a2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:23.589395 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9b9cf05-f1c5-4943-8df2-a3c659a949a2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:23.618245 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b9b9cf05-f1c5-4943-8df2-a3c659a949a2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043452 Apr 05 12:04:23.618784 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 974/1926] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:23 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:24.637957 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-156159f9-3cd2-4634-b6b2-be8e0f58af00 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:24.639377 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-156159f9-3cd2-4634-b6b2-be8e0f58af00 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:24.649666 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-156159f9-3cd2-4634-b6b2-be8e0f58af00 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:24.650402 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-156159f9-3cd2-4634-b6b2-be8e0f58af00 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:24.651636 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-156159f9-3cd2-4634-b6b2-be8e0f58af00 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:24.652419 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-156159f9-3cd2-4634-b6b2-be8e0f58af00 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:24.682150 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-156159f9-3cd2-4634-b6b2-be8e0f58af00 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052498 Apr 05 12:04:24.682692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 953/1927] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:24 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:25.694471 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-959d3750-6f6a-4c9a-99b7-58355f5de53f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:25.695368 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-959d3750-6f6a-4c9a-99b7-58355f5de53f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:25.702258 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-959d3750-6f6a-4c9a-99b7-58355f5de53f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:25.702945 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-959d3750-6f6a-4c9a-99b7-58355f5de53f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:25.704254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-959d3750-6f6a-4c9a-99b7-58355f5de53f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:25.704680 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-959d3750-6f6a-4c9a-99b7-58355f5de53f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:25.733520 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-959d3750-6f6a-4c9a-99b7-58355f5de53f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043023 Apr 05 12:04:25.734346 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 975/1928] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:25 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:26.746279 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6f397388-b509-420e-84a3-4856f48b202f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:26.747168 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6f397388-b509-420e-84a3-4856f48b202f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:26.754532 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6f397388-b509-420e-84a3-4856f48b202f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:26.754965 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6f397388-b509-420e-84a3-4856f48b202f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:26.755777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6f397388-b509-420e-84a3-4856f48b202f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:26.756246 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6f397388-b509-420e-84a3-4856f48b202f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:26.789495 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6f397388-b509-420e-84a3-4856f48b202f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047504 Apr 05 12:04:26.790140 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 954/1929] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:26 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:27.805946 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2796998a-d58d-46e1-b41b-778e0419234a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:27.807281 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2796998a-d58d-46e1-b41b-778e0419234a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:27.816592 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2796998a-d58d-46e1-b41b-778e0419234a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:27.817029 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2796998a-d58d-46e1-b41b-778e0419234a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:27.817801 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2796998a-d58d-46e1-b41b-778e0419234a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:27.818227 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2796998a-d58d-46e1-b41b-778e0419234a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:27.846695 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2796998a-d58d-46e1-b41b-778e0419234a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047565 Apr 05 12:04:27.847267 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 976/1930] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:27 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:28.862087 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1130dd9c-96f7-480b-8ca5-da313b3ce3b8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:28.862998 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1130dd9c-96f7-480b-8ca5-da313b3ce3b8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:28.869637 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1130dd9c-96f7-480b-8ca5-da313b3ce3b8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:28.870077 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1130dd9c-96f7-480b-8ca5-da313b3ce3b8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:28.870832 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1130dd9c-96f7-480b-8ca5-da313b3ce3b8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:28.871263 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1130dd9c-96f7-480b-8ca5-da313b3ce3b8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:28.900613 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1130dd9c-96f7-480b-8ca5-da313b3ce3b8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044616 Apr 05 12:04:28.901156 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 955/1931] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:28 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:29.918402 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8adff9b3-96dd-4ef7-af7f-548e7dad54eb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:29.919922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8adff9b3-96dd-4ef7-af7f-548e7dad54eb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:29.930467 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8adff9b3-96dd-4ef7-af7f-548e7dad54eb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:29.931207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8adff9b3-96dd-4ef7-af7f-548e7dad54eb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:29.932551 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8adff9b3-96dd-4ef7-af7f-548e7dad54eb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:29.933602 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8adff9b3-96dd-4ef7-af7f-548e7dad54eb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:29.975919 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8adff9b3-96dd-4ef7-af7f-548e7dad54eb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063954 Apr 05 12:04:29.976788 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 977/1932] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:29 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:30.993272 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3eb5a51c-7835-46d7-b6ce-2ab5445174de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:30.994772 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3eb5a51c-7835-46d7-b6ce-2ab5445174de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:31.006026 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3eb5a51c-7835-46d7-b6ce-2ab5445174de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:31.006772 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3eb5a51c-7835-46d7-b6ce-2ab5445174de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:31.008040 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3eb5a51c-7835-46d7-b6ce-2ab5445174de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:31.008799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3eb5a51c-7835-46d7-b6ce-2ab5445174de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:31.040394 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3eb5a51c-7835-46d7-b6ce-2ab5445174de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053797 Apr 05 12:04:31.040982 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 956/1933] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:30 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:32.056571 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d17f991f-f2b5-44f6-b4c5-e3ca29ccaee0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:32.058122 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d17f991f-f2b5-44f6-b4c5-e3ca29ccaee0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:32.067092 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d17f991f-f2b5-44f6-b4c5-e3ca29ccaee0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:32.067542 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d17f991f-f2b5-44f6-b4c5-e3ca29ccaee0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:32.068348 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d17f991f-f2b5-44f6-b4c5-e3ca29ccaee0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:32.068783 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d17f991f-f2b5-44f6-b4c5-e3ca29ccaee0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:32.097895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d17f991f-f2b5-44f6-b4c5-e3ca29ccaee0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047975 Apr 05 12:04:32.098440 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 978/1934] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:32 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:33.113170 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fd8c733d-bc5a-42c7-b6f9-7d91d35006de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:33.114022 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fd8c733d-bc5a-42c7-b6f9-7d91d35006de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:33.121148 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd8c733d-bc5a-42c7-b6f9-7d91d35006de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:33.121596 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd8c733d-bc5a-42c7-b6f9-7d91d35006de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:33.122384 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd8c733d-bc5a-42c7-b6f9-7d91d35006de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:33.122814 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd8c733d-bc5a-42c7-b6f9-7d91d35006de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:33.154855 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fd8c733d-bc5a-42c7-b6f9-7d91d35006de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047351 Apr 05 12:04:33.155605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 957/1935] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:33 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:34.172962 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8943ed82-90fb-40e4-a7ba-decd77c1ffdc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:34.174487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8943ed82-90fb-40e4-a7ba-decd77c1ffdc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:34.184991 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8943ed82-90fb-40e4-a7ba-decd77c1ffdc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:34.185725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8943ed82-90fb-40e4-a7ba-decd77c1ffdc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:34.186971 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8943ed82-90fb-40e4-a7ba-decd77c1ffdc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:34.187658 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8943ed82-90fb-40e4-a7ba-decd77c1ffdc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:34.219417 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8943ed82-90fb-40e4-a7ba-decd77c1ffdc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053105 Apr 05 12:04:34.219942 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 979/1936] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:34 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:35.235922 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-71a08480-6f1d-4a50-9182-a890d6b914c3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:35.237438 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-71a08480-6f1d-4a50-9182-a890d6b914c3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:35.244047 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-71a08480-6f1d-4a50-9182-a890d6b914c3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:35.244552 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-71a08480-6f1d-4a50-9182-a890d6b914c3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:35.245318 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-71a08480-6f1d-4a50-9182-a890d6b914c3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:35.245753 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-71a08480-6f1d-4a50-9182-a890d6b914c3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:35.274885 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-71a08480-6f1d-4a50-9182-a890d6b914c3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046441 Apr 05 12:04:35.275439 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 958/1937] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:35 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:36.291105 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f5df44d1-da2b-4cf5-8b4d-9082aeaaf91b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:36.292401 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f5df44d1-da2b-4cf5-8b4d-9082aeaaf91b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:36.301271 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f5df44d1-da2b-4cf5-8b4d-9082aeaaf91b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:36.301860 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f5df44d1-da2b-4cf5-8b4d-9082aeaaf91b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:36.302873 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f5df44d1-da2b-4cf5-8b4d-9082aeaaf91b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:36.303455 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f5df44d1-da2b-4cf5-8b4d-9082aeaaf91b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:36.337508 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f5df44d1-da2b-4cf5-8b4d-9082aeaaf91b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052988 Apr 05 12:04:36.338041 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 980/1938] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:36 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:37.353804 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f3bd0d50-3a86-4164-89c0-2dde76602a01 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:37.355293 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f3bd0d50-3a86-4164-89c0-2dde76602a01 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:37.365835 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f3bd0d50-3a86-4164-89c0-2dde76602a01 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:37.366579 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f3bd0d50-3a86-4164-89c0-2dde76602a01 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:37.367830 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f3bd0d50-3a86-4164-89c0-2dde76602a01 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:37.368614 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f3bd0d50-3a86-4164-89c0-2dde76602a01 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:37.399173 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f3bd0d50-3a86-4164-89c0-2dde76602a01 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052203 Apr 05 12:04:37.399732 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 959/1939] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:37 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:38.415336 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4ae9d0b6-6cb0-46a9-9fa0-3cc9e493fea2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:38.416871 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4ae9d0b6-6cb0-46a9-9fa0-3cc9e493fea2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:38.424960 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4ae9d0b6-6cb0-46a9-9fa0-3cc9e493fea2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:38.425388 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4ae9d0b6-6cb0-46a9-9fa0-3cc9e493fea2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:38.426174 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4ae9d0b6-6cb0-46a9-9fa0-3cc9e493fea2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:38.426600 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4ae9d0b6-6cb0-46a9-9fa0-3cc9e493fea2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:38.456328 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4ae9d0b6-6cb0-46a9-9fa0-3cc9e493fea2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047695 Apr 05 12:04:38.456880 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 981/1940] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:38 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:39.471536 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2ca54de8-653d-4f6d-9ef1-886883aa9bd6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:39.472505 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2ca54de8-653d-4f6d-9ef1-886883aa9bd6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:39.479085 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ca54de8-653d-4f6d-9ef1-886883aa9bd6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:39.479530 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ca54de8-653d-4f6d-9ef1-886883aa9bd6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:39.480325 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ca54de8-653d-4f6d-9ef1-886883aa9bd6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:39.480757 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ca54de8-653d-4f6d-9ef1-886883aa9bd6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:39.511032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2ca54de8-653d-4f6d-9ef1-886883aa9bd6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044094 Apr 05 12:04:39.511605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 960/1941] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:39 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:40.524138 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c08b47a8-6a56-4746-a501-e5fd07ecaad8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:40.525237 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c08b47a8-6a56-4746-a501-e5fd07ecaad8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:40.532536 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c08b47a8-6a56-4746-a501-e5fd07ecaad8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:40.533061 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c08b47a8-6a56-4746-a501-e5fd07ecaad8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:40.533940 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c08b47a8-6a56-4746-a501-e5fd07ecaad8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:40.534444 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c08b47a8-6a56-4746-a501-e5fd07ecaad8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:40.564891 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c08b47a8-6a56-4746-a501-e5fd07ecaad8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045493 Apr 05 12:04:40.565404 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 982/1942] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:40 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:41.581229 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b34d3882-8adb-413f-9c60-67ba22c5cb4b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:41.582713 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b34d3882-8adb-413f-9c60-67ba22c5cb4b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:41.592752 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b34d3882-8adb-413f-9c60-67ba22c5cb4b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:41.593199 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b34d3882-8adb-413f-9c60-67ba22c5cb4b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:41.593962 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b34d3882-8adb-413f-9c60-67ba22c5cb4b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:41.594399 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b34d3882-8adb-413f-9c60-67ba22c5cb4b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:41.623441 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b34d3882-8adb-413f-9c60-67ba22c5cb4b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048968 Apr 05 12:04:41.624002 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 961/1943] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:41 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:41.685492 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:04:41.685738 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Tue Apr 5 12:04:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:04:42.640384 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c238f993-5d3b-4088-b465-38059ac00125 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:42.641344 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c238f993-5d3b-4088-b465-38059ac00125 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:42.648294 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c238f993-5d3b-4088-b465-38059ac00125 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:42.648758 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c238f993-5d3b-4088-b465-38059ac00125 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:42.649550 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c238f993-5d3b-4088-b465-38059ac00125 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:42.649997 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c238f993-5d3b-4088-b465-38059ac00125 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:42.680643 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c238f993-5d3b-4088-b465-38059ac00125 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046077 Apr 05 12:04:42.681178 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 983/1944] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:42 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:43.696163 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cf22a44b-628e-406e-a514-3c02c35062e3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:43.697659 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cf22a44b-628e-406e-a514-3c02c35062e3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:43.705713 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cf22a44b-628e-406e-a514-3c02c35062e3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:43.706190 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cf22a44b-628e-406e-a514-3c02c35062e3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:43.706956 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cf22a44b-628e-406e-a514-3c02c35062e3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:43.707391 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cf22a44b-628e-406e-a514-3c02c35062e3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:43.736647 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cf22a44b-628e-406e-a514-3c02c35062e3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047366 Apr 05 12:04:43.737192 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 962/1945] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:43 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:44.753293 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8a461368-6556-47c4-8a69-4ab9dcae884c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:44.754663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8a461368-6556-47c4-8a69-4ab9dcae884c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:44.765453 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8a461368-6556-47c4-8a69-4ab9dcae884c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:44.766195 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8a461368-6556-47c4-8a69-4ab9dcae884c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:44.767439 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8a461368-6556-47c4-8a69-4ab9dcae884c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:44.768198 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8a461368-6556-47c4-8a69-4ab9dcae884c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:44.801698 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8a461368-6556-47c4-8a69-4ab9dcae884c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055741 Apr 05 12:04:44.802242 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 984/1946] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:44 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:45.817890 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a654c2d9-0a2c-4567-881f-eed036390075 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:45.819390 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a654c2d9-0a2c-4567-881f-eed036390075 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:45.828685 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a654c2d9-0a2c-4567-881f-eed036390075 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:45.829175 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a654c2d9-0a2c-4567-881f-eed036390075 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:45.829897 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a654c2d9-0a2c-4567-881f-eed036390075 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:45.830333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a654c2d9-0a2c-4567-881f-eed036390075 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:45.859128 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a654c2d9-0a2c-4567-881f-eed036390075 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048114 Apr 05 12:04:45.859676 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 963/1947] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:45 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:46.872708 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-90a22424-da84-45e8-b178-306cc17e2c32 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:46.873768 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-90a22424-da84-45e8-b178-306cc17e2c32 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:46.881072 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90a22424-da84-45e8-b178-306cc17e2c32 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:46.881523 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90a22424-da84-45e8-b178-306cc17e2c32 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:46.882276 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90a22424-da84-45e8-b178-306cc17e2c32 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:46.882710 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90a22424-da84-45e8-b178-306cc17e2c32 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:46.911942 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-90a22424-da84-45e8-b178-306cc17e2c32 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043947 Apr 05 12:04:46.912561 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 985/1948] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:46 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:47.927381 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-77bf8971-d8d0-4085-9062-7d2a82b443da tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:47.928913 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-77bf8971-d8d0-4085-9062-7d2a82b443da tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:47.939453 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-77bf8971-d8d0-4085-9062-7d2a82b443da tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:47.940253 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-77bf8971-d8d0-4085-9062-7d2a82b443da tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:47.941507 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-77bf8971-d8d0-4085-9062-7d2a82b443da tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:47.942229 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-77bf8971-d8d0-4085-9062-7d2a82b443da tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:47.975828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-77bf8971-d8d0-4085-9062-7d2a82b443da tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055237 Apr 05 12:04:47.976429 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 964/1949] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:47 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:48.991272 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ace1a88b-d99a-499f-ae3f-bdffa5dcff3e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:48.992788 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ace1a88b-d99a-499f-ae3f-bdffa5dcff3e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:49.002272 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ace1a88b-d99a-499f-ae3f-bdffa5dcff3e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:49.002712 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ace1a88b-d99a-499f-ae3f-bdffa5dcff3e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:49.003462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ace1a88b-d99a-499f-ae3f-bdffa5dcff3e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:49.003892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ace1a88b-d99a-499f-ae3f-bdffa5dcff3e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:49.034261 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ace1a88b-d99a-499f-ae3f-bdffa5dcff3e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049560 Apr 05 12:04:49.034803 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 986/1950] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:48 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:50.046438 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f9375a1b-2e1e-41c5-8018-070459f7abf2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:50.047357 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f9375a1b-2e1e-41c5-8018-070459f7abf2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:50.054027 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f9375a1b-2e1e-41c5-8018-070459f7abf2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:50.054466 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f9375a1b-2e1e-41c5-8018-070459f7abf2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:50.055245 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f9375a1b-2e1e-41c5-8018-070459f7abf2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:50.055692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f9375a1b-2e1e-41c5-8018-070459f7abf2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:50.088038 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f9375a1b-2e1e-41c5-8018-070459f7abf2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045841 Apr 05 12:04:50.088576 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 965/1951] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:50 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:51.104057 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cae39d33-8bc5-42f1-a2ab-25f7c70c624c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:51.105546 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cae39d33-8bc5-42f1-a2ab-25f7c70c624c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:51.114820 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cae39d33-8bc5-42f1-a2ab-25f7c70c624c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:51.115274 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cae39d33-8bc5-42f1-a2ab-25f7c70c624c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:51.116043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cae39d33-8bc5-42f1-a2ab-25f7c70c624c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:51.116511 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cae39d33-8bc5-42f1-a2ab-25f7c70c624c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:51.145700 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cae39d33-8bc5-42f1-a2ab-25f7c70c624c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048474 Apr 05 12:04:51.146258 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 987/1952] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:51 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:52.162331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c1b8865a-6d72-4de9-99f6-d4deec67fe1c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:52.163833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c1b8865a-6d72-4de9-99f6-d4deec67fe1c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:52.174340 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1b8865a-6d72-4de9-99f6-d4deec67fe1c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:52.175085 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1b8865a-6d72-4de9-99f6-d4deec67fe1c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:52.176428 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1b8865a-6d72-4de9-99f6-d4deec67fe1c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:52.177146 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1b8865a-6d72-4de9-99f6-d4deec67fe1c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:52.210352 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c1b8865a-6d72-4de9-99f6-d4deec67fe1c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055252 Apr 05 12:04:52.210899 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 966/1953] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:52 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:53.226478 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4abffed6-3b40-4076-9179-3b5b9d827e72 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:53.228002 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4abffed6-3b40-4076-9179-3b5b9d827e72 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:53.237982 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4abffed6-3b40-4076-9179-3b5b9d827e72 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:53.238439 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4abffed6-3b40-4076-9179-3b5b9d827e72 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:53.239201 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4abffed6-3b40-4076-9179-3b5b9d827e72 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:53.239635 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4abffed6-3b40-4076-9179-3b5b9d827e72 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:53.268559 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4abffed6-3b40-4076-9179-3b5b9d827e72 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048845 Apr 05 12:04:53.269116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 988/1954] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:53 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:54.284827 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-00e7095c-19d9-4ba8-a39d-a4bb19436808 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:54.286304 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-00e7095c-19d9-4ba8-a39d-a4bb19436808 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:54.296409 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00e7095c-19d9-4ba8-a39d-a4bb19436808 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:54.297154 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00e7095c-19d9-4ba8-a39d-a4bb19436808 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:54.298392 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00e7095c-19d9-4ba8-a39d-a4bb19436808 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:54.299111 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00e7095c-19d9-4ba8-a39d-a4bb19436808 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:54.333725 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-00e7095c-19d9-4ba8-a39d-a4bb19436808 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055825 Apr 05 12:04:54.334255 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 967/1955] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:54 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:55.349705 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9d3a2edf-ee00-4acc-af6a-8a32b58410d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:55.351232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9d3a2edf-ee00-4acc-af6a-8a32b58410d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:55.361739 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9d3a2edf-ee00-4acc-af6a-8a32b58410d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:55.362563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9d3a2edf-ee00-4acc-af6a-8a32b58410d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:55.363406 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9d3a2edf-ee00-4acc-af6a-8a32b58410d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:55.363827 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9d3a2edf-ee00-4acc-af6a-8a32b58410d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:55.394004 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9d3a2edf-ee00-4acc-af6a-8a32b58410d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050967 Apr 05 12:04:55.394571 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 989/1956] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:55 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:56.406030 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7f97f1a8-0181-46e5-8cdb-cb7737652c4f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:56.407076 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7f97f1a8-0181-46e5-8cdb-cb7737652c4f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:56.413602 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f97f1a8-0181-46e5-8cdb-cb7737652c4f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:56.414057 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f97f1a8-0181-46e5-8cdb-cb7737652c4f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:56.414820 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f97f1a8-0181-46e5-8cdb-cb7737652c4f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:56.415287 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f97f1a8-0181-46e5-8cdb-cb7737652c4f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:56.444285 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7f97f1a8-0181-46e5-8cdb-cb7737652c4f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042214 Apr 05 12:04:56.444862 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 968/1957] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:56 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:57.457109 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-30e6ff3f-e6e7-4a4e-a438-fbbb0938eeda tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:57.458256 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-30e6ff3f-e6e7-4a4e-a438-fbbb0938eeda tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:57.466471 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-30e6ff3f-e6e7-4a4e-a438-fbbb0938eeda tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:57.467025 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-30e6ff3f-e6e7-4a4e-a438-fbbb0938eeda tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:57.467968 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-30e6ff3f-e6e7-4a4e-a438-fbbb0938eeda tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:57.468554 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-30e6ff3f-e6e7-4a4e-a438-fbbb0938eeda tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:57.498433 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-30e6ff3f-e6e7-4a4e-a438-fbbb0938eeda tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046388 Apr 05 12:04:57.499190 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 990/1958] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:57 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:58.515333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-75ec8efd-a167-4997-8c5e-8cf219053e84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:58.516889 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-75ec8efd-a167-4997-8c5e-8cf219053e84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:58.525712 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-75ec8efd-a167-4997-8c5e-8cf219053e84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:58.526160 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-75ec8efd-a167-4997-8c5e-8cf219053e84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:58.526921 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-75ec8efd-a167-4997-8c5e-8cf219053e84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:58.527356 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-75ec8efd-a167-4997-8c5e-8cf219053e84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:58.556454 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-75ec8efd-a167-4997-8c5e-8cf219053e84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047837 Apr 05 12:04:58.556993 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 969/1959] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:58 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:59.572608 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5c42b5a4-893a-4d57-b7bb-c84bfc30a607 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:04:59.574124 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5c42b5a4-893a-4d57-b7bb-c84bfc30a607 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:04:59.584843 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5c42b5a4-893a-4d57-b7bb-c84bfc30a607 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:59.585592 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5c42b5a4-893a-4d57-b7bb-c84bfc30a607 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:59.586719 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5c42b5a4-893a-4d57-b7bb-c84bfc30a607 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:04:59.587150 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5c42b5a4-893a-4d57-b7bb-c84bfc30a607 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:04:59.616215 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5c42b5a4-893a-4d57-b7bb-c84bfc30a607 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050438 Apr 05 12:04:59.616763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 991/1960] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:04:59 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:00.632721 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-07545359-8ed7-4965-9f96-0ad8c47e5bf3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:00.634190 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-07545359-8ed7-4965-9f96-0ad8c47e5bf3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:00.641640 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-07545359-8ed7-4965-9f96-0ad8c47e5bf3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:00.642107 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-07545359-8ed7-4965-9f96-0ad8c47e5bf3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:00.642899 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-07545359-8ed7-4965-9f96-0ad8c47e5bf3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:00.643320 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-07545359-8ed7-4965-9f96-0ad8c47e5bf3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:00.673779 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-07545359-8ed7-4965-9f96-0ad8c47e5bf3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047776 Apr 05 12:05:00.674343 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 970/1961] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:00 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:01.689803 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-552bc1c2-05bf-4882-b8fb-48d564e49c7f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:01.691380 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-552bc1c2-05bf-4882-b8fb-48d564e49c7f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:01.701915 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-552bc1c2-05bf-4882-b8fb-48d564e49c7f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:01.702655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-552bc1c2-05bf-4882-b8fb-48d564e49c7f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:01.703911 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-552bc1c2-05bf-4882-b8fb-48d564e49c7f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:01.704678 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-552bc1c2-05bf-4882-b8fb-48d564e49c7f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:01.737178 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-552bc1c2-05bf-4882-b8fb-48d564e49c7f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054019 Apr 05 12:05:01.737697 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 992/1962] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:01 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:02.753651 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-57d46e01-7571-4e4a-903c-0a458f0cd005 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:02.755114 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-57d46e01-7571-4e4a-903c-0a458f0cd005 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:02.764380 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-57d46e01-7571-4e4a-903c-0a458f0cd005 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:02.764828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-57d46e01-7571-4e4a-903c-0a458f0cd005 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:02.765580 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-57d46e01-7571-4e4a-903c-0a458f0cd005 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:02.766006 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-57d46e01-7571-4e4a-903c-0a458f0cd005 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:02.795028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-57d46e01-7571-4e4a-903c-0a458f0cd005 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048456 Apr 05 12:05:02.795587 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 971/1963] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:02 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:03.810168 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f647a60c-a9ed-488a-b4d7-78184ee64f48 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:03.811068 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f647a60c-a9ed-488a-b4d7-78184ee64f48 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:03.817305 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f647a60c-a9ed-488a-b4d7-78184ee64f48 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:03.817743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f647a60c-a9ed-488a-b4d7-78184ee64f48 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:03.818487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f647a60c-a9ed-488a-b4d7-78184ee64f48 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:03.818911 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f647a60c-a9ed-488a-b4d7-78184ee64f48 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:03.851823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f647a60c-a9ed-488a-b4d7-78184ee64f48 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047571 Apr 05 12:05:03.852454 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 993/1964] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:03 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:04.867977 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bf83be41-62aa-4481-b96a-49f9de0b4cb0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:04.869536 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bf83be41-62aa-4481-b96a-49f9de0b4cb0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:04.877150 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bf83be41-62aa-4481-b96a-49f9de0b4cb0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:04.877595 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bf83be41-62aa-4481-b96a-49f9de0b4cb0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:04.878361 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bf83be41-62aa-4481-b96a-49f9de0b4cb0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:04.878796 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bf83be41-62aa-4481-b96a-49f9de0b4cb0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:04.907795 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bf83be41-62aa-4481-b96a-49f9de0b4cb0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046541 Apr 05 12:05:04.908380 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 972/1965] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:04 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:05.920956 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-03239e09-f536-4faa-920f-0ba11ed24c08 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:05.921904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-03239e09-f536-4faa-920f-0ba11ed24c08 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:05.928674 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-03239e09-f536-4faa-920f-0ba11ed24c08 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:05.929099 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-03239e09-f536-4faa-920f-0ba11ed24c08 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:05.929848 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-03239e09-f536-4faa-920f-0ba11ed24c08 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:05.930280 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-03239e09-f536-4faa-920f-0ba11ed24c08 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:05.959055 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-03239e09-f536-4faa-920f-0ba11ed24c08 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042272 Apr 05 12:05:05.959604 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 994/1966] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:05 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:06.970347 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c0027b1c-37bf-4d89-8d97-5206dd870791 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:06.971263 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c0027b1c-37bf-4d89-8d97-5206dd870791 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:06.977770 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0027b1c-37bf-4d89-8d97-5206dd870791 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:06.978220 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0027b1c-37bf-4d89-8d97-5206dd870791 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:06.978991 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0027b1c-37bf-4d89-8d97-5206dd870791 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:06.979415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0027b1c-37bf-4d89-8d97-5206dd870791 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:07.009404 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c0027b1c-37bf-4d89-8d97-5206dd870791 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043061 Apr 05 12:05:07.010006 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 973/1967] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:06 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:08.026690 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8c7f7b11-fc41-488a-91b1-d65c9e146258 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:08.027705 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8c7f7b11-fc41-488a-91b1-d65c9e146258 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:08.036678 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8c7f7b11-fc41-488a-91b1-d65c9e146258 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:08.041640 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8c7f7b11-fc41-488a-91b1-d65c9e146258 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:08.041640 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8c7f7b11-fc41-488a-91b1-d65c9e146258 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:08.041640 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8c7f7b11-fc41-488a-91b1-d65c9e146258 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:08.067693 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8c7f7b11-fc41-488a-91b1-d65c9e146258 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047626 Apr 05 12:05:08.068281 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 995/1968] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:08 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:09.083597 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4435f00c-0e3e-4c1d-a469-1c88e6cc145f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:09.085017 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4435f00c-0e3e-4c1d-a469-1c88e6cc145f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:09.093482 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4435f00c-0e3e-4c1d-a469-1c88e6cc145f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:09.093929 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4435f00c-0e3e-4c1d-a469-1c88e6cc145f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:09.094692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4435f00c-0e3e-4c1d-a469-1c88e6cc145f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:09.095126 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4435f00c-0e3e-4c1d-a469-1c88e6cc145f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:09.125921 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4435f00c-0e3e-4c1d-a469-1c88e6cc145f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049120 Apr 05 12:05:09.126464 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 974/1969] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:09 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:10.144864 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4f0c559b-c868-417e-aea3-0b31cd340e75 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:10.146203 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4f0c559b-c868-417e-aea3-0b31cd340e75 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:10.156385 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f0c559b-c868-417e-aea3-0b31cd340e75 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:10.157121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f0c559b-c868-417e-aea3-0b31cd340e75 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:10.158396 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f0c559b-c868-417e-aea3-0b31cd340e75 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:10.159142 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4f0c559b-c868-417e-aea3-0b31cd340e75 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:10.191149 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4f0c559b-c868-417e-aea3-0b31cd340e75 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053493 Apr 05 12:05:10.191693 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 996/1970] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:10 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:11.205437 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5a883fd0-388e-4fc2-bdc8-cd4e79f9fc62 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:11.206455 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5a883fd0-388e-4fc2-bdc8-cd4e79f9fc62 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:11.213737 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5a883fd0-388e-4fc2-bdc8-cd4e79f9fc62 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:11.214240 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5a883fd0-388e-4fc2-bdc8-cd4e79f9fc62 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:11.215082 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5a883fd0-388e-4fc2-bdc8-cd4e79f9fc62 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:11.215542 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5a883fd0-388e-4fc2-bdc8-cd4e79f9fc62 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:11.245944 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5a883fd0-388e-4fc2-bdc8-cd4e79f9fc62 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045475 Apr 05 12:05:11.246491 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 975/1971] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:11 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:12.262063 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bbbddfdf-c5d1-403d-9d17-5dff54fb6ce1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:12.263647 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bbbddfdf-c5d1-403d-9d17-5dff54fb6ce1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:12.274566 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bbbddfdf-c5d1-403d-9d17-5dff54fb6ce1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:12.275299 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bbbddfdf-c5d1-403d-9d17-5dff54fb6ce1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:12.276591 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bbbddfdf-c5d1-403d-9d17-5dff54fb6ce1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:12.277310 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bbbddfdf-c5d1-403d-9d17-5dff54fb6ce1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:12.306688 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bbbddfdf-c5d1-403d-9d17-5dff54fb6ce1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051527 Apr 05 12:05:12.307216 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 997/1972] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:12 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:13.322629 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c19dbe3b-5a06-48d5-b4b4-04219057158d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:13.324129 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c19dbe3b-5a06-48d5-b4b4-04219057158d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:13.331705 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c19dbe3b-5a06-48d5-b4b4-04219057158d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:13.332180 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c19dbe3b-5a06-48d5-b4b4-04219057158d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:13.332933 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c19dbe3b-5a06-48d5-b4b4-04219057158d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:13.333367 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c19dbe3b-5a06-48d5-b4b4-04219057158d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:13.362599 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c19dbe3b-5a06-48d5-b4b4-04219057158d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046699 Apr 05 12:05:13.363150 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 976/1973] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:13 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:14.382646 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2f3efe0c-0203-43c8-b92f-d4e499dd7d6c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:14.384214 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2f3efe0c-0203-43c8-b92f-d4e499dd7d6c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:14.394790 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2f3efe0c-0203-43c8-b92f-d4e499dd7d6c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:14.395566 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2f3efe0c-0203-43c8-b92f-d4e499dd7d6c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:14.396892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2f3efe0c-0203-43c8-b92f-d4e499dd7d6c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:14.397571 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2f3efe0c-0203-43c8-b92f-d4e499dd7d6c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:14.430201 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2f3efe0c-0203-43c8-b92f-d4e499dd7d6c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056813 Apr 05 12:05:14.430774 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 998/1974] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:14 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:15.447954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b3472b44-f458-4816-bd89-0292be3e4909 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:15.449586 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b3472b44-f458-4816-bd89-0292be3e4909 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:15.458411 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b3472b44-f458-4816-bd89-0292be3e4909 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:15.458869 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b3472b44-f458-4816-bd89-0292be3e4909 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:15.459770 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b3472b44-f458-4816-bd89-0292be3e4909 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:15.460427 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b3472b44-f458-4816-bd89-0292be3e4909 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:15.488799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b3472b44-f458-4816-bd89-0292be3e4909 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049342 Apr 05 12:05:15.489566 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 977/1975] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:15 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:16.505145 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cca1a0aa-27e2-416b-a23c-3654c3b14e07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:16.506065 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cca1a0aa-27e2-416b-a23c-3654c3b14e07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:16.512790 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cca1a0aa-27e2-416b-a23c-3654c3b14e07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:16.513241 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cca1a0aa-27e2-416b-a23c-3654c3b14e07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:16.513984 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cca1a0aa-27e2-416b-a23c-3654c3b14e07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:16.514405 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cca1a0aa-27e2-416b-a23c-3654c3b14e07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:16.543118 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cca1a0aa-27e2-416b-a23c-3654c3b14e07 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045190 Apr 05 12:05:16.543660 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 999/1976] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:16 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:17.558972 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c3738bbf-8dea-4481-a19e-6187350e5e77 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:17.560555 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c3738bbf-8dea-4481-a19e-6187350e5e77 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:17.570930 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3738bbf-8dea-4481-a19e-6187350e5e77 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:17.571686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3738bbf-8dea-4481-a19e-6187350e5e77 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:17.573004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3738bbf-8dea-4481-a19e-6187350e5e77 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:17.573744 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3738bbf-8dea-4481-a19e-6187350e5e77 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:17.605965 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c3738bbf-8dea-4481-a19e-6187350e5e77 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053758 Apr 05 12:05:17.606515 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 978/1977] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:17 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:18.621901 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bc5962e2-6523-4fec-886e-78b3991b51c0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:18.623252 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bc5962e2-6523-4fec-886e-78b3991b51c0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:18.632875 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bc5962e2-6523-4fec-886e-78b3991b51c0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:18.633313 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bc5962e2-6523-4fec-886e-78b3991b51c0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:18.634064 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bc5962e2-6523-4fec-886e-78b3991b51c0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:18.634487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bc5962e2-6523-4fec-886e-78b3991b51c0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:18.662818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bc5962e2-6523-4fec-886e-78b3991b51c0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047651 Apr 05 12:05:18.663359 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1000/1978] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:18 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:19.678813 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-dc24fb1b-d267-4d3e-8896-2d318df961b7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:19.679781 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-dc24fb1b-d267-4d3e-8896-2d318df961b7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:19.687667 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dc24fb1b-d267-4d3e-8896-2d318df961b7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:19.688218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dc24fb1b-d267-4d3e-8896-2d318df961b7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:19.689147 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dc24fb1b-d267-4d3e-8896-2d318df961b7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:19.689685 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dc24fb1b-d267-4d3e-8896-2d318df961b7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:19.721852 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-dc24fb1b-d267-4d3e-8896-2d318df961b7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049819 Apr 05 12:05:19.722404 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 979/1979] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:19 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:20.735197 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3543d03b-4150-416b-ad1e-cf753e1c264f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:20.736101 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3543d03b-4150-416b-ad1e-cf753e1c264f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:20.742701 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3543d03b-4150-416b-ad1e-cf753e1c264f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:20.743158 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3543d03b-4150-416b-ad1e-cf753e1c264f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:20.743905 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3543d03b-4150-416b-ad1e-cf753e1c264f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:20.744376 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3543d03b-4150-416b-ad1e-cf753e1c264f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:20.773966 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3543d03b-4150-416b-ad1e-cf753e1c264f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043329 Apr 05 12:05:20.774528 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1001/1980] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:20 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:21.789830 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a94ec608-47a7-4182-abe8-4fe929f9fd79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:21.791447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a94ec608-47a7-4182-abe8-4fe929f9fd79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:21.798563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a94ec608-47a7-4182-abe8-4fe929f9fd79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:21.799004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a94ec608-47a7-4182-abe8-4fe929f9fd79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:21.799799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a94ec608-47a7-4182-abe8-4fe929f9fd79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:21.800291 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a94ec608-47a7-4182-abe8-4fe929f9fd79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:21.831013 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a94ec608-47a7-4182-abe8-4fe929f9fd79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047688 Apr 05 12:05:21.831542 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 980/1981] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:21 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:22.847202 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ebddb2cb-fd37-46d3-8579-33ff45680db0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:22.848754 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ebddb2cb-fd37-46d3-8579-33ff45680db0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:22.859320 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ebddb2cb-fd37-46d3-8579-33ff45680db0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:22.860049 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ebddb2cb-fd37-46d3-8579-33ff45680db0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:22.861411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ebddb2cb-fd37-46d3-8579-33ff45680db0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:22.862073 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ebddb2cb-fd37-46d3-8579-33ff45680db0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:22.894689 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ebddb2cb-fd37-46d3-8579-33ff45680db0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054096 Apr 05 12:05:22.895463 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1002/1982] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:22 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:23.908868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-81c70ec3-8260-4256-a4eb-22ea7a849869 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:23.909979 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-81c70ec3-8260-4256-a4eb-22ea7a849869 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:23.917849 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-81c70ec3-8260-4256-a4eb-22ea7a849869 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:23.918301 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-81c70ec3-8260-4256-a4eb-22ea7a849869 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:23.919061 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-81c70ec3-8260-4256-a4eb-22ea7a849869 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:23.919498 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-81c70ec3-8260-4256-a4eb-22ea7a849869 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:23.948330 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-81c70ec3-8260-4256-a4eb-22ea7a849869 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044891 Apr 05 12:05:23.948923 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 981/1983] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:23 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:24.965254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-df01d06c-3ce6-4c31-b1bc-230164a4a40a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:24.966333 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-df01d06c-3ce6-4c31-b1bc-230164a4a40a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:24.974034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-df01d06c-3ce6-4c31-b1bc-230164a4a40a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:24.974563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-df01d06c-3ce6-4c31-b1bc-230164a4a40a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:24.975450 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-df01d06c-3ce6-4c31-b1bc-230164a4a40a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:24.975951 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-df01d06c-3ce6-4c31-b1bc-230164a4a40a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:25.007957 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-df01d06c-3ce6-4c31-b1bc-230164a4a40a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048839 Apr 05 12:05:25.008555 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1003/1984] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:24 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:26.020681 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3e0ffedc-daa4-42d0-889b-27064b0ca0fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:26.021525 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3e0ffedc-daa4-42d0-889b-27064b0ca0fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:26.028193 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e0ffedc-daa4-42d0-889b-27064b0ca0fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:26.028646 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e0ffedc-daa4-42d0-889b-27064b0ca0fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:26.029415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e0ffedc-daa4-42d0-889b-27064b0ca0fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:26.029848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e0ffedc-daa4-42d0-889b-27064b0ca0fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:26.057712 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3e0ffedc-daa4-42d0-889b-27064b0ca0fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041188 Apr 05 12:05:26.058261 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 982/1985] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:26 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:27.073308 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-75fabe14-6ee1-4c78-ab63-ede4e598dc85 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:27.074643 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-75fabe14-6ee1-4c78-ab63-ede4e598dc85 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:27.085101 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-75fabe14-6ee1-4c78-ab63-ede4e598dc85 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:27.085833 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-75fabe14-6ee1-4c78-ab63-ede4e598dc85 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:27.087064 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-75fabe14-6ee1-4c78-ab63-ede4e598dc85 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:27.087772 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-75fabe14-6ee1-4c78-ab63-ede4e598dc85 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:27.116646 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-75fabe14-6ee1-4c78-ab63-ede4e598dc85 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050160 Apr 05 12:05:27.117196 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1004/1986] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:27 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:28.132666 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8651e43e-c41a-49fc-8452-641b74b1759c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:28.134070 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8651e43e-c41a-49fc-8452-641b74b1759c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:28.144555 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8651e43e-c41a-49fc-8452-641b74b1759c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:28.145299 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8651e43e-c41a-49fc-8452-641b74b1759c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:28.146559 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8651e43e-c41a-49fc-8452-641b74b1759c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:28.147285 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8651e43e-c41a-49fc-8452-641b74b1759c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:28.177783 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8651e43e-c41a-49fc-8452-641b74b1759c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052207 Apr 05 12:05:28.178335 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 983/1987] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:28 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:29.195378 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1a37cb27-b22b-4a72-8ad4-87d1152fb2b6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:29.196776 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1a37cb27-b22b-4a72-8ad4-87d1152fb2b6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:29.203874 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a37cb27-b22b-4a72-8ad4-87d1152fb2b6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:29.204357 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a37cb27-b22b-4a72-8ad4-87d1152fb2b6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:29.205114 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a37cb27-b22b-4a72-8ad4-87d1152fb2b6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:29.205547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a37cb27-b22b-4a72-8ad4-87d1152fb2b6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:29.233885 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1a37cb27-b22b-4a72-8ad4-87d1152fb2b6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045355 Apr 05 12:05:29.234421 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1005/1988] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:29 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:30.249783 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bce48802-b8a5-4ffd-8302-46cb0d463651 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:30.251586 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bce48802-b8a5-4ffd-8302-46cb0d463651 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:30.262203 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bce48802-b8a5-4ffd-8302-46cb0d463651 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:30.262946 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bce48802-b8a5-4ffd-8302-46cb0d463651 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:30.264250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bce48802-b8a5-4ffd-8302-46cb0d463651 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:30.264977 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bce48802-b8a5-4ffd-8302-46cb0d463651 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:30.299155 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bce48802-b8a5-4ffd-8302-46cb0d463651 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056149 Apr 05 12:05:30.299709 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 984/1989] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:30 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:31.314549 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4a32308b-43a0-4f37-bc03-e598dbfdf627 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:31.316065 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4a32308b-43a0-4f37-bc03-e598dbfdf627 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:31.325344 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a32308b-43a0-4f37-bc03-e598dbfdf627 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:31.325783 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a32308b-43a0-4f37-bc03-e598dbfdf627 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:31.326542 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a32308b-43a0-4f37-bc03-e598dbfdf627 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:31.326969 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a32308b-43a0-4f37-bc03-e598dbfdf627 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:31.355138 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4a32308b-43a0-4f37-bc03-e598dbfdf627 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047363 Apr 05 12:05:31.355679 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1006/1990] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:31 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:32.373156 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8b955692-cb11-4f7c-97ec-da8930848175 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:32.374657 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8b955692-cb11-4f7c-97ec-da8930848175 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:32.385899 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8b955692-cb11-4f7c-97ec-da8930848175 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:32.386711 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8b955692-cb11-4f7c-97ec-da8930848175 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:32.388135 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8b955692-cb11-4f7c-97ec-da8930848175 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:32.388876 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8b955692-cb11-4f7c-97ec-da8930848175 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:32.423897 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8b955692-cb11-4f7c-97ec-da8930848175 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056727 Apr 05 12:05:32.423897 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 985/1991] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:32 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:33.438938 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-42dff42b-ee67-4a3b-b2c6-5a98d043346b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:33.440373 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-42dff42b-ee67-4a3b-b2c6-5a98d043346b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:33.449895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-42dff42b-ee67-4a3b-b2c6-5a98d043346b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:33.450342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-42dff42b-ee67-4a3b-b2c6-5a98d043346b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:33.451104 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-42dff42b-ee67-4a3b-b2c6-5a98d043346b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:33.451532 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-42dff42b-ee67-4a3b-b2c6-5a98d043346b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:33.482083 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-42dff42b-ee67-4a3b-b2c6-5a98d043346b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049930 Apr 05 12:05:33.482628 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1007/1992] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:33 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:34.495602 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d580f333-40bb-46a4-8107-2fba82ce0f79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:34.497044 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d580f333-40bb-46a4-8107-2fba82ce0f79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:34.507524 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d580f333-40bb-46a4-8107-2fba82ce0f79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:34.508322 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d580f333-40bb-46a4-8107-2fba82ce0f79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:34.509561 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d580f333-40bb-46a4-8107-2fba82ce0f79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:34.510228 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d580f333-40bb-46a4-8107-2fba82ce0f79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:34.538808 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d580f333-40bb-46a4-8107-2fba82ce0f79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048853 Apr 05 12:05:34.539361 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 986/1993] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:34 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:35.550864 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e54134ee-9389-45e7-b992-2afb0ebe6adb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:35.551842 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e54134ee-9389-45e7-b992-2afb0ebe6adb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:35.558672 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e54134ee-9389-45e7-b992-2afb0ebe6adb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:35.559116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e54134ee-9389-45e7-b992-2afb0ebe6adb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:35.559870 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e54134ee-9389-45e7-b992-2afb0ebe6adb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:35.560343 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e54134ee-9389-45e7-b992-2afb0ebe6adb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:35.589020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e54134ee-9389-45e7-b992-2afb0ebe6adb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042059 Apr 05 12:05:35.589550 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1008/1994] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:35 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:36.605134 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b8e85d36-ae9c-4d4a-8b06-a5280f0efaf5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:36.606320 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b8e85d36-ae9c-4d4a-8b06-a5280f0efaf5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:36.614918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b8e85d36-ae9c-4d4a-8b06-a5280f0efaf5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:36.615512 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b8e85d36-ae9c-4d4a-8b06-a5280f0efaf5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:36.616584 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b8e85d36-ae9c-4d4a-8b06-a5280f0efaf5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:36.617164 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b8e85d36-ae9c-4d4a-8b06-a5280f0efaf5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:36.650667 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b8e85d36-ae9c-4d4a-8b06-a5280f0efaf5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052401 Apr 05 12:05:36.651213 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 987/1995] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:36 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:37.666268 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3eb711ac-8db0-46db-82fb-fd1e01838bf1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:37.667623 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3eb711ac-8db0-46db-82fb-fd1e01838bf1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:37.678286 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3eb711ac-8db0-46db-82fb-fd1e01838bf1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:37.679065 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3eb711ac-8db0-46db-82fb-fd1e01838bf1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:37.680387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3eb711ac-8db0-46db-82fb-fd1e01838bf1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:37.681130 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3eb711ac-8db0-46db-82fb-fd1e01838bf1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:37.710472 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3eb711ac-8db0-46db-82fb-fd1e01838bf1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050930 Apr 05 12:05:37.711034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1009/1996] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:37 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:38.726898 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8c811c25-feb6-4e6e-b8e5-380ebcdcbd78 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:38.728532 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8c811c25-feb6-4e6e-b8e5-380ebcdcbd78 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:38.735604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c811c25-feb6-4e6e-b8e5-380ebcdcbd78 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:38.736055 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c811c25-feb6-4e6e-b8e5-380ebcdcbd78 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:38.736869 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c811c25-feb6-4e6e-b8e5-380ebcdcbd78 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:38.737300 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c811c25-feb6-4e6e-b8e5-380ebcdcbd78 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:38.766121 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8c811c25-feb6-4e6e-b8e5-380ebcdcbd78 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046241 Apr 05 12:05:38.766668 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 988/1997] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:38 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:39.781915 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ab89983f-182b-4c1f-b76b-c83d8ac107a4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:39.783380 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ab89983f-182b-4c1f-b76b-c83d8ac107a4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:39.793100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ab89983f-182b-4c1f-b76b-c83d8ac107a4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:39.793542 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ab89983f-182b-4c1f-b76b-c83d8ac107a4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:39.794292 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ab89983f-182b-4c1f-b76b-c83d8ac107a4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:39.794715 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ab89983f-182b-4c1f-b76b-c83d8ac107a4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:39.822794 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ab89983f-182b-4c1f-b76b-c83d8ac107a4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047568 Apr 05 12:05:39.823337 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1010/1998] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:39 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:40.838982 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e0eb605f-c253-4362-a8de-72807f51ca1c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:40.840287 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e0eb605f-c253-4362-a8de-72807f51ca1c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:40.848443 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0eb605f-c253-4362-a8de-72807f51ca1c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:40.849004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0eb605f-c253-4362-a8de-72807f51ca1c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:40.849950 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0eb605f-c253-4362-a8de-72807f51ca1c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:40.850492 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0eb605f-c253-4362-a8de-72807f51ca1c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:40.883687 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e0eb605f-c253-4362-a8de-72807f51ca1c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051620 Apr 05 12:05:40.884280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 989/1999] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:40 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:41.900734 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4406c484-48f9-4bc4-b3e5-3e774281b704 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:41.902089 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4406c484-48f9-4bc4-b3e5-3e774281b704 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:41.912803 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4406c484-48f9-4bc4-b3e5-3e774281b704 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:41.913537 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4406c484-48f9-4bc4-b3e5-3e774281b704 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:41.914827 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4406c484-48f9-4bc4-b3e5-3e774281b704 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:41.915542 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4406c484-48f9-4bc4-b3e5-3e774281b704 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:41.945138 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4406c484-48f9-4bc4-b3e5-3e774281b704 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051306 Apr 05 12:05:41.945681 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1011/2000] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:41 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:42.958489 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bbf5297b-c300-47bf-9e95-ac5208a9625a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:42.959602 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bbf5297b-c300-47bf-9e95-ac5208a9625a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:42.967248 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bbf5297b-c300-47bf-9e95-ac5208a9625a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:42.967692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bbf5297b-c300-47bf-9e95-ac5208a9625a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:42.968482 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bbf5297b-c300-47bf-9e95-ac5208a9625a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:42.968918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bbf5297b-c300-47bf-9e95-ac5208a9625a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:42.997559 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bbf5297b-c300-47bf-9e95-ac5208a9625a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044070 Apr 05 12:05:42.998097 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 990/2001] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:42 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:44.013825 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c08baffe-0906-4bef-8ddf-8100d60d4db3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:44.015282 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c08baffe-0906-4bef-8ddf-8100d60d4db3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:44.025979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c08baffe-0906-4bef-8ddf-8100d60d4db3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:44.026733 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c08baffe-0906-4bef-8ddf-8100d60d4db3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:44.027987 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c08baffe-0906-4bef-8ddf-8100d60d4db3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:44.028775 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c08baffe-0906-4bef-8ddf-8100d60d4db3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:44.063307 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c08baffe-0906-4bef-8ddf-8100d60d4db3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056545 Apr 05 12:05:44.063854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1012/2002] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:44 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:45.078646 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-351b651b-c7ba-4a26-9911-2c3447fafda8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:45.080014 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-351b651b-c7ba-4a26-9911-2c3447fafda8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:45.090511 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-351b651b-c7ba-4a26-9911-2c3447fafda8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:45.091411 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-351b651b-c7ba-4a26-9911-2c3447fafda8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:45.092187 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-351b651b-c7ba-4a26-9911-2c3447fafda8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:45.092618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-351b651b-c7ba-4a26-9911-2c3447fafda8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:45.120931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-351b651b-c7ba-4a26-9911-2c3447fafda8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049017 Apr 05 12:05:45.121462 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 991/2003] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:45 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:46.136497 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f9de2d59-17a3-4c7c-96f3-9752622ba69d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:46.137837 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f9de2d59-17a3-4c7c-96f3-9752622ba69d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:46.144797 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9de2d59-17a3-4c7c-96f3-9752622ba69d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:46.145248 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9de2d59-17a3-4c7c-96f3-9752622ba69d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:46.146004 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9de2d59-17a3-4c7c-96f3-9752622ba69d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:46.146435 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9de2d59-17a3-4c7c-96f3-9752622ba69d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:46.177060 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f9de2d59-17a3-4c7c-96f3-9752622ba69d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047424 Apr 05 12:05:46.177609 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1013/2004] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:46 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:47.193177 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4b9cb859-8005-4154-afe0-af657a2f06e1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:47.194664 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4b9cb859-8005-4154-afe0-af657a2f06e1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:47.203777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4b9cb859-8005-4154-afe0-af657a2f06e1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:47.204269 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4b9cb859-8005-4154-afe0-af657a2f06e1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:47.205075 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4b9cb859-8005-4154-afe0-af657a2f06e1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:47.205542 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4b9cb859-8005-4154-afe0-af657a2f06e1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:47.236271 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4b9cb859-8005-4154-afe0-af657a2f06e1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049790 Apr 05 12:05:47.236823 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 992/2005] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:47 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:48.248794 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8e456607-a495-475f-965f-e33830310dbd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:48.249716 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8e456607-a495-475f-965f-e33830310dbd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:48.256750 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e456607-a495-475f-965f-e33830310dbd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:48.257189 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e456607-a495-475f-965f-e33830310dbd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:48.257949 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e456607-a495-475f-965f-e33830310dbd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:48.258521 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e456607-a495-475f-965f-e33830310dbd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:48.287655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8e456607-a495-475f-965f-e33830310dbd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042920 Apr 05 12:05:48.288231 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1014/2006] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:48 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:49.299826 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-81840ddc-19bd-4f85-b280-0ec5c3e3b9b6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:49.301129 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-81840ddc-19bd-4f85-b280-0ec5c3e3b9b6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:49.313873 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-81840ddc-19bd-4f85-b280-0ec5c3e3b9b6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:49.314675 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-81840ddc-19bd-4f85-b280-0ec5c3e3b9b6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:49.315554 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-81840ddc-19bd-4f85-b280-0ec5c3e3b9b6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:49.315989 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-81840ddc-19bd-4f85-b280-0ec5c3e3b9b6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:49.355249 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-81840ddc-19bd-4f85-b280-0ec5c3e3b9b6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058984 Apr 05 12:05:49.356543 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 993/2007] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:49 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:50.368774 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-00256861-86b7-4e03-a4b9-f0bd7878a5cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:50.369600 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-00256861-86b7-4e03-a4b9-f0bd7878a5cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:50.376564 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-00256861-86b7-4e03-a4b9-f0bd7878a5cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:50.377322 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-00256861-86b7-4e03-a4b9-f0bd7878a5cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:50.378230 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-00256861-86b7-4e03-a4b9-f0bd7878a5cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:50.378527 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-00256861-86b7-4e03-a4b9-f0bd7878a5cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:50.413220 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-00256861-86b7-4e03-a4b9-f0bd7878a5cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048917 Apr 05 12:05:50.413783 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1015/2008] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:50 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:51.425424 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-85d3adf7-260e-43d3-b7bd-cdc209707387 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:51.426278 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-85d3adf7-260e-43d3-b7bd-cdc209707387 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:51.433312 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85d3adf7-260e-43d3-b7bd-cdc209707387 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:51.433773 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85d3adf7-260e-43d3-b7bd-cdc209707387 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:51.434554 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85d3adf7-260e-43d3-b7bd-cdc209707387 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:51.434996 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85d3adf7-260e-43d3-b7bd-cdc209707387 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:51.465700 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-85d3adf7-260e-43d3-b7bd-cdc209707387 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044418 Apr 05 12:05:51.467425 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 994/2009] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:51 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:52.479075 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7ea9c492-8209-47f9-9cb4-9025a79c6e81 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:52.479997 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7ea9c492-8209-47f9-9cb4-9025a79c6e81 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:52.488315 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7ea9c492-8209-47f9-9cb4-9025a79c6e81 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:52.488798 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7ea9c492-8209-47f9-9cb4-9025a79c6e81 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:52.489604 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7ea9c492-8209-47f9-9cb4-9025a79c6e81 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:52.490044 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7ea9c492-8209-47f9-9cb4-9025a79c6e81 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:52.521261 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7ea9c492-8209-47f9-9cb4-9025a79c6e81 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046286 Apr 05 12:05:52.521831 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1016/2010] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:52 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:53.536855 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8f5869de-ae87-489a-9731-a516c4880bbd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:53.538277 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8f5869de-ae87-489a-9731-a516c4880bbd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:53.549116 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f5869de-ae87-489a-9731-a516c4880bbd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:53.549857 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f5869de-ae87-489a-9731-a516c4880bbd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:53.551181 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f5869de-ae87-489a-9731-a516c4880bbd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:53.551914 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f5869de-ae87-489a-9731-a516c4880bbd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:53.584309 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8f5869de-ae87-489a-9731-a516c4880bbd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054441 Apr 05 12:05:53.584857 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 995/2011] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:53 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:54.600244 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b4c63c7f-c296-4e7a-b8e6-7077fda61f1f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:54.601596 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b4c63c7f-c296-4e7a-b8e6-7077fda61f1f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:54.611397 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b4c63c7f-c296-4e7a-b8e6-7077fda61f1f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:54.611845 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b4c63c7f-c296-4e7a-b8e6-7077fda61f1f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:54.612698 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b4c63c7f-c296-4e7a-b8e6-7077fda61f1f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:54.613130 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b4c63c7f-c296-4e7a-b8e6-7077fda61f1f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:54.642558 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b4c63c7f-c296-4e7a-b8e6-7077fda61f1f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049468 Apr 05 12:05:54.643121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1017/2012] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:54 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:55.660733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-54601a18-0147-4092-b4d1-b79293be0aff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:55.662082 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-54601a18-0147-4092-b4d1-b79293be0aff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:55.672339 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54601a18-0147-4092-b4d1-b79293be0aff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:55.673085 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54601a18-0147-4092-b4d1-b79293be0aff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:55.674333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54601a18-0147-4092-b4d1-b79293be0aff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:55.675018 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54601a18-0147-4092-b4d1-b79293be0aff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:55.709672 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-54601a18-0147-4092-b4d1-b79293be0aff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056275 Apr 05 12:05:55.710229 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 996/2013] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:55 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:56.725774 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-38f9888b-0ac9-4fd0-bea4-0801edb90f50 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:56.727265 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-38f9888b-0ac9-4fd0-bea4-0801edb90f50 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:56.737275 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-38f9888b-0ac9-4fd0-bea4-0801edb90f50 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:56.737721 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-38f9888b-0ac9-4fd0-bea4-0801edb90f50 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:56.738485 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-38f9888b-0ac9-4fd0-bea4-0801edb90f50 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:56.738943 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-38f9888b-0ac9-4fd0-bea4-0801edb90f50 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:56.768425 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-38f9888b-0ac9-4fd0-bea4-0801edb90f50 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049497 Apr 05 12:05:56.768979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1018/2014] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:56 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:57.780417 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a163de55-c77f-47cf-9ed1-943757366188 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:57.781331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a163de55-c77f-47cf-9ed1-943757366188 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:57.788182 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a163de55-c77f-47cf-9ed1-943757366188 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:57.788634 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a163de55-c77f-47cf-9ed1-943757366188 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:57.789398 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a163de55-c77f-47cf-9ed1-943757366188 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:57.789870 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a163de55-c77f-47cf-9ed1-943757366188 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:57.819002 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a163de55-c77f-47cf-9ed1-943757366188 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042647 Apr 05 12:05:57.819878 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 997/2015] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:57 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:58.835328 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9c623be9-e987-4472-b925-73338cad7cf0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:58.836699 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9c623be9-e987-4472-b925-73338cad7cf0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:58.847272 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9c623be9-e987-4472-b925-73338cad7cf0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:58.848019 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9c623be9-e987-4472-b925-73338cad7cf0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:58.849301 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9c623be9-e987-4472-b925-73338cad7cf0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:58.850006 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9c623be9-e987-4472-b925-73338cad7cf0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:58.884477 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9c623be9-e987-4472-b925-73338cad7cf0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055981 Apr 05 12:05:58.885014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1019/2016] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:58 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:05:59.900203 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c5b1f049-bb02-40c7-9d2d-662061d0824e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:05:59.901603 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c5b1f049-bb02-40c7-9d2d-662061d0824e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:05:59.910683 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c5b1f049-bb02-40c7-9d2d-662061d0824e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:59.911134 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c5b1f049-bb02-40c7-9d2d-662061d0824e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:59.911885 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c5b1f049-bb02-40c7-9d2d-662061d0824e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:05:59.912419 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c5b1f049-bb02-40c7-9d2d-662061d0824e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:05:59.940584 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c5b1f049-bb02-40c7-9d2d-662061d0824e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047131 Apr 05 12:05:59.941129 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 998/2017] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:05:59 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:00.956276 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4d2606c5-da13-4b2e-98fc-d76362a6fc16 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:00.957743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4d2606c5-da13-4b2e-98fc-d76362a6fc16 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:00.968338 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4d2606c5-da13-4b2e-98fc-d76362a6fc16 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:00.969072 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4d2606c5-da13-4b2e-98fc-d76362a6fc16 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:00.970317 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4d2606c5-da13-4b2e-98fc-d76362a6fc16 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:00.970906 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4d2606c5-da13-4b2e-98fc-d76362a6fc16 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:00.999701 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4d2606c5-da13-4b2e-98fc-d76362a6fc16 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049934 Apr 05 12:06:01.000194 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1020/2018] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:00 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:02.016015 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f79b6dc2-40b4-4980-9555-780b9fed652a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:02.017533 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f79b6dc2-40b4-4980-9555-780b9fed652a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:02.025281 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f79b6dc2-40b4-4980-9555-780b9fed652a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:02.025803 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f79b6dc2-40b4-4980-9555-780b9fed652a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:02.026690 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f79b6dc2-40b4-4980-9555-780b9fed652a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:02.027189 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f79b6dc2-40b4-4980-9555-780b9fed652a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:02.058092 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f79b6dc2-40b4-4980-9555-780b9fed652a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048795 Apr 05 12:06:02.058634 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 999/2019] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:02 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:03.075817 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f9d497da-e13d-4803-8050-7326bced2319 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:03.077236 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f9d497da-e13d-4803-8050-7326bced2319 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:03.087641 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9d497da-e13d-4803-8050-7326bced2319 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:03.088438 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9d497da-e13d-4803-8050-7326bced2319 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:03.089686 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9d497da-e13d-4803-8050-7326bced2319 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:03.090424 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9d497da-e13d-4803-8050-7326bced2319 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:03.121416 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f9d497da-e13d-4803-8050-7326bced2319 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052343 Apr 05 12:06:03.121960 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1021/2020] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:03 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:04.138041 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-46bedbb6-faf6-4b41-b7d1-e79c169291e8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:04.139447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-46bedbb6-faf6-4b41-b7d1-e79c169291e8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:04.147321 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-46bedbb6-faf6-4b41-b7d1-e79c169291e8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:04.147764 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-46bedbb6-faf6-4b41-b7d1-e79c169291e8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:04.148576 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-46bedbb6-faf6-4b41-b7d1-e79c169291e8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:04.149013 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-46bedbb6-faf6-4b41-b7d1-e79c169291e8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:04.177692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-46bedbb6-faf6-4b41-b7d1-e79c169291e8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046473 Apr 05 12:06:04.178250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1000/2021] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:04 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:04.644698 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:06:04.645093 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Tue Apr 5 12:06:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:06:05.193716 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-404d806a-11d3-4010-bbf7-556cc2a6c80a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:05.195066 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-404d806a-11d3-4010-bbf7-556cc2a6c80a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:05.205666 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-404d806a-11d3-4010-bbf7-556cc2a6c80a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:05.206415 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-404d806a-11d3-4010-bbf7-556cc2a6c80a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:05.207675 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-404d806a-11d3-4010-bbf7-556cc2a6c80a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:05.208479 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-404d806a-11d3-4010-bbf7-556cc2a6c80a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:05.241909 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-404d806a-11d3-4010-bbf7-556cc2a6c80a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055044 Apr 05 12:06:05.242461 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1022/2022] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:05 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:06.254850 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3ba7074b-d9e1-41da-89b9-9fd89b915bbf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:06.255770 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3ba7074b-d9e1-41da-89b9-9fd89b915bbf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:06.262724 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3ba7074b-d9e1-41da-89b9-9fd89b915bbf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:06.263179 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3ba7074b-d9e1-41da-89b9-9fd89b915bbf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:06.263950 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3ba7074b-d9e1-41da-89b9-9fd89b915bbf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:06.264435 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3ba7074b-d9e1-41da-89b9-9fd89b915bbf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:06.293976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3ba7074b-d9e1-41da-89b9-9fd89b915bbf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043514 Apr 05 12:06:06.294540 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1001/2023] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:06 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:07.305951 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7b96a768-2973-45e9-94e1-a0a467ba7e6f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:07.306803 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7b96a768-2973-45e9-94e1-a0a467ba7e6f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:07.313099 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b96a768-2973-45e9-94e1-a0a467ba7e6f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:07.313538 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b96a768-2973-45e9-94e1-a0a467ba7e6f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:07.314314 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b96a768-2973-45e9-94e1-a0a467ba7e6f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:07.314738 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b96a768-2973-45e9-94e1-a0a467ba7e6f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:07.343140 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7b96a768-2973-45e9-94e1-a0a467ba7e6f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041128 Apr 05 12:06:07.343643 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1023/2024] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:07 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:08.355592 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3bb58e26-e352-4327-aaab-cb74b1f50c69 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:08.356276 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3bb58e26-e352-4327-aaab-cb74b1f50c69 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:08.363043 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3bb58e26-e352-4327-aaab-cb74b1f50c69 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:08.363486 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3bb58e26-e352-4327-aaab-cb74b1f50c69 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:08.364303 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3bb58e26-e352-4327-aaab-cb74b1f50c69 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:08.364737 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3bb58e26-e352-4327-aaab-cb74b1f50c69 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:08.393907 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3bb58e26-e352-4327-aaab-cb74b1f50c69 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042577 Apr 05 12:06:08.394475 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1002/2025] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:08 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:09.409923 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a8a426b7-c93a-40cb-ac2c-19b5dcfaa218 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:09.411443 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a8a426b7-c93a-40cb-ac2c-19b5dcfaa218 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:09.422278 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a8a426b7-c93a-40cb-ac2c-19b5dcfaa218 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:09.423013 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a8a426b7-c93a-40cb-ac2c-19b5dcfaa218 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:09.424371 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a8a426b7-c93a-40cb-ac2c-19b5dcfaa218 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:09.424774 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a8a426b7-c93a-40cb-ac2c-19b5dcfaa218 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:09.456282 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a8a426b7-c93a-40cb-ac2c-19b5dcfaa218 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052956 Apr 05 12:06:09.456817 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1024/2026] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:09 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:10.468839 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-03b1fee0-12a5-46c5-a4b7-eef58cda638a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:10.469762 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-03b1fee0-12a5-46c5-a4b7-eef58cda638a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:10.476696 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03b1fee0-12a5-46c5-a4b7-eef58cda638a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:10.477147 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03b1fee0-12a5-46c5-a4b7-eef58cda638a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:10.477903 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03b1fee0-12a5-46c5-a4b7-eef58cda638a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:10.478333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03b1fee0-12a5-46c5-a4b7-eef58cda638a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:10.508342 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-03b1fee0-12a5-46c5-a4b7-eef58cda638a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043499 Apr 05 12:06:10.508924 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1003/2027] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:10 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:11.521198 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-312a43c5-4ae0-4360-afba-89f737b9ca7c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:11.522111 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-312a43c5-4ae0-4360-afba-89f737b9ca7c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:11.529152 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-312a43c5-4ae0-4360-afba-89f737b9ca7c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:11.529576 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-312a43c5-4ae0-4360-afba-89f737b9ca7c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:11.530360 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-312a43c5-4ae0-4360-afba-89f737b9ca7c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:11.530795 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-312a43c5-4ae0-4360-afba-89f737b9ca7c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:11.562097 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-312a43c5-4ae0-4360-afba-89f737b9ca7c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045165 Apr 05 12:06:11.562660 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1025/2028] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:11 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:12.573999 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-83996372-e5b3-4371-ba7a-2716c4bd6f28 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:12.574915 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-83996372-e5b3-4371-ba7a-2716c4bd6f28 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:12.581390 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-83996372-e5b3-4371-ba7a-2716c4bd6f28 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:12.581838 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-83996372-e5b3-4371-ba7a-2716c4bd6f28 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:12.582577 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-83996372-e5b3-4371-ba7a-2716c4bd6f28 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:12.583014 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-83996372-e5b3-4371-ba7a-2716c4bd6f28 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:12.612113 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-83996372-e5b3-4371-ba7a-2716c4bd6f28 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042146 Apr 05 12:06:12.612670 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1004/2029] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:12 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:13.857167 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3b1ef870-cf21-4ad8-b3dc-cc653d4150cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:13.858076 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3b1ef870-cf21-4ad8-b3dc-cc653d4150cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:13.864667 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b1ef870-cf21-4ad8-b3dc-cc653d4150cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:13.865116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b1ef870-cf21-4ad8-b3dc-cc653d4150cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:13.865878 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b1ef870-cf21-4ad8-b3dc-cc653d4150cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:13.866309 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b1ef870-cf21-4ad8-b3dc-cc653d4150cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:13.895505 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3b1ef870-cf21-4ad8-b3dc-cc653d4150cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.275155 Apr 05 12:06:13.896053 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1026/2030] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:13 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:14.205185 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:06:14.205487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Tue Apr 5 12:06:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:06:14.910323 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3d166e12-edb3-4029-8205-83a0ca2f8f22 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:14.911233 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3d166e12-edb3-4029-8205-83a0ca2f8f22 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:14.917827 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3d166e12-edb3-4029-8205-83a0ca2f8f22 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:14.918272 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3d166e12-edb3-4029-8205-83a0ca2f8f22 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:14.919028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3d166e12-edb3-4029-8205-83a0ca2f8f22 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:14.919455 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3d166e12-edb3-4029-8205-83a0ca2f8f22 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:14.948064 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3d166e12-edb3-4029-8205-83a0ca2f8f22 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043404 Apr 05 12:06:14.948647 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1005/2031] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:14 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:15.963279 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c7640e10-200f-42cc-b7b0-39d71c6d22ff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:15.964796 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c7640e10-200f-42cc-b7b0-39d71c6d22ff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:15.973738 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c7640e10-200f-42cc-b7b0-39d71c6d22ff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:15.974191 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c7640e10-200f-42cc-b7b0-39d71c6d22ff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:15.974953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c7640e10-200f-42cc-b7b0-39d71c6d22ff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:15.975389 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c7640e10-200f-42cc-b7b0-39d71c6d22ff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:16.005293 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c7640e10-200f-42cc-b7b0-39d71c6d22ff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048559 Apr 05 12:06:16.005776 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1027/2032] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:15 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:17.017415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3000d748-bd8b-4056-bf21-a369c7872551 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:17.018325 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3000d748-bd8b-4056-bf21-a369c7872551 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:17.024978 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3000d748-bd8b-4056-bf21-a369c7872551 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:17.025432 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3000d748-bd8b-4056-bf21-a369c7872551 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:17.026195 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3000d748-bd8b-4056-bf21-a369c7872551 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:17.026634 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3000d748-bd8b-4056-bf21-a369c7872551 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:17.055623 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3000d748-bd8b-4056-bf21-a369c7872551 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042402 Apr 05 12:06:17.056203 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1006/2033] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:17 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:17.091717 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:06:17.092235 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Tue Apr 5 12:06:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:06:18.068860 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3cc09b7f-222d-4329-9df2-1154bd1485ee tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:18.069805 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3cc09b7f-222d-4329-9df2-1154bd1485ee tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:18.077316 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3cc09b7f-222d-4329-9df2-1154bd1485ee tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:18.077816 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3cc09b7f-222d-4329-9df2-1154bd1485ee tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:18.078687 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3cc09b7f-222d-4329-9df2-1154bd1485ee tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:18.079159 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3cc09b7f-222d-4329-9df2-1154bd1485ee tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:18.109651 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3cc09b7f-222d-4329-9df2-1154bd1485ee tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046048 Apr 05 12:06:18.110242 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1028/2034] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:18 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:19.122368 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-56a6baea-dd5e-4f62-90e3-7a9a7cb49810 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:19.123292 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-56a6baea-dd5e-4f62-90e3-7a9a7cb49810 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:19.131381 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56a6baea-dd5e-4f62-90e3-7a9a7cb49810 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:19.131988 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56a6baea-dd5e-4f62-90e3-7a9a7cb49810 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:19.132877 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56a6baea-dd5e-4f62-90e3-7a9a7cb49810 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:19.133468 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56a6baea-dd5e-4f62-90e3-7a9a7cb49810 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:19.175249 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-56a6baea-dd5e-4f62-90e3-7a9a7cb49810 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057750 Apr 05 12:06:19.175788 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1007/2035] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:19 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:20.190715 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-75fa609c-52ad-47f9-bea9-dce7db45dd54 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:20.191624 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-75fa609c-52ad-47f9-bea9-dce7db45dd54 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:20.198353 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-75fa609c-52ad-47f9-bea9-dce7db45dd54 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:20.198782 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-75fa609c-52ad-47f9-bea9-dce7db45dd54 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:20.199540 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-75fa609c-52ad-47f9-bea9-dce7db45dd54 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:20.199971 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-75fa609c-52ad-47f9-bea9-dce7db45dd54 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:20.228838 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-75fa609c-52ad-47f9-bea9-dce7db45dd54 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044477 Apr 05 12:06:20.229389 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1029/2036] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:20 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:21.243997 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f920d39a-7c7e-45c5-9932-f18e900036e8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:21.245518 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f920d39a-7c7e-45c5-9932-f18e900036e8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:21.254935 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f920d39a-7c7e-45c5-9932-f18e900036e8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:21.255379 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f920d39a-7c7e-45c5-9932-f18e900036e8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:21.256162 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f920d39a-7c7e-45c5-9932-f18e900036e8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:21.256617 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f920d39a-7c7e-45c5-9932-f18e900036e8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:21.286136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f920d39a-7c7e-45c5-9932-f18e900036e8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048589 Apr 05 12:06:21.286689 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1008/2037] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:21 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:22.299636 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-03f0f96f-9d31-4207-87b3-3eaefc8bfd6e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:22.301008 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-03f0f96f-9d31-4207-87b3-3eaefc8bfd6e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:22.309698 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-03f0f96f-9d31-4207-87b3-3eaefc8bfd6e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:22.310329 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-03f0f96f-9d31-4207-87b3-3eaefc8bfd6e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:22.311343 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-03f0f96f-9d31-4207-87b3-3eaefc8bfd6e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:22.311925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-03f0f96f-9d31-4207-87b3-3eaefc8bfd6e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:22.345827 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-03f0f96f-9d31-4207-87b3-3eaefc8bfd6e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050347 Apr 05 12:06:22.346372 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1030/2038] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:22 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:23.361167 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-86c35344-2925-4dc5-a6be-b2d23db55f06 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:23.362702 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-86c35344-2925-4dc5-a6be-b2d23db55f06 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:23.373855 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86c35344-2925-4dc5-a6be-b2d23db55f06 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:23.374689 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86c35344-2925-4dc5-a6be-b2d23db55f06 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:23.375969 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86c35344-2925-4dc5-a6be-b2d23db55f06 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:23.376767 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86c35344-2925-4dc5-a6be-b2d23db55f06 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:23.407063 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-86c35344-2925-4dc5-a6be-b2d23db55f06 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052925 Apr 05 12:06:23.407607 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1009/2039] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:23 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:24.277502 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:06:24.277999 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Tue Apr 5 12:06:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:06:24.419245 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-64c73d32-dd34-4e08-a027-6165752c1d44 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:24.420193 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-64c73d32-dd34-4e08-a027-6165752c1d44 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:24.427091 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-64c73d32-dd34-4e08-a027-6165752c1d44 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:24.427542 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-64c73d32-dd34-4e08-a027-6165752c1d44 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:24.428345 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-64c73d32-dd34-4e08-a027-6165752c1d44 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:24.428777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-64c73d32-dd34-4e08-a027-6165752c1d44 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:24.459313 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-64c73d32-dd34-4e08-a027-6165752c1d44 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044220 Apr 05 12:06:24.459880 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1031/2040] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:24 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:25.471627 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4679a6dd-48fa-4de9-9047-b252499e4eda tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:25.472563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4679a6dd-48fa-4de9-9047-b252499e4eda tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:25.478992 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4679a6dd-48fa-4de9-9047-b252499e4eda tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:25.479440 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4679a6dd-48fa-4de9-9047-b252499e4eda tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:25.480237 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4679a6dd-48fa-4de9-9047-b252499e4eda tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:25.480774 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4679a6dd-48fa-4de9-9047-b252499e4eda tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:25.510558 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4679a6dd-48fa-4de9-9047-b252499e4eda tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043203 Apr 05 12:06:25.511110 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1010/2041] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:25 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:26.522377 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-735d28b3-2ab7-4d78-ab7f-e239e6545615 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:26.523283 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-735d28b3-2ab7-4d78-ab7f-e239e6545615 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:26.529881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-735d28b3-2ab7-4d78-ab7f-e239e6545615 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:26.530327 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-735d28b3-2ab7-4d78-ab7f-e239e6545615 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:26.531073 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-735d28b3-2ab7-4d78-ab7f-e239e6545615 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:26.531498 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-735d28b3-2ab7-4d78-ab7f-e239e6545615 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:26.560190 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-735d28b3-2ab7-4d78-ab7f-e239e6545615 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041710 Apr 05 12:06:26.560723 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1032/2042] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:26 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:27.572538 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a96ca5be-de66-46f2-a28e-202cf2c501f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:27.573463 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a96ca5be-de66-46f2-a28e-202cf2c501f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:27.581979 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a96ca5be-de66-46f2-a28e-202cf2c501f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:27.582573 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a96ca5be-de66-46f2-a28e-202cf2c501f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:27.583647 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a96ca5be-de66-46f2-a28e-202cf2c501f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:27.584157 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a96ca5be-de66-46f2-a28e-202cf2c501f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:27.619889 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a96ca5be-de66-46f2-a28e-202cf2c501f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051434 Apr 05 12:06:27.620471 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1011/2043] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:27 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:28.635909 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b25e59ed-5610-4719-b8a7-acb7d1e85df0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:28.637469 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b25e59ed-5610-4719-b8a7-acb7d1e85df0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:28.648192 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b25e59ed-5610-4719-b8a7-acb7d1e85df0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:28.648973 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b25e59ed-5610-4719-b8a7-acb7d1e85df0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:28.650239 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b25e59ed-5610-4719-b8a7-acb7d1e85df0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:28.650953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b25e59ed-5610-4719-b8a7-acb7d1e85df0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:28.681052 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b25e59ed-5610-4719-b8a7-acb7d1e85df0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051553 Apr 05 12:06:28.681589 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1033/2044] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:28 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:29.692957 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a10b4e2e-df3b-4f49-81ef-5364709c9699 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:29.693837 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a10b4e2e-df3b-4f49-81ef-5364709c9699 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:29.700342 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a10b4e2e-df3b-4f49-81ef-5364709c9699 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:29.700790 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a10b4e2e-df3b-4f49-81ef-5364709c9699 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:29.701543 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a10b4e2e-df3b-4f49-81ef-5364709c9699 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:29.701968 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a10b4e2e-df3b-4f49-81ef-5364709c9699 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:29.729853 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a10b4e2e-df3b-4f49-81ef-5364709c9699 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041082 Apr 05 12:06:29.730388 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1012/2045] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:29 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:30.742603 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9dd534e3-a570-45c1-aa4f-093013f18617 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:30.743516 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9dd534e3-a570-45c1-aa4f-093013f18617 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:30.750129 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9dd534e3-a570-45c1-aa4f-093013f18617 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:30.750570 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9dd534e3-a570-45c1-aa4f-093013f18617 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:30.751295 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9dd534e3-a570-45c1-aa4f-093013f18617 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:30.751746 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9dd534e3-a570-45c1-aa4f-093013f18617 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:30.782558 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9dd534e3-a570-45c1-aa4f-093013f18617 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043937 Apr 05 12:06:30.783088 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1034/2046] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:30 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:31.797180 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4273d153-8d05-4c1b-b12c-33e32d8dcd00 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:31.798157 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4273d153-8d05-4c1b-b12c-33e32d8dcd00 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:31.804885 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4273d153-8d05-4c1b-b12c-33e32d8dcd00 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:31.805333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4273d153-8d05-4c1b-b12c-33e32d8dcd00 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:31.806141 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4273d153-8d05-4c1b-b12c-33e32d8dcd00 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:31.806570 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4273d153-8d05-4c1b-b12c-33e32d8dcd00 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:31.835434 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4273d153-8d05-4c1b-b12c-33e32d8dcd00 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042615 Apr 05 12:06:31.835988 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1013/2047] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:31 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:32.847411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-69b409c8-5faf-4dc0-8871-21cdb8af503c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:32.848380 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-69b409c8-5faf-4dc0-8871-21cdb8af503c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:32.854989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-69b409c8-5faf-4dc0-8871-21cdb8af503c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:32.855436 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-69b409c8-5faf-4dc0-8871-21cdb8af503c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:32.856459 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-69b409c8-5faf-4dc0-8871-21cdb8af503c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:32.856895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-69b409c8-5faf-4dc0-8871-21cdb8af503c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:32.886517 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-69b409c8-5faf-4dc0-8871-21cdb8af503c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043275 Apr 05 12:06:32.887168 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1035/2048] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:32 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:33.898512 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ffbb0703-52cd-4c50-adfd-29d4eb93c6ea tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:33.899429 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ffbb0703-52cd-4c50-adfd-29d4eb93c6ea tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:33.906263 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ffbb0703-52cd-4c50-adfd-29d4eb93c6ea tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:33.906709 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ffbb0703-52cd-4c50-adfd-29d4eb93c6ea tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:33.907462 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ffbb0703-52cd-4c50-adfd-29d4eb93c6ea tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:33.907886 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ffbb0703-52cd-4c50-adfd-29d4eb93c6ea tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:33.936399 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ffbb0703-52cd-4c50-adfd-29d4eb93c6ea tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041921 Apr 05 12:06:33.936945 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1014/2049] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:33 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:34.947943 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1fbd6436-e228-40c5-a56f-f53571c778fb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:34.948895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1fbd6436-e228-40c5-a56f-f53571c778fb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:34.955627 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1fbd6436-e228-40c5-a56f-f53571c778fb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:34.956090 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1fbd6436-e228-40c5-a56f-f53571c778fb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:34.956853 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1fbd6436-e228-40c5-a56f-f53571c778fb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:34.957280 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1fbd6436-e228-40c5-a56f-f53571c778fb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:34.985454 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1fbd6436-e228-40c5-a56f-f53571c778fb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041590 Apr 05 12:06:34.986004 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1036/2050] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:34 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:35.997216 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ff286ace-e110-40f7-bb65-d5bab8ca20ce tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:35.998132 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ff286ace-e110-40f7-bb65-d5bab8ca20ce tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:36.005215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff286ace-e110-40f7-bb65-d5bab8ca20ce tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:36.005671 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff286ace-e110-40f7-bb65-d5bab8ca20ce tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:36.006438 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff286ace-e110-40f7-bb65-d5bab8ca20ce tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:36.006877 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff286ace-e110-40f7-bb65-d5bab8ca20ce tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:36.035375 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ff286ace-e110-40f7-bb65-d5bab8ca20ce tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042142 Apr 05 12:06:36.035925 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1015/2051] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:35 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:37.046922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d7a0f430-6cb5-4408-b89c-16ceb5ec80b9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:37.047855 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d7a0f430-6cb5-4408-b89c-16ceb5ec80b9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:37.054520 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d7a0f430-6cb5-4408-b89c-16ceb5ec80b9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:37.054897 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d7a0f430-6cb5-4408-b89c-16ceb5ec80b9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:37.055659 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d7a0f430-6cb5-4408-b89c-16ceb5ec80b9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:37.056112 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d7a0f430-6cb5-4408-b89c-16ceb5ec80b9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:37.085256 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d7a0f430-6cb5-4408-b89c-16ceb5ec80b9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042246 Apr 05 12:06:37.085804 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1037/2052] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:37 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:38.098381 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ca4ee3fc-882c-4c05-8626-e6add3a1f5fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:38.099482 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ca4ee3fc-882c-4c05-8626-e6add3a1f5fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:38.106129 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ca4ee3fc-882c-4c05-8626-e6add3a1f5fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:38.106573 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ca4ee3fc-882c-4c05-8626-e6add3a1f5fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:38.107389 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ca4ee3fc-882c-4c05-8626-e6add3a1f5fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:38.107828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ca4ee3fc-882c-4c05-8626-e6add3a1f5fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:38.137339 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ca4ee3fc-882c-4c05-8626-e6add3a1f5fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043105 Apr 05 12:06:38.137913 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1016/2053] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:38 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:39.149243 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1c575ddf-b207-48bb-9cda-64151139c1c1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:39.150198 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1c575ddf-b207-48bb-9cda-64151139c1c1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:39.156536 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1c575ddf-b207-48bb-9cda-64151139c1c1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:39.156979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1c575ddf-b207-48bb-9cda-64151139c1c1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:39.157741 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1c575ddf-b207-48bb-9cda-64151139c1c1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:39.158172 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1c575ddf-b207-48bb-9cda-64151139c1c1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:39.187153 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1c575ddf-b207-48bb-9cda-64151139c1c1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042175 Apr 05 12:06:39.187736 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1038/2054] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:39 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:40.199505 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c25ae6ff-6b19-4046-b4ea-8cb7172e1995 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:40.201034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c25ae6ff-6b19-4046-b4ea-8cb7172e1995 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:40.209399 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c25ae6ff-6b19-4046-b4ea-8cb7172e1995 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:40.209842 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c25ae6ff-6b19-4046-b4ea-8cb7172e1995 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:40.210596 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c25ae6ff-6b19-4046-b4ea-8cb7172e1995 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:40.211023 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c25ae6ff-6b19-4046-b4ea-8cb7172e1995 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:40.240350 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c25ae6ff-6b19-4046-b4ea-8cb7172e1995 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045264 Apr 05 12:06:40.240891 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1017/2055] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:40 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:41.255430 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f39a3a99-3019-4bc9-8ecb-8758e7568fbf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:41.256378 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f39a3a99-3019-4bc9-8ecb-8758e7568fbf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:41.263020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f39a3a99-3019-4bc9-8ecb-8758e7568fbf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:41.263478 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f39a3a99-3019-4bc9-8ecb-8758e7568fbf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:41.264582 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f39a3a99-3019-4bc9-8ecb-8758e7568fbf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:41.264744 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f39a3a99-3019-4bc9-8ecb-8758e7568fbf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:41.294526 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f39a3a99-3019-4bc9-8ecb-8758e7568fbf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045103 Apr 05 12:06:41.295085 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1039/2056] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:41 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:42.306819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a6ad2c0a-4f3c-4d86-abea-74d392041cb3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:42.307860 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a6ad2c0a-4f3c-4d86-abea-74d392041cb3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:42.314834 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a6ad2c0a-4f3c-4d86-abea-74d392041cb3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:42.315300 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a6ad2c0a-4f3c-4d86-abea-74d392041cb3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:42.316108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a6ad2c0a-4f3c-4d86-abea-74d392041cb3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:42.316604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a6ad2c0a-4f3c-4d86-abea-74d392041cb3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:42.346055 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a6ad2c0a-4f3c-4d86-abea-74d392041cb3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043335 Apr 05 12:06:42.346618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1018/2057] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:42 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:43.361847 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4a0c5829-5413-4596-bc11-c45deeeafb33 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:43.363293 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4a0c5829-5413-4596-bc11-c45deeeafb33 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:43.369819 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a0c5829-5413-4596-bc11-c45deeeafb33 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:43.370270 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a0c5829-5413-4596-bc11-c45deeeafb33 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:43.371026 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a0c5829-5413-4596-bc11-c45deeeafb33 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:43.371493 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a0c5829-5413-4596-bc11-c45deeeafb33 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:43.402357 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4a0c5829-5413-4596-bc11-c45deeeafb33 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047152 Apr 05 12:06:43.406461 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1040/2058] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:43 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:44.416379 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9992f40d-7884-479a-8e90-b936e46294be tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:44.417505 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9992f40d-7884-479a-8e90-b936e46294be tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:44.425603 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9992f40d-7884-479a-8e90-b936e46294be tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:44.426164 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9992f40d-7884-479a-8e90-b936e46294be tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:44.427122 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9992f40d-7884-479a-8e90-b936e46294be tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:44.427659 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9992f40d-7884-479a-8e90-b936e46294be tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:44.460507 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9992f40d-7884-479a-8e90-b936e46294be tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049081 Apr 05 12:06:44.461247 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1019/2059] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:44 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:45.472274 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1cde37d7-b4aa-435d-af3c-651e4d009ccf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:45.473192 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1cde37d7-b4aa-435d-af3c-651e4d009ccf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:45.479484 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1cde37d7-b4aa-435d-af3c-651e4d009ccf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:45.479929 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1cde37d7-b4aa-435d-af3c-651e4d009ccf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:45.480820 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1cde37d7-b4aa-435d-af3c-651e4d009ccf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:45.481311 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1cde37d7-b4aa-435d-af3c-651e4d009ccf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:45.510792 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1cde37d7-b4aa-435d-af3c-651e4d009ccf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042656 Apr 05 12:06:45.511624 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1041/2060] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:45 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:46.522235 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-afafa3f0-45bf-40e8-9147-c766378cfc87 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:46.523147 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-afafa3f0-45bf-40e8-9147-c766378cfc87 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:46.529780 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-afafa3f0-45bf-40e8-9147-c766378cfc87 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:46.530232 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-afafa3f0-45bf-40e8-9147-c766378cfc87 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:46.530958 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-afafa3f0-45bf-40e8-9147-c766378cfc87 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:46.531422 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-afafa3f0-45bf-40e8-9147-c766378cfc87 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:46.561666 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-afafa3f0-45bf-40e8-9147-c766378cfc87 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043388 Apr 05 12:06:46.562212 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1020/2061] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:46 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:47.573941 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3b3f40c4-41af-4601-a57e-1e03cfe4e5de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:47.574862 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3b3f40c4-41af-4601-a57e-1e03cfe4e5de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:47.582247 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b3f40c4-41af-4601-a57e-1e03cfe4e5de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:47.582856 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b3f40c4-41af-4601-a57e-1e03cfe4e5de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:47.584245 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b3f40c4-41af-4601-a57e-1e03cfe4e5de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:47.584918 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b3f40c4-41af-4601-a57e-1e03cfe4e5de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:47.615924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3b3f40c4-41af-4601-a57e-1e03cfe4e5de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046108 Apr 05 12:06:47.616535 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1042/2062] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:47 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:48.627812 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-827f172a-9d44-423e-9e5d-43b6cc3d0009 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:48.629137 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-827f172a-9d44-423e-9e5d-43b6cc3d0009 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:48.635785 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-827f172a-9d44-423e-9e5d-43b6cc3d0009 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:48.636268 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-827f172a-9d44-423e-9e5d-43b6cc3d0009 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:48.637020 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-827f172a-9d44-423e-9e5d-43b6cc3d0009 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:48.637451 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-827f172a-9d44-423e-9e5d-43b6cc3d0009 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:48.666633 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-827f172a-9d44-423e-9e5d-43b6cc3d0009 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042806 Apr 05 12:06:48.667224 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1021/2063] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:48 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:49.681063 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c650f078-c680-4951-b59a-1d4079e77ee8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:49.681980 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c650f078-c680-4951-b59a-1d4079e77ee8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:49.689003 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c650f078-c680-4951-b59a-1d4079e77ee8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:49.689455 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c650f078-c680-4951-b59a-1d4079e77ee8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:49.690211 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c650f078-c680-4951-b59a-1d4079e77ee8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:49.690642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c650f078-c680-4951-b59a-1d4079e77ee8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:49.721065 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c650f078-c680-4951-b59a-1d4079e77ee8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046006 Apr 05 12:06:49.721469 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1043/2064] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:49 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:50.733351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f26cf0ef-9254-4bf0-b2a1-3a6dfff489b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:50.734248 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f26cf0ef-9254-4bf0-b2a1-3a6dfff489b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:50.740646 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f26cf0ef-9254-4bf0-b2a1-3a6dfff489b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:50.741098 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f26cf0ef-9254-4bf0-b2a1-3a6dfff489b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:50.742140 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f26cf0ef-9254-4bf0-b2a1-3a6dfff489b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:50.742574 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f26cf0ef-9254-4bf0-b2a1-3a6dfff489b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:50.771996 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f26cf0ef-9254-4bf0-b2a1-3a6dfff489b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043079 Apr 05 12:06:50.772591 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1022/2065] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:50 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:51.785714 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3c0ac221-6d12-4bff-862f-bf86f0ed3a51 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:51.786887 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3c0ac221-6d12-4bff-862f-bf86f0ed3a51 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:51.794444 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3c0ac221-6d12-4bff-862f-bf86f0ed3a51 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:51.795091 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3c0ac221-6d12-4bff-862f-bf86f0ed3a51 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:51.795850 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3c0ac221-6d12-4bff-862f-bf86f0ed3a51 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:51.796323 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3c0ac221-6d12-4bff-862f-bf86f0ed3a51 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:51.826821 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3c0ac221-6d12-4bff-862f-bf86f0ed3a51 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047285 Apr 05 12:06:51.827521 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1044/2066] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:51 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:52.838467 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fbbf9ce5-9166-46d7-94de-029c411e1c03 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:52.839386 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fbbf9ce5-9166-46d7-94de-029c411e1c03 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:52.846080 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fbbf9ce5-9166-46d7-94de-029c411e1c03 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:52.846528 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fbbf9ce5-9166-46d7-94de-029c411e1c03 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:52.847554 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fbbf9ce5-9166-46d7-94de-029c411e1c03 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:52.847993 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fbbf9ce5-9166-46d7-94de-029c411e1c03 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:52.877255 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fbbf9ce5-9166-46d7-94de-029c411e1c03 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042757 Apr 05 12:06:52.877799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1023/2067] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:52 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:53.890418 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d1f506d0-2442-45bc-9cbe-6b1d96d62552 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:53.891347 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d1f506d0-2442-45bc-9cbe-6b1d96d62552 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:53.898083 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d1f506d0-2442-45bc-9cbe-6b1d96d62552 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:53.898541 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d1f506d0-2442-45bc-9cbe-6b1d96d62552 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:53.899286 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d1f506d0-2442-45bc-9cbe-6b1d96d62552 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:53.899789 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d1f506d0-2442-45bc-9cbe-6b1d96d62552 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:53.929208 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d1f506d0-2442-45bc-9cbe-6b1d96d62552 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042790 Apr 05 12:06:53.929761 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1045/2068] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:53 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:54.941407 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-176fd683-26bd-4c6b-b1c4-140a5e4b509d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:54.942322 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-176fd683-26bd-4c6b-b1c4-140a5e4b509d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:54.948774 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-176fd683-26bd-4c6b-b1c4-140a5e4b509d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:54.949218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-176fd683-26bd-4c6b-b1c4-140a5e4b509d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:54.949984 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-176fd683-26bd-4c6b-b1c4-140a5e4b509d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:54.950416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-176fd683-26bd-4c6b-b1c4-140a5e4b509d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:54.979460 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-176fd683-26bd-4c6b-b1c4-140a5e4b509d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042155 Apr 05 12:06:54.980042 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1024/2069] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:54 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:55.990945 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-764b1f50-eabb-475e-8271-1bdcfccf5bb5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:55.991856 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-764b1f50-eabb-475e-8271-1bdcfccf5bb5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:55.998327 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-764b1f50-eabb-475e-8271-1bdcfccf5bb5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:55.998770 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-764b1f50-eabb-475e-8271-1bdcfccf5bb5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:55.999554 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-764b1f50-eabb-475e-8271-1bdcfccf5bb5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:55.999947 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-764b1f50-eabb-475e-8271-1bdcfccf5bb5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:56.032137 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-764b1f50-eabb-475e-8271-1bdcfccf5bb5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044777 Apr 05 12:06:56.033022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1046/2070] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:55 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:57.046003 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-69e7309d-670f-4c95-a10c-72d28fba4668 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:57.047551 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-69e7309d-670f-4c95-a10c-72d28fba4668 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:57.053981 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-69e7309d-670f-4c95-a10c-72d28fba4668 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:57.054441 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-69e7309d-670f-4c95-a10c-72d28fba4668 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:57.055196 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-69e7309d-670f-4c95-a10c-72d28fba4668 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:57.055679 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-69e7309d-670f-4c95-a10c-72d28fba4668 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:57.084619 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-69e7309d-670f-4c95-a10c-72d28fba4668 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042532 Apr 05 12:06:57.085445 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1025/2071] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:57 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:58.096263 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4e52d6dd-e3c1-4b10-ace0-cd06ebf100df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:58.097199 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4e52d6dd-e3c1-4b10-ace0-cd06ebf100df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:58.103398 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e52d6dd-e3c1-4b10-ace0-cd06ebf100df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:58.103838 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e52d6dd-e3c1-4b10-ace0-cd06ebf100df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:58.104643 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e52d6dd-e3c1-4b10-ace0-cd06ebf100df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:58.105077 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e52d6dd-e3c1-4b10-ace0-cd06ebf100df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:58.137239 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4e52d6dd-e3c1-4b10-ace0-cd06ebf100df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044878 Apr 05 12:06:58.140918 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1047/2072] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:58 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:59.148709 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1e0df256-fe51-487c-999a-cba022f22a3f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:06:59.149661 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1e0df256-fe51-487c-999a-cba022f22a3f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:06:59.156350 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1e0df256-fe51-487c-999a-cba022f22a3f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:59.156808 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1e0df256-fe51-487c-999a-cba022f22a3f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:59.157535 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1e0df256-fe51-487c-999a-cba022f22a3f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:06:59.157997 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1e0df256-fe51-487c-999a-cba022f22a3f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:06:59.186951 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1e0df256-fe51-487c-999a-cba022f22a3f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042123 Apr 05 12:06:59.187486 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1026/2073] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:06:59 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:00.198480 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7673043b-fec5-4281-8b4f-f07c1b348e1e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:00.199394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7673043b-fec5-4281-8b4f-f07c1b348e1e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:00.205665 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7673043b-fec5-4281-8b4f-f07c1b348e1e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:00.206111 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7673043b-fec5-4281-8b4f-f07c1b348e1e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:00.206864 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7673043b-fec5-4281-8b4f-f07c1b348e1e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:00.207293 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7673043b-fec5-4281-8b4f-f07c1b348e1e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:00.236892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7673043b-fec5-4281-8b4f-f07c1b348e1e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042327 Apr 05 12:07:00.237424 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1048/2074] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:07:00 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:01.248685 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c003807d-502e-417e-a835-6d2a45f3011d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:01.249766 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c003807d-502e-417e-a835-6d2a45f3011d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:01.256444 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c003807d-502e-417e-a835-6d2a45f3011d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:01.256893 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c003807d-502e-417e-a835-6d2a45f3011d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:01.257658 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c003807d-502e-417e-a835-6d2a45f3011d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:01.258088 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c003807d-502e-417e-a835-6d2a45f3011d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:01.288248 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c003807d-502e-417e-a835-6d2a45f3011d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043411 Apr 05 12:07:01.289000 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1027/2075] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:07:01 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:02.299052 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a9f96933-d5da-4c4b-a141-1613eb09a1ed tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:02.299975 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a9f96933-d5da-4c4b-a141-1613eb09a1ed tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:02.306294 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a9f96933-d5da-4c4b-a141-1613eb09a1ed tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:02.306732 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a9f96933-d5da-4c4b-a141-1613eb09a1ed tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:02.307492 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a9f96933-d5da-4c4b-a141-1613eb09a1ed tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:02.307923 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a9f96933-d5da-4c4b-a141-1613eb09a1ed tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:02.337013 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a9f96933-d5da-4c4b-a141-1613eb09a1ed tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041848 Apr 05 12:07:02.337593 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1049/2076] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:07:02 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:03.348740 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c3073156-6cb2-470d-bf8d-2244200a9c6f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:03.349751 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c3073156-6cb2-470d-bf8d-2244200a9c6f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:03.356380 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3073156-6cb2-470d-bf8d-2244200a9c6f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:03.356833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3073156-6cb2-470d-bf8d-2244200a9c6f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:03.357610 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3073156-6cb2-470d-bf8d-2244200a9c6f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:03.358034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3073156-6cb2-470d-bf8d-2244200a9c6f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:03.387783 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c3073156-6cb2-470d-bf8d-2244200a9c6f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042990 Apr 05 12:07:03.388634 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1028/2077] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:07:03 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:04.402931 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e6519132-bb79-4413-a8ae-92b09b82f645 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:04.404455 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e6519132-bb79-4413-a8ae-92b09b82f645 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:04.414711 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6519132-bb79-4413-a8ae-92b09b82f645 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:04.415388 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6519132-bb79-4413-a8ae-92b09b82f645 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:04.416137 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6519132-bb79-4413-a8ae-92b09b82f645 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:04.416641 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6519132-bb79-4413-a8ae-92b09b82f645 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:04.453433 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e6519132-bb79-4413-a8ae-92b09b82f645 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056987 Apr 05 12:07:04.453868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1050/2078] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:07:04 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:05.466876 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b5194a91-2670-449c-a690-fa649c3920ac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:05.467975 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b5194a91-2670-449c-a690-fa649c3920ac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:05.474322 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b5194a91-2670-449c-a690-fa649c3920ac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:05.474771 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b5194a91-2670-449c-a690-fa649c3920ac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:05.475714 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b5194a91-2670-449c-a690-fa649c3920ac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:05.476178 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b5194a91-2670-449c-a690-fa649c3920ac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:05.505521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b5194a91-2670-449c-a690-fa649c3920ac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043226 Apr 05 12:07:05.506285 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1029/2079] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:07:05 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:06.519796 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d591d151-90f2-4dca-a3ef-9fdd4a88a7ae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:06.521238 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d591d151-90f2-4dca-a3ef-9fdd4a88a7ae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:06.531195 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d591d151-90f2-4dca-a3ef-9fdd4a88a7ae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:06.531915 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d591d151-90f2-4dca-a3ef-9fdd4a88a7ae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:06.533121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d591d151-90f2-4dca-a3ef-9fdd4a88a7ae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:06.533785 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d591d151-90f2-4dca-a3ef-9fdd4a88a7ae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:06.564571 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d591d151-90f2-4dca-a3ef-9fdd4a88a7ae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050731 Apr 05 12:07:06.565288 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1051/2080] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:07:06 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:07.581224 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-094f31c9-7ecb-4b81-a934-1f469fea772b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:07.582738 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-094f31c9-7ecb-4b81-a934-1f469fea772b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:07.592995 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-094f31c9-7ecb-4b81-a934-1f469fea772b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:07.593738 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-094f31c9-7ecb-4b81-a934-1f469fea772b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:07.594961 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-094f31c9-7ecb-4b81-a934-1f469fea772b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:07.595731 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-094f31c9-7ecb-4b81-a934-1f469fea772b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:07.627636 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-094f31c9-7ecb-4b81-a934-1f469fea772b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053768 Apr 05 12:07:07.628803 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1030/2081] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:07:07 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:08.643847 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cb516cf9-8384-49dd-8a47-566e9455021c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:08.645555 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cb516cf9-8384-49dd-8a47-566e9455021c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:08.653631 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cb516cf9-8384-49dd-8a47-566e9455021c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:08.654077 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cb516cf9-8384-49dd-8a47-566e9455021c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:08.654839 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cb516cf9-8384-49dd-8a47-566e9455021c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:08.655274 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cb516cf9-8384-49dd-8a47-566e9455021c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:08.684354 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cb516cf9-8384-49dd-8a47-566e9455021c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047359 Apr 05 12:07:08.685100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1052/2082] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:07:08 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:09.700478 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b83ea745-dfc3-414d-ab4e-9a016a0b53fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:09.702099 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b83ea745-dfc3-414d-ab4e-9a016a0b53fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:09.712575 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b83ea745-dfc3-414d-ab4e-9a016a0b53fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:09.713331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b83ea745-dfc3-414d-ab4e-9a016a0b53fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:09.714690 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b83ea745-dfc3-414d-ab4e-9a016a0b53fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:09.715485 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b83ea745-dfc3-414d-ab4e-9a016a0b53fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:09.748899 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b83ea745-dfc3-414d-ab4e-9a016a0b53fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055088 Apr 05 12:07:09.749393 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1031/2083] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:07:09 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:10.764815 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-66e9a193-3546-4da3-9e06-19495cd989b7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:10.766179 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-66e9a193-3546-4da3-9e06-19495cd989b7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:10.775770 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-66e9a193-3546-4da3-9e06-19495cd989b7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:10.776258 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-66e9a193-3546-4da3-9e06-19495cd989b7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:10.777038 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-66e9a193-3546-4da3-9e06-19495cd989b7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:10.777479 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-66e9a193-3546-4da3-9e06-19495cd989b7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:10.806882 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-66e9a193-3546-4da3-9e06-19495cd989b7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048780 Apr 05 12:07:10.810671 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1053/2084] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:07:10 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:11.822779 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c66c59de-c36c-4746-ab45-104844d84c56 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:11.823777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c66c59de-c36c-4746-ab45-104844d84c56 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:11.831446 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c66c59de-c36c-4746-ab45-104844d84c56 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:11.832008 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c66c59de-c36c-4746-ab45-104844d84c56 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:11.832950 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c66c59de-c36c-4746-ab45-104844d84c56 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:11.833462 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c66c59de-c36c-4746-ab45-104844d84c56 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:11.865826 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c66c59de-c36c-4746-ab45-104844d84c56 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049577 Apr 05 12:07:11.866399 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1032/2085] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:07:11 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:12.882053 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ad99ae51-8cb1-467e-97c4-eb8995562704 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:12.884177 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ad99ae51-8cb1-467e-97c4-eb8995562704 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:12.890380 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ad99ae51-8cb1-467e-97c4-eb8995562704 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:12.890832 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ad99ae51-8cb1-467e-97c4-eb8995562704 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:12.891605 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ad99ae51-8cb1-467e-97c4-eb8995562704 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:12.892058 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ad99ae51-8cb1-467e-97c4-eb8995562704 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:12.920635 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ad99ae51-8cb1-467e-97c4-eb8995562704 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045568 Apr 05 12:07:12.921188 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1054/2086] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:07:12 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:13.935525 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c07b8e41-7ef7-4202-a3b7-d6cfcc9283bb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:13.936579 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c07b8e41-7ef7-4202-a3b7-d6cfcc9283bb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:13.944736 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c07b8e41-7ef7-4202-a3b7-d6cfcc9283bb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:13.945206 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c07b8e41-7ef7-4202-a3b7-d6cfcc9283bb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:13.946168 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c07b8e41-7ef7-4202-a3b7-d6cfcc9283bb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:13.946749 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c07b8e41-7ef7-4202-a3b7-d6cfcc9283bb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:13.979086 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c07b8e41-7ef7-4202-a3b7-d6cfcc9283bb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049192 Apr 05 12:07:13.979645 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1033/2087] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:07:13 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:14.994950 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d24ec9fc-0c87-4e8e-9912-bdaa08849c61 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:14.996479 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d24ec9fc-0c87-4e8e-9912-bdaa08849c61 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:15.007607 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d24ec9fc-0c87-4e8e-9912-bdaa08849c61 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:15.008564 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d24ec9fc-0c87-4e8e-9912-bdaa08849c61 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:15.009460 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d24ec9fc-0c87-4e8e-9912-bdaa08849c61 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:15.009892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d24ec9fc-0c87-4e8e-9912-bdaa08849c61 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:15.039365 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d24ec9fc-0c87-4e8e-9912-bdaa08849c61 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050993 Apr 05 12:07:15.039904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1055/2088] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:07:14 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:16.055170 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-48f45c68-df04-4409-852e-da58f3f349b5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:16.056561 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-48f45c68-df04-4409-852e-da58f3f349b5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:16.064112 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-48f45c68-df04-4409-852e-da58f3f349b5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:16.064670 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-48f45c68-df04-4409-852e-da58f3f349b5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:16.065560 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-48f45c68-df04-4409-852e-da58f3f349b5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:16.066061 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-48f45c68-df04-4409-852e-da58f3f349b5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:16.097617 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-48f45c68-df04-4409-852e-da58f3f349b5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049067 Apr 05 12:07:16.098178 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1034/2089] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:07:16 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:17.114035 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bd18140c-0317-479e-8393-e138112c9d93 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:17.115522 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bd18140c-0317-479e-8393-e138112c9d93 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:17.125853 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bd18140c-0317-479e-8393-e138112c9d93 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:17.126610 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bd18140c-0317-479e-8393-e138112c9d93 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:17.127859 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bd18140c-0317-479e-8393-e138112c9d93 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:17.128909 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bd18140c-0317-479e-8393-e138112c9d93 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:17.159625 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bd18140c-0317-479e-8393-e138112c9d93 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052431 Apr 05 12:07:17.160210 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1056/2090] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:07:17 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:18.171914 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3e3b4f1c-4f49-4976-bf40-be72faa04c38 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:18.172887 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3e3b4f1c-4f49-4976-bf40-be72faa04c38 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:18.179277 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e3b4f1c-4f49-4976-bf40-be72faa04c38 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:18.179641 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e3b4f1c-4f49-4976-bf40-be72faa04c38 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:18.180652 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e3b4f1c-4f49-4976-bf40-be72faa04c38 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:18.181138 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e3b4f1c-4f49-4976-bf40-be72faa04c38 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:18.209702 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3e3b4f1c-4f49-4976-bf40-be72faa04c38 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041774 Apr 05 12:07:18.210278 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1035/2091] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:07:18 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:19.225280 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2aa24720-9c49-42f0-9a7f-b5c471240de6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:19.226686 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2aa24720-9c49-42f0-9a7f-b5c471240de6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:19.237180 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2aa24720-9c49-42f0-9a7f-b5c471240de6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:19.238161 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2aa24720-9c49-42f0-9a7f-b5c471240de6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:19.239101 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2aa24720-9c49-42f0-9a7f-b5c471240de6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:19.239873 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2aa24720-9c49-42f0-9a7f-b5c471240de6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:19.270802 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2aa24720-9c49-42f0-9a7f-b5c471240de6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052217 Apr 05 12:07:19.271340 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1057/2092] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:07:19 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:20.287044 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fdb3c2a2-0a0f-458b-af71-0f3c6e36bc1e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:20.288400 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fdb3c2a2-0a0f-458b-af71-0f3c6e36bc1e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:20.295788 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fdb3c2a2-0a0f-458b-af71-0f3c6e36bc1e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:20.296348 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fdb3c2a2-0a0f-458b-af71-0f3c6e36bc1e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:20.297112 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fdb3c2a2-0a0f-458b-af71-0f3c6e36bc1e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:20.297544 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fdb3c2a2-0a0f-458b-af71-0f3c6e36bc1e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:20.326344 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fdb3c2a2-0a0f-458b-af71-0f3c6e36bc1e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046356 Apr 05 12:07:20.327190 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1036/2093] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:07:20 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:21.342306 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-88ef1dfa-cba6-4857-b759-ad39da349e8a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:21.343736 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-88ef1dfa-cba6-4857-b759-ad39da349e8a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:21.354135 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-88ef1dfa-cba6-4857-b759-ad39da349e8a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:21.354882 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-88ef1dfa-cba6-4857-b759-ad39da349e8a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:21.356131 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-88ef1dfa-cba6-4857-b759-ad39da349e8a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:21.356897 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-88ef1dfa-cba6-4857-b759-ad39da349e8a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:21.391289 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-88ef1dfa-cba6-4857-b759-ad39da349e8a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055742 Apr 05 12:07:21.391872 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1058/2094] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:07:21 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:22.407195 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0b377bc2-0e8a-4f83-8b2d-a33e57365012 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:22.408765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0b377bc2-0e8a-4f83-8b2d-a33e57365012 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:22.417900 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0b377bc2-0e8a-4f83-8b2d-a33e57365012 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:22.418346 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0b377bc2-0e8a-4f83-8b2d-a33e57365012 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:22.419111 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0b377bc2-0e8a-4f83-8b2d-a33e57365012 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:22.419635 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0b377bc2-0e8a-4f83-8b2d-a33e57365012 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:22.448290 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0b377bc2-0e8a-4f83-8b2d-a33e57365012 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047650 Apr 05 12:07:22.448856 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1037/2095] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:07:22 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:23.463745 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3743d9a3-7eeb-4406-987c-ebff1e1c1426 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:23.464696 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3743d9a3-7eeb-4406-987c-ebff1e1c1426 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:23.471366 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3743d9a3-7eeb-4406-987c-ebff1e1c1426 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:23.471819 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3743d9a3-7eeb-4406-987c-ebff1e1c1426 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:23.472619 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3743d9a3-7eeb-4406-987c-ebff1e1c1426 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:23.473069 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3743d9a3-7eeb-4406-987c-ebff1e1c1426 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:23.502829 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3743d9a3-7eeb-4406-987c-ebff1e1c1426 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045023 Apr 05 12:07:23.503435 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1059/2096] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:07:23 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:24.519029 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ff079577-12dd-422f-a06e-b51c772e7fe1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:24.520504 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ff079577-12dd-422f-a06e-b51c772e7fe1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:24.530759 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff079577-12dd-422f-a06e-b51c772e7fe1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:24.531476 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff079577-12dd-422f-a06e-b51c772e7fe1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:24.532781 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff079577-12dd-422f-a06e-b51c772e7fe1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:24.533513 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff079577-12dd-422f-a06e-b51c772e7fe1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:24.565568 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ff079577-12dd-422f-a06e-b51c772e7fe1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053404 Apr 05 12:07:24.568102 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1038/2097] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:07:24 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:25.581541 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ac3b36d0-16f5-47bc-9615-5f132d9a86a2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:07:25.583033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ac3b36d0-16f5-47bc-9615-5f132d9a86a2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:25.594027 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ac3b36d0-16f5-47bc-9615-5f132d9a86a2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:25.594762 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ac3b36d0-16f5-47bc-9615-5f132d9a86a2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:25.595989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ac3b36d0-16f5-47bc-9615-5f132d9a86a2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:25.596757 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ac3b36d0-16f5-47bc-9615-5f132d9a86a2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:25.686658 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ac3b36d0-16f5-47bc-9615-5f132d9a86a2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "POST /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/action" status: 200 len: 76748 microversion: 2.1 time: 0.111387 Apr 05 12:07:25.688113 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1060/2098] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Apr 5 12:07:25 2022] POST /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de/action => generated 76748 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:07:32.069680 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-339e6f0a-f60b-4038-a087-99812e10f9c1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:32.070255 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-339e6f0a-f60b-4038-a087-99812e10f9c1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:32.076766 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-339e6f0a-f60b-4038-a087-99812e10f9c1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:32.077250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-339e6f0a-f60b-4038-a087-99812e10f9c1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:32.077960 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-339e6f0a-f60b-4038-a087-99812e10f9c1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:32.078393 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-339e6f0a-f60b-4038-a087-99812e10f9c1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:32.102529 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-339e6f0a-f60b-4038-a087-99812e10f9c1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Going to try to terminate instance {{(pid=123357) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 12:07:32.189508 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-339e6f0a-f60b-4038-a087-99812e10f9c1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 204 len: 0 microversion: 2.1 time: 0.123435 Apr 05 12:07:32.190221 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1039/2099] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 12:07:32 2022] DELETE /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:07:32.199596 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c8611339-6114-4d88-bc4b-ade84034a455 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:32.200370 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c8611339-6114-4d88-bc4b-ade84034a455 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:32.207266 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c8611339-6114-4d88-bc4b-ade84034a455 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:32.207711 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c8611339-6114-4d88-bc4b-ade84034a455 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:32.208529 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c8611339-6114-4d88-bc4b-ade84034a455 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:32.208961 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c8611339-6114-4d88-bc4b-ade84034a455 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:32.405522 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c8611339-6114-4d88-bc4b-ade84034a455 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:32.413314 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c8611339-6114-4d88-bc4b-ade84034a455 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.218672 Apr 05 12:07:32.413879 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1061/2100] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:07:32 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:33.434393 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e8281e94-1fdf-4c75-8d33-e31916b2b6ce tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:33.435290 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e8281e94-1fdf-4c75-8d33-e31916b2b6ce tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:33.443989 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e8281e94-1fdf-4c75-8d33-e31916b2b6ce tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:33.444627 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e8281e94-1fdf-4c75-8d33-e31916b2b6ce tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:33.445639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e8281e94-1fdf-4c75-8d33-e31916b2b6ce tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:33.446216 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e8281e94-1fdf-4c75-8d33-e31916b2b6ce tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:33.644143 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e8281e94-1fdf-4c75-8d33-e31916b2b6ce tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:33.656188 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e8281e94-1fdf-4c75-8d33-e31916b2b6ce tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.228064 Apr 05 12:07:33.656940 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1040/2101] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:07:33 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:33.749059 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:07:33.749337 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Tue Apr 5 12:07:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:07:34.681015 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0ada876c-8250-445e-901d-9389606a6e94 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:34.681831 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0ada876c-8250-445e-901d-9389606a6e94 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:34.690501 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0ada876c-8250-445e-901d-9389606a6e94 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:34.691090 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0ada876c-8250-445e-901d-9389606a6e94 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:34.692109 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0ada876c-8250-445e-901d-9389606a6e94 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:34.692705 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0ada876c-8250-445e-901d-9389606a6e94 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:34.835492 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0ada876c-8250-445e-901d-9389606a6e94 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:34.843753 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0ada876c-8250-445e-901d-9389606a6e94 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.169539 Apr 05 12:07:34.844392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1062/2102] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:07:34 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:35.861490 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a73ad225-8cb8-4031-bc5c-a121751c1369 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:35.862037 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a73ad225-8cb8-4031-bc5c-a121751c1369 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:35.868883 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a73ad225-8cb8-4031-bc5c-a121751c1369 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:35.869341 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a73ad225-8cb8-4031-bc5c-a121751c1369 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:35.870099 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a73ad225-8cb8-4031-bc5c-a121751c1369 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:35.870532 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a73ad225-8cb8-4031-bc5c-a121751c1369 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:36.020931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a73ad225-8cb8-4031-bc5c-a121751c1369 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:36.033939 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a73ad225-8cb8-4031-bc5c-a121751c1369 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.176144 Apr 05 12:07:36.034818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1041/2103] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:07:35 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:37.057438 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-95ff5553-256c-473c-a85e-fbd1b5adc10c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:37.058024 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-95ff5553-256c-473c-a85e-fbd1b5adc10c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:37.064750 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95ff5553-256c-473c-a85e-fbd1b5adc10c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:37.065199 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95ff5553-256c-473c-a85e-fbd1b5adc10c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:37.065957 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95ff5553-256c-473c-a85e-fbd1b5adc10c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:37.066392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95ff5553-256c-473c-a85e-fbd1b5adc10c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:37.216252 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-95ff5553-256c-473c-a85e-fbd1b5adc10c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:37.224189 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-95ff5553-256c-473c-a85e-fbd1b5adc10c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.173268 Apr 05 12:07:37.224733 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1063/2104] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:07:37 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:38.245765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b66a2223-89e2-44c8-a68d-d95bc3b44fa7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:38.246776 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b66a2223-89e2-44c8-a68d-d95bc3b44fa7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:38.257545 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b66a2223-89e2-44c8-a68d-d95bc3b44fa7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:38.258281 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b66a2223-89e2-44c8-a68d-d95bc3b44fa7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:38.259517 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b66a2223-89e2-44c8-a68d-d95bc3b44fa7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:38.260309 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b66a2223-89e2-44c8-a68d-d95bc3b44fa7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:38.408856 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b66a2223-89e2-44c8-a68d-d95bc3b44fa7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:38.417009 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b66a2223-89e2-44c8-a68d-d95bc3b44fa7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.177773 Apr 05 12:07:38.417590 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1042/2105] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:07:38 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:39.434788 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5df69d8f-6bde-4823-8b34-e7f51547a739 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:39.436049 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5df69d8f-6bde-4823-8b34-e7f51547a739 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:39.442518 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5df69d8f-6bde-4823-8b34-e7f51547a739 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:39.442966 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5df69d8f-6bde-4823-8b34-e7f51547a739 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:39.443719 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5df69d8f-6bde-4823-8b34-e7f51547a739 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:39.444168 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5df69d8f-6bde-4823-8b34-e7f51547a739 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:39.592512 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5df69d8f-6bde-4823-8b34-e7f51547a739 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:39.600297 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5df69d8f-6bde-4823-8b34-e7f51547a739 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.169325 Apr 05 12:07:39.600856 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1064/2106] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:07:39 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:40.617241 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b9ba3443-4d54-4b3f-8884-73d4d8785e8b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:40.617855 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b9ba3443-4d54-4b3f-8884-73d4d8785e8b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:40.624676 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b9ba3443-4d54-4b3f-8884-73d4d8785e8b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:40.625134 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b9ba3443-4d54-4b3f-8884-73d4d8785e8b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:40.625887 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b9ba3443-4d54-4b3f-8884-73d4d8785e8b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:40.626329 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b9ba3443-4d54-4b3f-8884-73d4d8785e8b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:40.761598 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b9ba3443-4d54-4b3f-8884-73d4d8785e8b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:40.774455 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b9ba3443-4d54-4b3f-8884-73d4d8785e8b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.160590 Apr 05 12:07:40.776619 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1043/2107] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:07:40 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:41.800206 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e0f56d60-7c17-4107-88e5-03ad690cfe3e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:41.801058 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e0f56d60-7c17-4107-88e5-03ad690cfe3e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:41.811489 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0f56d60-7c17-4107-88e5-03ad690cfe3e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:41.812297 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0f56d60-7c17-4107-88e5-03ad690cfe3e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:41.813547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0f56d60-7c17-4107-88e5-03ad690cfe3e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:41.814278 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0f56d60-7c17-4107-88e5-03ad690cfe3e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:41.960793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e0f56d60-7c17-4107-88e5-03ad690cfe3e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:41.969182 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e0f56d60-7c17-4107-88e5-03ad690cfe3e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.175569 Apr 05 12:07:41.969766 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1065/2108] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:07:41 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:42.990221 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3729c270-0eb7-4669-8736-4b7885e37dc2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:42.991212 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3729c270-0eb7-4669-8736-4b7885e37dc2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:43.001717 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3729c270-0eb7-4669-8736-4b7885e37dc2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:43.002450 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3729c270-0eb7-4669-8736-4b7885e37dc2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:43.003684 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3729c270-0eb7-4669-8736-4b7885e37dc2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:43.004799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3729c270-0eb7-4669-8736-4b7885e37dc2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:43.149297 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3729c270-0eb7-4669-8736-4b7885e37dc2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:43.166131 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3729c270-0eb7-4669-8736-4b7885e37dc2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.182254 Apr 05 12:07:43.166699 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1044/2109] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:07:42 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:44.187101 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f363f15c-d580-46de-ac32-2f997f05dd1d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:44.187955 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f363f15c-d580-46de-ac32-2f997f05dd1d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:44.198631 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f363f15c-d580-46de-ac32-2f997f05dd1d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:44.199413 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f363f15c-d580-46de-ac32-2f997f05dd1d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:44.200736 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f363f15c-d580-46de-ac32-2f997f05dd1d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:44.201444 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f363f15c-d580-46de-ac32-2f997f05dd1d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:44.346937 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f363f15c-d580-46de-ac32-2f997f05dd1d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:44.358554 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f363f15c-d580-46de-ac32-2f997f05dd1d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.178099 Apr 05 12:07:44.359262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1066/2110] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:07:44 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:45.383472 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ffbd34af-533e-4ab6-a902-73572569001d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:45.384578 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ffbd34af-533e-4ab6-a902-73572569001d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:45.392318 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ffbd34af-533e-4ab6-a902-73572569001d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:45.392838 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ffbd34af-533e-4ab6-a902-73572569001d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:45.393718 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ffbd34af-533e-4ab6-a902-73572569001d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:45.394221 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ffbd34af-533e-4ab6-a902-73572569001d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:45.541305 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ffbd34af-533e-4ab6-a902-73572569001d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:45.549440 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ffbd34af-533e-4ab6-a902-73572569001d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.172685 Apr 05 12:07:45.549965 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1045/2111] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:07:45 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:46.570408 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3ced3a20-9dde-4559-be0b-bf6e55b97542 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:46.571461 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3ced3a20-9dde-4559-be0b-bf6e55b97542 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:46.581973 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3ced3a20-9dde-4559-be0b-bf6e55b97542 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:46.582714 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3ced3a20-9dde-4559-be0b-bf6e55b97542 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:46.583953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3ced3a20-9dde-4559-be0b-bf6e55b97542 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:46.584725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3ced3a20-9dde-4559-be0b-bf6e55b97542 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:46.728383 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3ced3a20-9dde-4559-be0b-bf6e55b97542 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:46.736745 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3ced3a20-9dde-4559-be0b-bf6e55b97542 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.172809 Apr 05 12:07:46.737314 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1067/2112] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:07:46 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:47.754718 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7586de93-aae7-4938-8372-b35108c5b369 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:47.755309 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7586de93-aae7-4938-8372-b35108c5b369 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:47.761917 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7586de93-aae7-4938-8372-b35108c5b369 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:47.762376 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7586de93-aae7-4938-8372-b35108c5b369 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:47.763272 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7586de93-aae7-4938-8372-b35108c5b369 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:47.763712 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7586de93-aae7-4938-8372-b35108c5b369 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:47.906375 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7586de93-aae7-4938-8372-b35108c5b369 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:47.914356 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7586de93-aae7-4938-8372-b35108c5b369 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.164051 Apr 05 12:07:47.915159 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1046/2113] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:07:47 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:48.935143 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c9354086-18e0-4ccc-b83b-c47b347ffc0a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:48.936019 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c9354086-18e0-4ccc-b83b-c47b347ffc0a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:48.946692 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9354086-18e0-4ccc-b83b-c47b347ffc0a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:48.947315 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9354086-18e0-4ccc-b83b-c47b347ffc0a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:48.948122 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9354086-18e0-4ccc-b83b-c47b347ffc0a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:48.948567 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9354086-18e0-4ccc-b83b-c47b347ffc0a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:49.083468 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c9354086-18e0-4ccc-b83b-c47b347ffc0a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:49.092063 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c9354086-18e0-4ccc-b83b-c47b347ffc0a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.163754 Apr 05 12:07:49.092664 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1068/2114] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:07:48 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:50.108629 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-92ca7fd8-d06c-4649-913e-7ee1ff4f3635 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:50.109255 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-92ca7fd8-d06c-4649-913e-7ee1ff4f3635 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:50.115686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-92ca7fd8-d06c-4649-913e-7ee1ff4f3635 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:50.116167 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-92ca7fd8-d06c-4649-913e-7ee1ff4f3635 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:50.116933 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-92ca7fd8-d06c-4649-913e-7ee1ff4f3635 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:50.117418 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-92ca7fd8-d06c-4649-913e-7ee1ff4f3635 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:50.256561 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-92ca7fd8-d06c-4649-913e-7ee1ff4f3635 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:50.264489 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-92ca7fd8-d06c-4649-913e-7ee1ff4f3635 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.159674 Apr 05 12:07:50.265035 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1047/2115] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:07:50 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:51.285677 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9cf81fb3-6b69-4993-98d3-2f6f0fe1a13d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:51.286730 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9cf81fb3-6b69-4993-98d3-2f6f0fe1a13d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:51.294974 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9cf81fb3-6b69-4993-98d3-2f6f0fe1a13d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:51.295868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9cf81fb3-6b69-4993-98d3-2f6f0fe1a13d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:51.296208 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9cf81fb3-6b69-4993-98d3-2f6f0fe1a13d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:51.296644 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9cf81fb3-6b69-4993-98d3-2f6f0fe1a13d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:51.433182 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9cf81fb3-6b69-4993-98d3-2f6f0fe1a13d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:51.442485 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9cf81fb3-6b69-4993-98d3-2f6f0fe1a13d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.162946 Apr 05 12:07:51.443169 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1069/2116] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:07:51 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:52.181247 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e819c80b-dc71-48f6-b35f-c0b6bc2c1342 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:52.181784 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e819c80b-dc71-48f6-b35f-c0b6bc2c1342 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:52.188387 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e819c80b-dc71-48f6-b35f-c0b6bc2c1342 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:52.188839 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e819c80b-dc71-48f6-b35f-c0b6bc2c1342 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:52.189596 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e819c80b-dc71-48f6-b35f-c0b6bc2c1342 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:52.190042 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e819c80b-dc71-48f6-b35f-c0b6bc2c1342 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:52.213717 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e819c80b-dc71-48f6-b35f-c0b6bc2c1342 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Going to try to terminate instance {{(pid=123357) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 12:07:52.298790 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e819c80b-dc71-48f6-b35f-c0b6bc2c1342 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "DELETE /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 204 len: 0 microversion: 2.20 time: 0.121021 Apr 05 12:07:52.299500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1048/2117] 10.222.0.61 () {60 vars in 1279 bytes} [Tue Apr 5 12:07:52 2022] DELETE /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 05 12:07:52.308770 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e4736008-525f-4ed1-a2c1-e0c51876e0cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:52.309341 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e4736008-525f-4ed1-a2c1-e0c51876e0cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:52.315370 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e4736008-525f-4ed1-a2c1-e0c51876e0cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:52.315824 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e4736008-525f-4ed1-a2c1-e0c51876e0cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:52.316620 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e4736008-525f-4ed1-a2c1-e0c51876e0cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:52.317063 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e4736008-525f-4ed1-a2c1-e0c51876e0cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:52.457673 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e4736008-525f-4ed1-a2c1-e0c51876e0cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:52.460857 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-51daf3da-8b37-46ca-83c3-c2124c99588f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:52.461621 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-51daf3da-8b37-46ca-83c3-c2124c99588f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:52.466335 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e4736008-525f-4ed1-a2c1-e0c51876e0cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:52.467853 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e4736008-525f-4ed1-a2c1-e0c51876e0cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:52.468027 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-51daf3da-8b37-46ca-83c3-c2124c99588f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:52.468499 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-51daf3da-8b37-46ca-83c3-c2124c99588f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:52.469070 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e4736008-525f-4ed1-a2c1-e0c51876e0cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.164938 Apr 05 12:07:52.469370 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-51daf3da-8b37-46ca-83c3-c2124c99588f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:52.476265 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1070/2118] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:07:52 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:52.476443 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-51daf3da-8b37-46ca-83c3-c2124c99588f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:52.602930 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-51daf3da-8b37-46ca-83c3-c2124c99588f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:52.611249 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-51daf3da-8b37-46ca-83c3-c2124c99588f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.154646 Apr 05 12:07:52.611833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1049/2119] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:07:52 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:53.490924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a9287b7e-3ddd-40fe-ae35-e930b33edcd9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:53.491776 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a9287b7e-3ddd-40fe-ae35-e930b33edcd9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:53.502593 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a9287b7e-3ddd-40fe-ae35-e930b33edcd9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:53.503336 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a9287b7e-3ddd-40fe-ae35-e930b33edcd9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:53.504973 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a9287b7e-3ddd-40fe-ae35-e930b33edcd9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:53.505693 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a9287b7e-3ddd-40fe-ae35-e930b33edcd9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:53.631836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a4997a42-4e62-47e5-899e-163e838b9b1e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:53.632443 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a4997a42-4e62-47e5-899e-163e838b9b1e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:53.638849 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a4997a42-4e62-47e5-899e-163e838b9b1e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:53.639298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a4997a42-4e62-47e5-899e-163e838b9b1e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:53.640053 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a4997a42-4e62-47e5-899e-163e838b9b1e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:53.640508 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a4997a42-4e62-47e5-899e-163e838b9b1e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:53.641507 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a9287b7e-3ddd-40fe-ae35-e930b33edcd9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:53.649857 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a9287b7e-3ddd-40fe-ae35-e930b33edcd9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:53.651360 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a9287b7e-3ddd-40fe-ae35-e930b33edcd9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:53.652520 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a9287b7e-3ddd-40fe-ae35-e930b33edcd9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.168290 Apr 05 12:07:53.653107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1071/2120] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:07:53 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:53.782223 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a4997a42-4e62-47e5-899e-163e838b9b1e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:53.793250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a4997a42-4e62-47e5-899e-163e838b9b1e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.165607 Apr 05 12:07:53.793859 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1050/2121] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:07:53 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:54.675154 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7d7cd5bf-bf7e-4288-8a3c-072af3806625 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:54.675973 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7d7cd5bf-bf7e-4288-8a3c-072af3806625 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:54.684571 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7d7cd5bf-bf7e-4288-8a3c-072af3806625 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:54.685011 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7d7cd5bf-bf7e-4288-8a3c-072af3806625 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:54.685761 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7d7cd5bf-bf7e-4288-8a3c-072af3806625 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:54.694469 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7d7cd5bf-bf7e-4288-8a3c-072af3806625 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:54.811034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7253f085-b31e-4c37-a74d-1feee1cafd39 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:54.811699 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7253f085-b31e-4c37-a74d-1feee1cafd39 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:54.818125 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7253f085-b31e-4c37-a74d-1feee1cafd39 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:54.818564 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7253f085-b31e-4c37-a74d-1feee1cafd39 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:54.819361 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7253f085-b31e-4c37-a74d-1feee1cafd39 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:54.819782 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7253f085-b31e-4c37-a74d-1feee1cafd39 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:54.849428 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7d7cd5bf-bf7e-4288-8a3c-072af3806625 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:54.858287 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7d7cd5bf-bf7e-4288-8a3c-072af3806625 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:54.859790 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7d7cd5bf-bf7e-4288-8a3c-072af3806625 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:54.860993 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7d7cd5bf-bf7e-4288-8a3c-072af3806625 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.192554 Apr 05 12:07:54.861559 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1072/2122] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:07:54 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:54.951983 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7253f085-b31e-4c37-a74d-1feee1cafd39 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:54.963611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7253f085-b31e-4c37-a74d-1feee1cafd39 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.156637 Apr 05 12:07:54.964217 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1051/2123] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:07:54 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:55.883284 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-97f3c062-ab3b-4bb5-b595-cc758430bd8f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:55.884354 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-97f3c062-ab3b-4bb5-b595-cc758430bd8f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:55.891144 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-97f3c062-ab3b-4bb5-b595-cc758430bd8f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:55.891569 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-97f3c062-ab3b-4bb5-b595-cc758430bd8f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:55.892359 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-97f3c062-ab3b-4bb5-b595-cc758430bd8f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:55.892771 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-97f3c062-ab3b-4bb5-b595-cc758430bd8f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:55.981017 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-473d3129-e1d8-40df-9126-1e109e654981 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:55.981662 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-473d3129-e1d8-40df-9126-1e109e654981 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:55.988045 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-473d3129-e1d8-40df-9126-1e109e654981 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:55.988496 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-473d3129-e1d8-40df-9126-1e109e654981 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:55.989270 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-473d3129-e1d8-40df-9126-1e109e654981 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:55.989696 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-473d3129-e1d8-40df-9126-1e109e654981 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:56.033852 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-97f3c062-ab3b-4bb5-b595-cc758430bd8f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:56.042278 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-97f3c062-ab3b-4bb5-b595-cc758430bd8f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:56.043760 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-97f3c062-ab3b-4bb5-b595-cc758430bd8f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:56.044932 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-97f3c062-ab3b-4bb5-b595-cc758430bd8f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.168550 Apr 05 12:07:56.045596 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1073/2124] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:07:55 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:56.120985 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-473d3129-e1d8-40df-9126-1e109e654981 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:56.129692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-473d3129-e1d8-40df-9126-1e109e654981 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.152268 Apr 05 12:07:56.130259 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1052/2125] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:07:55 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:57.063746 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5b6e1a3e-6755-4217-9501-dd6f3e96b6da tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:57.064551 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5b6e1a3e-6755-4217-9501-dd6f3e96b6da tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:57.071110 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5b6e1a3e-6755-4217-9501-dd6f3e96b6da tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:57.071557 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5b6e1a3e-6755-4217-9501-dd6f3e96b6da tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:57.072413 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5b6e1a3e-6755-4217-9501-dd6f3e96b6da tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:57.072847 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5b6e1a3e-6755-4217-9501-dd6f3e96b6da tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:57.147533 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-37a56b55-4138-47d1-a6e0-589a9026c4aa tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:57.148180 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-37a56b55-4138-47d1-a6e0-589a9026c4aa tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:57.154900 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37a56b55-4138-47d1-a6e0-589a9026c4aa tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:57.155349 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37a56b55-4138-47d1-a6e0-589a9026c4aa tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:57.156142 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37a56b55-4138-47d1-a6e0-589a9026c4aa tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:57.156601 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37a56b55-4138-47d1-a6e0-589a9026c4aa tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:57.210531 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5b6e1a3e-6755-4217-9501-dd6f3e96b6da tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:57.219530 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5b6e1a3e-6755-4217-9501-dd6f3e96b6da tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:57.221001 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5b6e1a3e-6755-4217-9501-dd6f3e96b6da tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:57.222165 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5b6e1a3e-6755-4217-9501-dd6f3e96b6da tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.162628 Apr 05 12:07:57.222756 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1074/2126] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:07:57 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:57.291627 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-37a56b55-4138-47d1-a6e0-589a9026c4aa tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:57.300208 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-37a56b55-4138-47d1-a6e0-589a9026c4aa tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.156472 Apr 05 12:07:57.300794 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1053/2127] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:07:57 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:58.244730 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-745e7be1-b0be-48c4-bc07-f8a83d73a132 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:58.245658 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-745e7be1-b0be-48c4-bc07-f8a83d73a132 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:58.256809 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-745e7be1-b0be-48c4-bc07-f8a83d73a132 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:58.257552 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-745e7be1-b0be-48c4-bc07-f8a83d73a132 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:58.258810 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-745e7be1-b0be-48c4-bc07-f8a83d73a132 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:58.259649 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-745e7be1-b0be-48c4-bc07-f8a83d73a132 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:58.317696 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c3098fe4-df37-4bb7-a1ea-f62e03b32d73 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:58.318400 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c3098fe4-df37-4bb7-a1ea-f62e03b32d73 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:58.325051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3098fe4-df37-4bb7-a1ea-f62e03b32d73 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:58.325570 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3098fe4-df37-4bb7-a1ea-f62e03b32d73 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:58.326387 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3098fe4-df37-4bb7-a1ea-f62e03b32d73 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:58.326890 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3098fe4-df37-4bb7-a1ea-f62e03b32d73 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:58.407090 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-745e7be1-b0be-48c4-bc07-f8a83d73a132 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:58.415955 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-745e7be1-b0be-48c4-bc07-f8a83d73a132 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:58.417533 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-745e7be1-b0be-48c4-bc07-f8a83d73a132 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:58.418820 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-745e7be1-b0be-48c4-bc07-f8a83d73a132 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.180743 Apr 05 12:07:58.419384 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1075/2128] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:07:58 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:58.461359 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c3098fe4-df37-4bb7-a1ea-f62e03b32d73 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:58.470052 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c3098fe4-df37-4bb7-a1ea-f62e03b32d73 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.156221 Apr 05 12:07:58.470600 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1054/2129] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:07:58 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:59.441766 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8f1e7651-9d22-4a04-9a15-1cd46dab0cf0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:59.442580 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8f1e7651-9d22-4a04-9a15-1cd46dab0cf0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:59.450929 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8f1e7651-9d22-4a04-9a15-1cd46dab0cf0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:59.451394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8f1e7651-9d22-4a04-9a15-1cd46dab0cf0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:59.452176 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8f1e7651-9d22-4a04-9a15-1cd46dab0cf0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:59.452614 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8f1e7651-9d22-4a04-9a15-1cd46dab0cf0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:59.491506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-02c82fed-895d-4996-a890-27415227e53f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:07:59.492219 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-02c82fed-895d-4996-a890-27415227e53f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:07:59.498567 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02c82fed-895d-4996-a890-27415227e53f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:59.498965 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02c82fed-895d-4996-a890-27415227e53f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:59.499726 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02c82fed-895d-4996-a890-27415227e53f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:07:59.500179 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02c82fed-895d-4996-a890-27415227e53f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:07:59.595669 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8f1e7651-9d22-4a04-9a15-1cd46dab0cf0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:59.604763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8f1e7651-9d22-4a04-9a15-1cd46dab0cf0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:59.606427 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8f1e7651-9d22-4a04-9a15-1cd46dab0cf0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:59.607658 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8f1e7651-9d22-4a04-9a15-1cd46dab0cf0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.172738 Apr 05 12:07:59.608248 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1076/2130] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:07:59 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:59.650555 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-02c82fed-895d-4996-a890-27415227e53f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:07:59.658315 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-02c82fed-895d-4996-a890-27415227e53f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.170747 Apr 05 12:07:59.659910 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1055/2131] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:07:59 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:00.630124 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3eda9104-8a26-4a4f-9e27-3994aea3b11a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:00.631271 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3eda9104-8a26-4a4f-9e27-3994aea3b11a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:00.641895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3eda9104-8a26-4a4f-9e27-3994aea3b11a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:00.642591 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3eda9104-8a26-4a4f-9e27-3994aea3b11a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:00.643817 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3eda9104-8a26-4a4f-9e27-3994aea3b11a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:00.644769 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3eda9104-8a26-4a4f-9e27-3994aea3b11a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:00.676206 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cc2fdd8c-b8ff-4c35-9deb-6eef15994c5e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:00.676926 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cc2fdd8c-b8ff-4c35-9deb-6eef15994c5e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:00.683951 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cc2fdd8c-b8ff-4c35-9deb-6eef15994c5e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:00.684512 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cc2fdd8c-b8ff-4c35-9deb-6eef15994c5e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:00.685338 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cc2fdd8c-b8ff-4c35-9deb-6eef15994c5e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:00.685853 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cc2fdd8c-b8ff-4c35-9deb-6eef15994c5e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:00.792461 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3eda9104-8a26-4a4f-9e27-3994aea3b11a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:00.800815 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3eda9104-8a26-4a4f-9e27-3994aea3b11a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:00.802388 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3eda9104-8a26-4a4f-9e27-3994aea3b11a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:00.803614 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3eda9104-8a26-4a4f-9e27-3994aea3b11a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.180325 Apr 05 12:08:00.804292 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1077/2132] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:00 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:00.823376 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-cc2fdd8c-b8ff-4c35-9deb-6eef15994c5e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:00.831060 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cc2fdd8c-b8ff-4c35-9deb-6eef15994c5e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.158696 Apr 05 12:08:00.831634 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1056/2133] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:00 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:01.822496 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4acc9f48-9d5c-409c-8014-ee6c9e0c65e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:01.823276 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4acc9f48-9d5c-409c-8014-ee6c9e0c65e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:01.829745 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4acc9f48-9d5c-409c-8014-ee6c9e0c65e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:01.830187 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4acc9f48-9d5c-409c-8014-ee6c9e0c65e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:01.830933 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4acc9f48-9d5c-409c-8014-ee6c9e0c65e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:01.831365 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4acc9f48-9d5c-409c-8014-ee6c9e0c65e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:01.847680 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9ab587a8-e0b7-46bf-abe2-33a0d1b12dd9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:01.848323 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9ab587a8-e0b7-46bf-abe2-33a0d1b12dd9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:01.854718 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9ab587a8-e0b7-46bf-abe2-33a0d1b12dd9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:01.855168 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9ab587a8-e0b7-46bf-abe2-33a0d1b12dd9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:01.855925 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9ab587a8-e0b7-46bf-abe2-33a0d1b12dd9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:01.856388 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9ab587a8-e0b7-46bf-abe2-33a0d1b12dd9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:01.965182 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4acc9f48-9d5c-409c-8014-ee6c9e0c65e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:01.973444 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4acc9f48-9d5c-409c-8014-ee6c9e0c65e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:01.974932 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4acc9f48-9d5c-409c-8014-ee6c9e0c65e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:01.976091 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4acc9f48-9d5c-409c-8014-ee6c9e0c65e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.157490 Apr 05 12:08:01.976671 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1078/2134] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:01 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:01.987552 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9ab587a8-e0b7-46bf-abe2-33a0d1b12dd9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:01.995337 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9ab587a8-e0b7-46bf-abe2-33a0d1b12dd9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.151517 Apr 05 12:08:01.995833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1057/2135] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:01 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:08:02.997478 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e258bcc5-163d-4327-91b3-af1bd5b805a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:02.998115 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e258bcc5-163d-4327-91b3-af1bd5b805a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:03.005359 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e258bcc5-163d-4327-91b3-af1bd5b805a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:03.005750 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e258bcc5-163d-4327-91b3-af1bd5b805a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:03.006507 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e258bcc5-163d-4327-91b3-af1bd5b805a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:03.006946 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e258bcc5-163d-4327-91b3-af1bd5b805a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:03.012742 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-dc1ebe50-6e28-4f4d-b65e-ada9aeb54d59 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:03.013361 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-dc1ebe50-6e28-4f4d-b65e-ada9aeb54d59 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:03.019965 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dc1ebe50-6e28-4f4d-b65e-ada9aeb54d59 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:03.020447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dc1ebe50-6e28-4f4d-b65e-ada9aeb54d59 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:03.021213 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dc1ebe50-6e28-4f4d-b65e-ada9aeb54d59 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:03.021643 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dc1ebe50-6e28-4f4d-b65e-ada9aeb54d59 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:03.144830 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e258bcc5-163d-4327-91b3-af1bd5b805a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:03.153508 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e258bcc5-163d-4327-91b3-af1bd5b805a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:03.154991 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e258bcc5-163d-4327-91b3-af1bd5b805a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:03.156175 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e258bcc5-163d-4327-91b3-af1bd5b805a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.163914 Apr 05 12:08:03.156700 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1079/2136] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:02 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:03.160197 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-dc1ebe50-6e28-4f4d-b65e-ada9aeb54d59 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:03.168063 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-dc1ebe50-6e28-4f4d-b65e-ada9aeb54d59 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.159224 Apr 05 12:08:03.168657 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1058/2137] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:03 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:04.179409 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e7255c7f-ba8e-4227-b5a0-b10b0d43b432 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:04.180312 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e7255c7f-ba8e-4227-b5a0-b10b0d43b432 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:04.189306 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3e1e36ee-f934-44b0-9daf-f2543ba41bb5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:04.190314 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3e1e36ee-f934-44b0-9daf-f2543ba41bb5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:04.190701 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e7255c7f-ba8e-4227-b5a0-b10b0d43b432 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:04.191441 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e7255c7f-ba8e-4227-b5a0-b10b0d43b432 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:04.192698 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e7255c7f-ba8e-4227-b5a0-b10b0d43b432 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:04.193437 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e7255c7f-ba8e-4227-b5a0-b10b0d43b432 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:04.199772 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e1e36ee-f934-44b0-9daf-f2543ba41bb5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:04.200298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e1e36ee-f934-44b0-9daf-f2543ba41bb5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:04.201070 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e1e36ee-f934-44b0-9daf-f2543ba41bb5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:04.201510 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e1e36ee-f934-44b0-9daf-f2543ba41bb5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:04.328284 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e7255c7f-ba8e-4227-b5a0-b10b0d43b432 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:04.333710 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3e1e36ee-f934-44b0-9daf-f2543ba41bb5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:04.336844 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e7255c7f-ba8e-4227-b5a0-b10b0d43b432 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:04.338345 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e7255c7f-ba8e-4227-b5a0-b10b0d43b432 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:04.339583 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e7255c7f-ba8e-4227-b5a0-b10b0d43b432 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.166885 Apr 05 12:08:04.340168 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1080/2138] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:04 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:04.342074 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3e1e36ee-f934-44b0-9daf-f2543ba41bb5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.159247 Apr 05 12:08:04.342636 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1059/2139] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:04 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:05.362089 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5bc9298c-ca2d-436e-ac5b-ee618e25d08b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:05.362978 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8cfeb35c-a014-482e-8f55-32043865180f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:05.363576 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5bc9298c-ca2d-436e-ac5b-ee618e25d08b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:05.363735 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8cfeb35c-a014-482e-8f55-32043865180f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:05.372227 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8cfeb35c-a014-482e-8f55-32043865180f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:05.372384 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5bc9298c-ca2d-436e-ac5b-ee618e25d08b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:05.372676 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8cfeb35c-a014-482e-8f55-32043865180f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:05.372846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5bc9298c-ca2d-436e-ac5b-ee618e25d08b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:05.373437 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8cfeb35c-a014-482e-8f55-32043865180f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:05.373584 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5bc9298c-ca2d-436e-ac5b-ee618e25d08b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:05.373864 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8cfeb35c-a014-482e-8f55-32043865180f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:05.374023 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5bc9298c-ca2d-436e-ac5b-ee618e25d08b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:05.510655 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8cfeb35c-a014-482e-8f55-32043865180f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:05.516428 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5bc9298c-ca2d-436e-ac5b-ee618e25d08b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:05.518605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8cfeb35c-a014-482e-8f55-32043865180f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.162522 Apr 05 12:08:05.519217 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1060/2140] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:05 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:05.524945 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5bc9298c-ca2d-436e-ac5b-ee618e25d08b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:05.526417 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5bc9298c-ca2d-436e-ac5b-ee618e25d08b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:05.527623 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5bc9298c-ca2d-436e-ac5b-ee618e25d08b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.172001 Apr 05 12:08:05.528187 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1081/2141] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:05 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:06.535947 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-314623d8-c938-4c96-b85a-c6b9704bce9b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:06.536601 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-314623d8-c938-4c96-b85a-c6b9704bce9b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:06.543366 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-314623d8-c938-4c96-b85a-c6b9704bce9b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:06.543813 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-314623d8-c938-4c96-b85a-c6b9704bce9b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:06.544607 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-314623d8-c938-4c96-b85a-c6b9704bce9b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:06.545039 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-314623d8-c938-4c96-b85a-c6b9704bce9b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:06.545462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5e26e171-f80b-4ff9-8e0a-db0ae01fe8cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:06.546064 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5e26e171-f80b-4ff9-8e0a-db0ae01fe8cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:06.552521 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5e26e171-f80b-4ff9-8e0a-db0ae01fe8cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:06.552961 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5e26e171-f80b-4ff9-8e0a-db0ae01fe8cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:06.553706 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5e26e171-f80b-4ff9-8e0a-db0ae01fe8cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:06.554128 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5e26e171-f80b-4ff9-8e0a-db0ae01fe8cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:06.678079 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-314623d8-c938-4c96-b85a-c6b9704bce9b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:06.686710 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5e26e171-f80b-4ff9-8e0a-db0ae01fe8cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:06.686932 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-314623d8-c938-4c96-b85a-c6b9704bce9b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.154621 Apr 05 12:08:06.687298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1061/2142] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:06 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:06.695672 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5e26e171-f80b-4ff9-8e0a-db0ae01fe8cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:06.697267 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5e26e171-f80b-4ff9-8e0a-db0ae01fe8cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:06.698441 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5e26e171-f80b-4ff9-8e0a-db0ae01fe8cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.157038 Apr 05 12:08:06.698984 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1082/2143] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:06 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:07.708758 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0db0a229-b40f-4cf4-b56e-c058507c8c7c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:07.712129 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0db0a229-b40f-4cf4-b56e-c058507c8c7c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:07.719830 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7d054da6-b2f8-4d39-95d3-127f29456e9c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:07.720626 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0db0a229-b40f-4cf4-b56e-c058507c8c7c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:07.721202 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7d054da6-b2f8-4d39-95d3-127f29456e9c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:07.721516 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0db0a229-b40f-4cf4-b56e-c058507c8c7c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:07.722572 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0db0a229-b40f-4cf4-b56e-c058507c8c7c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:07.723276 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0db0a229-b40f-4cf4-b56e-c058507c8c7c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:07.731391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7d054da6-b2f8-4d39-95d3-127f29456e9c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:07.731836 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7d054da6-b2f8-4d39-95d3-127f29456e9c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:07.732618 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7d054da6-b2f8-4d39-95d3-127f29456e9c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:07.733042 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7d054da6-b2f8-4d39-95d3-127f29456e9c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:07.864910 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0db0a229-b40f-4cf4-b56e-c058507c8c7c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:07.866902 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7d054da6-b2f8-4d39-95d3-127f29456e9c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:07.873281 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0db0a229-b40f-4cf4-b56e-c058507c8c7c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.171581 Apr 05 12:08:07.873862 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1062/2144] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:07 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:07.875116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7d054da6-b2f8-4d39-95d3-127f29456e9c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:07.876664 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7d054da6-b2f8-4d39-95d3-127f29456e9c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:07.877812 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7d054da6-b2f8-4d39-95d3-127f29456e9c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.164573 Apr 05 12:08:07.878338 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1083/2145] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:07 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:08.895363 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fee1f3e1-c680-4fbb-83a3-b27e1f8d9397 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:08.896251 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fee1f3e1-c680-4fbb-83a3-b27e1f8d9397 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:08.899817 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e38fa9b5-c52e-4861-92a7-ec674884f444 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:08.900848 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e38fa9b5-c52e-4861-92a7-ec674884f444 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:08.905464 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fee1f3e1-c680-4fbb-83a3-b27e1f8d9397 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:08.905943 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fee1f3e1-c680-4fbb-83a3-b27e1f8d9397 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:08.906819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fee1f3e1-c680-4fbb-83a3-b27e1f8d9397 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:08.907255 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fee1f3e1-c680-4fbb-83a3-b27e1f8d9397 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:08.907870 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e38fa9b5-c52e-4861-92a7-ec674884f444 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:08.908353 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e38fa9b5-c52e-4861-92a7-ec674884f444 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:08.909737 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e38fa9b5-c52e-4861-92a7-ec674884f444 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:08.910187 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e38fa9b5-c52e-4861-92a7-ec674884f444 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:09.038839 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fee1f3e1-c680-4fbb-83a3-b27e1f8d9397 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:09.046152 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e38fa9b5-c52e-4861-92a7-ec674884f444 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:09.046697 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fee1f3e1-c680-4fbb-83a3-b27e1f8d9397 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.158274 Apr 05 12:08:09.047294 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1063/2146] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:08 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:09.054364 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e38fa9b5-c52e-4861-92a7-ec674884f444 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:09.055847 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e38fa9b5-c52e-4861-92a7-ec674884f444 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:09.057014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e38fa9b5-c52e-4861-92a7-ec674884f444 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.163811 Apr 05 12:08:09.057565 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1084/2147] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:08 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:10.068107 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b0950ed9-092e-4874-b068-b93ebec91be6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:10.069109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b0950ed9-092e-4874-b068-b93ebec91be6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:10.077324 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e35aee1f-768c-4cd8-8a1b-b4adf5e6433d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:10.077811 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b0950ed9-092e-4874-b068-b93ebec91be6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:10.077916 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e35aee1f-768c-4cd8-8a1b-b4adf5e6433d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:10.078278 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b0950ed9-092e-4874-b068-b93ebec91be6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:10.079038 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b0950ed9-092e-4874-b068-b93ebec91be6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:10.079477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b0950ed9-092e-4874-b068-b93ebec91be6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:10.084617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e35aee1f-768c-4cd8-8a1b-b4adf5e6433d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:10.085068 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e35aee1f-768c-4cd8-8a1b-b4adf5e6433d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:10.085808 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e35aee1f-768c-4cd8-8a1b-b4adf5e6433d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:10.086237 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e35aee1f-768c-4cd8-8a1b-b4adf5e6433d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:10.213983 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b0950ed9-092e-4874-b068-b93ebec91be6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:10.227510 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e35aee1f-768c-4cd8-8a1b-b4adf5e6433d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:10.230297 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b0950ed9-092e-4874-b068-b93ebec91be6 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.168545 Apr 05 12:08:10.231033 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1064/2148] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:10 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:10.245619 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e35aee1f-768c-4cd8-8a1b-b4adf5e6433d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:10.247086 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e35aee1f-768c-4cd8-8a1b-b4adf5e6433d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:10.248282 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e35aee1f-768c-4cd8-8a1b-b4adf5e6433d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.176004 Apr 05 12:08:10.248838 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1085/2149] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:10 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:11.249917 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-33ab123d-7dc4-487a-b223-07ba4c70705f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:11.250598 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-33ab123d-7dc4-487a-b223-07ba4c70705f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:11.257093 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-33ab123d-7dc4-487a-b223-07ba4c70705f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:11.257614 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-33ab123d-7dc4-487a-b223-07ba4c70705f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:11.258369 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-33ab123d-7dc4-487a-b223-07ba4c70705f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:11.258794 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-33ab123d-7dc4-487a-b223-07ba4c70705f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:11.266949 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6a778960-5c25-448b-a5ed-b7ca51b489a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:11.267590 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6a778960-5c25-448b-a5ed-b7ca51b489a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:11.274148 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6a778960-5c25-448b-a5ed-b7ca51b489a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:11.274600 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6a778960-5c25-448b-a5ed-b7ca51b489a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:11.275342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6a778960-5c25-448b-a5ed-b7ca51b489a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:11.275789 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6a778960-5c25-448b-a5ed-b7ca51b489a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:11.402366 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-33ab123d-7dc4-487a-b223-07ba4c70705f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:11.410362 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-33ab123d-7dc4-487a-b223-07ba4c70705f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.164892 Apr 05 12:08:11.410978 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1065/2150] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:11 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:11.411232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6a778960-5c25-448b-a5ed-b7ca51b489a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:11.419642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6a778960-5c25-448b-a5ed-b7ca51b489a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:11.421169 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6a778960-5c25-448b-a5ed-b7ca51b489a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:11.422441 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6a778960-5c25-448b-a5ed-b7ca51b489a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.159437 Apr 05 12:08:11.422998 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1086/2151] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:11 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:12.426738 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ddd93df5-cdad-4528-b9d4-312af12539b1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:12.427315 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ddd93df5-cdad-4528-b9d4-312af12539b1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:12.435659 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ddd93df5-cdad-4528-b9d4-312af12539b1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:12.436145 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ddd93df5-cdad-4528-b9d4-312af12539b1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:12.440410 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ddd93df5-cdad-4528-b9d4-312af12539b1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:12.440410 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ddd93df5-cdad-4528-b9d4-312af12539b1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:12.440634 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7d835466-f7a6-46fb-96fd-d379ca47e3f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:12.441035 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7d835466-f7a6-46fb-96fd-d379ca47e3f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:12.447440 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7d835466-f7a6-46fb-96fd-d379ca47e3f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:12.447890 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7d835466-f7a6-46fb-96fd-d379ca47e3f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:12.448699 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7d835466-f7a6-46fb-96fd-d379ca47e3f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:12.449133 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7d835466-f7a6-46fb-96fd-d379ca47e3f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:12.572715 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ddd93df5-cdad-4528-b9d4-312af12539b1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:12.580956 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ddd93df5-cdad-4528-b9d4-312af12539b1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.157928 Apr 05 12:08:12.581781 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1066/2152] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:12 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:12.586988 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7d835466-f7a6-46fb-96fd-d379ca47e3f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:12.595449 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7d835466-f7a6-46fb-96fd-d379ca47e3f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:12.596971 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7d835466-f7a6-46fb-96fd-d379ca47e3f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:12.598143 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7d835466-f7a6-46fb-96fd-d379ca47e3f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.161981 Apr 05 12:08:12.598713 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1087/2153] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:12 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:13.602404 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-15bc50ca-6213-41f3-9c09-36ab726e664a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:13.603428 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-15bc50ca-6213-41f3-9c09-36ab726e664a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:13.614254 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-15bc50ca-6213-41f3-9c09-36ab726e664a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:13.614907 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-15bc50ca-6213-41f3-9c09-36ab726e664a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:13.616203 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-15bc50ca-6213-41f3-9c09-36ab726e664a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:13.616931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-15bc50ca-6213-41f3-9c09-36ab726e664a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:13.620462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1275496b-ae54-4f09-8159-7755cf7067cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:13.621571 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1275496b-ae54-4f09-8159-7755cf7067cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:13.627943 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1275496b-ae54-4f09-8159-7755cf7067cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:13.628428 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1275496b-ae54-4f09-8159-7755cf7067cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:13.629475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1275496b-ae54-4f09-8159-7755cf7067cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:13.629931 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1275496b-ae54-4f09-8159-7755cf7067cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:13.753998 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-15bc50ca-6213-41f3-9c09-36ab726e664a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:13.762559 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-15bc50ca-6213-41f3-9c09-36ab726e664a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.166503 Apr 05 12:08:13.763136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1067/2154] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:13 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:13.764030 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1275496b-ae54-4f09-8159-7755cf7067cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:13.778341 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1275496b-ae54-4f09-8159-7755cf7067cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:13.779837 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1275496b-ae54-4f09-8159-7755cf7067cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:13.782525 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1275496b-ae54-4f09-8159-7755cf7067cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.167021 Apr 05 12:08:13.783085 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1088/2155] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:13 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:14.782886 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b59e020a-cb63-44b8-a6f1-11dca8d2c56e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:14.783871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b59e020a-cb63-44b8-a6f1-11dca8d2c56e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:14.794467 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b59e020a-cb63-44b8-a6f1-11dca8d2c56e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:14.795243 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b59e020a-cb63-44b8-a6f1-11dca8d2c56e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:14.796537 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b59e020a-cb63-44b8-a6f1-11dca8d2c56e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:14.797248 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b59e020a-cb63-44b8-a6f1-11dca8d2c56e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:14.804237 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-00ecdbaa-4892-4481-8889-ba00a2decd62 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:14.805388 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-00ecdbaa-4892-4481-8889-ba00a2decd62 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:14.813479 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-00ecdbaa-4892-4481-8889-ba00a2decd62 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:14.813929 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-00ecdbaa-4892-4481-8889-ba00a2decd62 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:14.814695 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-00ecdbaa-4892-4481-8889-ba00a2decd62 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:14.815099 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-00ecdbaa-4892-4481-8889-ba00a2decd62 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:14.935860 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b59e020a-cb63-44b8-a6f1-11dca8d2c56e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:14.943810 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b59e020a-cb63-44b8-a6f1-11dca8d2c56e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.167469 Apr 05 12:08:14.944347 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1068/2156] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:14 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:14.946241 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-00ecdbaa-4892-4481-8889-ba00a2decd62 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:14.954665 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-00ecdbaa-4892-4481-8889-ba00a2decd62 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:14.956153 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-00ecdbaa-4892-4481-8889-ba00a2decd62 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:14.957306 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-00ecdbaa-4892-4481-8889-ba00a2decd62 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.159586 Apr 05 12:08:14.958015 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1089/2157] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:14 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:15.964949 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6878d42b-7522-418c-b0e1-eabace07634f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:15.965997 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6878d42b-7522-418c-b0e1-eabace07634f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:15.977269 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6878d42b-7522-418c-b0e1-eabace07634f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:15.978005 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6878d42b-7522-418c-b0e1-eabace07634f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:15.978439 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ecc7f937-97c2-4793-aa5f-d5824bb436c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:15.979230 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6878d42b-7522-418c-b0e1-eabace07634f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:15.979421 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ecc7f937-97c2-4793-aa5f-d5824bb436c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:15.979983 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6878d42b-7522-418c-b0e1-eabace07634f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:15.987124 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ecc7f937-97c2-4793-aa5f-d5824bb436c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:15.987574 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ecc7f937-97c2-4793-aa5f-d5824bb436c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:15.988374 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ecc7f937-97c2-4793-aa5f-d5824bb436c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:15.988805 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ecc7f937-97c2-4793-aa5f-d5824bb436c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:16.115239 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6878d42b-7522-418c-b0e1-eabace07634f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:16.118099 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ecc7f937-97c2-4793-aa5f-d5824bb436c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:16.123327 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6878d42b-7522-418c-b0e1-eabace07634f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.164871 Apr 05 12:08:16.123897 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1069/2158] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:15 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:16.126499 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ecc7f937-97c2-4793-aa5f-d5824bb436c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:16.128308 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ecc7f937-97c2-4793-aa5f-d5824bb436c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:16.129797 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ecc7f937-97c2-4793-aa5f-d5824bb436c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.157397 Apr 05 12:08:16.130358 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1090/2159] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:15 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:17.145370 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-eb1bd04f-eb0b-4688-8872-f7dd0f0c0850 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:17.146410 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-eb1bd04f-eb0b-4688-8872-f7dd0f0c0850 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:17.152836 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d2ac491a-022f-4911-a9d7-93c71bc4efbd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:17.153829 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d2ac491a-022f-4911-a9d7-93c71bc4efbd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:17.155995 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eb1bd04f-eb0b-4688-8872-f7dd0f0c0850 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:17.156472 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eb1bd04f-eb0b-4688-8872-f7dd0f0c0850 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:17.157239 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eb1bd04f-eb0b-4688-8872-f7dd0f0c0850 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:17.157636 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eb1bd04f-eb0b-4688-8872-f7dd0f0c0850 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:17.160348 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d2ac491a-022f-4911-a9d7-93c71bc4efbd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:17.160796 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d2ac491a-022f-4911-a9d7-93c71bc4efbd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:17.161547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d2ac491a-022f-4911-a9d7-93c71bc4efbd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:17.161982 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d2ac491a-022f-4911-a9d7-93c71bc4efbd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:17.293388 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-eb1bd04f-eb0b-4688-8872-f7dd0f0c0850 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:17.293557 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d2ac491a-022f-4911-a9d7-93c71bc4efbd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:17.302108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-eb1bd04f-eb0b-4688-8872-f7dd0f0c0850 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.163337 Apr 05 12:08:17.302336 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d2ac491a-022f-4911-a9d7-93c71bc4efbd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:17.302679 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1070/2160] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:17 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:17.303917 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d2ac491a-022f-4911-a9d7-93c71bc4efbd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:17.305186 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d2ac491a-022f-4911-a9d7-93c71bc4efbd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.159738 Apr 05 12:08:17.305739 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1091/2161] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:17 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:18.323738 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f653236b-e46a-4218-a312-bf1832a4bffd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:18.324712 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f653236b-e46a-4218-a312-bf1832a4bffd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:18.327187 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c02b5c42-188a-4fb2-b373-5f4ff7d03910 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:18.328262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c02b5c42-188a-4fb2-b373-5f4ff7d03910 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:18.333259 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f653236b-e46a-4218-a312-bf1832a4bffd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:18.333643 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f653236b-e46a-4218-a312-bf1832a4bffd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:18.334412 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f653236b-e46a-4218-a312-bf1832a4bffd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:18.334822 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f653236b-e46a-4218-a312-bf1832a4bffd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:18.335000 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c02b5c42-188a-4fb2-b373-5f4ff7d03910 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:18.335445 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c02b5c42-188a-4fb2-b373-5f4ff7d03910 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:18.336253 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c02b5c42-188a-4fb2-b373-5f4ff7d03910 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:18.336681 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c02b5c42-188a-4fb2-b373-5f4ff7d03910 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:18.469883 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f653236b-e46a-4218-a312-bf1832a4bffd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:18.471725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c02b5c42-188a-4fb2-b373-5f4ff7d03910 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:18.478034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f653236b-e46a-4218-a312-bf1832a4bffd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.160982 Apr 05 12:08:18.478606 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1071/2162] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:18 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:18.480064 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c02b5c42-188a-4fb2-b373-5f4ff7d03910 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:18.481577 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c02b5c42-188a-4fb2-b373-5f4ff7d03910 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:18.482746 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c02b5c42-188a-4fb2-b373-5f4ff7d03910 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.161934 Apr 05 12:08:18.483323 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1092/2163] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:18 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:19.497755 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7de1691f-2dd5-4b1c-86ee-60f5a155ee0b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:19.498530 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7de1691f-2dd5-4b1c-86ee-60f5a155ee0b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:19.502564 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b2958f8a-f489-4a1c-8926-39913a71ec8e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:19.503263 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b2958f8a-f489-4a1c-8926-39913a71ec8e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:19.505367 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7de1691f-2dd5-4b1c-86ee-60f5a155ee0b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:19.505814 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7de1691f-2dd5-4b1c-86ee-60f5a155ee0b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:19.506580 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7de1691f-2dd5-4b1c-86ee-60f5a155ee0b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:19.507031 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7de1691f-2dd5-4b1c-86ee-60f5a155ee0b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:19.510151 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b2958f8a-f489-4a1c-8926-39913a71ec8e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:19.510696 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b2958f8a-f489-4a1c-8926-39913a71ec8e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:19.512198 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b2958f8a-f489-4a1c-8926-39913a71ec8e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:19.513181 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b2958f8a-f489-4a1c-8926-39913a71ec8e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:19.645413 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7de1691f-2dd5-4b1c-86ee-60f5a155ee0b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:19.647588 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b2958f8a-f489-4a1c-8926-39913a71ec8e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:19.653775 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7de1691f-2dd5-4b1c-86ee-60f5a155ee0b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.162106 Apr 05 12:08:19.654427 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1072/2164] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:19 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:19.655909 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b2958f8a-f489-4a1c-8926-39913a71ec8e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:19.657444 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b2958f8a-f489-4a1c-8926-39913a71ec8e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:19.658604 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b2958f8a-f489-4a1c-8926-39913a71ec8e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.160844 Apr 05 12:08:19.659153 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1093/2165] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:19 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:20.674474 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0f6fc6ec-574e-4360-aa37-a42fab741c36 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:20.675313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0f6fc6ec-574e-4360-aa37-a42fab741c36 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:20.678012 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-dc0facdc-d477-4605-9450-c954ec9ab23f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:20.678676 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-dc0facdc-d477-4605-9450-c954ec9ab23f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:20.682403 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0f6fc6ec-574e-4360-aa37-a42fab741c36 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:20.682871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0f6fc6ec-574e-4360-aa37-a42fab741c36 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:20.683659 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0f6fc6ec-574e-4360-aa37-a42fab741c36 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:20.684111 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0f6fc6ec-574e-4360-aa37-a42fab741c36 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:20.685518 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dc0facdc-d477-4605-9450-c954ec9ab23f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:20.685984 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dc0facdc-d477-4605-9450-c954ec9ab23f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:20.686767 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dc0facdc-d477-4605-9450-c954ec9ab23f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:20.687237 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dc0facdc-d477-4605-9450-c954ec9ab23f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:20.820917 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0f6fc6ec-574e-4360-aa37-a42fab741c36 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:20.823695 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-dc0facdc-d477-4605-9450-c954ec9ab23f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:20.830612 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0f6fc6ec-574e-4360-aa37-a42fab741c36 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.161661 Apr 05 12:08:20.831430 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1073/2166] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:20 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:20.832447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-dc0facdc-d477-4605-9450-c954ec9ab23f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:20.835265 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-dc0facdc-d477-4605-9450-c954ec9ab23f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:20.835265 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-dc0facdc-d477-4605-9450-c954ec9ab23f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.161139 Apr 05 12:08:20.845806 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1094/2167] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:20 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:21.855383 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e5ba7381-f1ee-462d-ac03-2c808317d5bc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:21.856556 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e5ba7381-f1ee-462d-ac03-2c808317d5bc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:21.859117 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cee1eed3-bb53-40dd-98e7-7b68703aafe5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:21.860022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cee1eed3-bb53-40dd-98e7-7b68703aafe5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:21.865082 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e5ba7381-f1ee-462d-ac03-2c808317d5bc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:21.865849 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e5ba7381-f1ee-462d-ac03-2c808317d5bc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:21.866651 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e5ba7381-f1ee-462d-ac03-2c808317d5bc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:21.867184 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e5ba7381-f1ee-462d-ac03-2c808317d5bc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:21.868033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cee1eed3-bb53-40dd-98e7-7b68703aafe5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:21.868488 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cee1eed3-bb53-40dd-98e7-7b68703aafe5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:21.869294 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cee1eed3-bb53-40dd-98e7-7b68703aafe5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:21.869710 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cee1eed3-bb53-40dd-98e7-7b68703aafe5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:22.007499 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e5ba7381-f1ee-462d-ac03-2c808317d5bc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:22.012201 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cee1eed3-bb53-40dd-98e7-7b68703aafe5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:22.015321 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e5ba7381-f1ee-462d-ac03-2c808317d5bc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.169036 Apr 05 12:08:22.015893 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1074/2168] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:21 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:22.020745 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cee1eed3-bb53-40dd-98e7-7b68703aafe5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:22.022351 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cee1eed3-bb53-40dd-98e7-7b68703aafe5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:22.023558 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cee1eed3-bb53-40dd-98e7-7b68703aafe5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.172903 Apr 05 12:08:22.024203 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1095/2169] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:21 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:23.032881 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4dc9dcb3-310a-4054-9633-88b3ddbc6035 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:23.033497 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4dc9dcb3-310a-4054-9633-88b3ddbc6035 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:23.040329 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4dc9dcb3-310a-4054-9633-88b3ddbc6035 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:23.040788 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4dc9dcb3-310a-4054-9633-88b3ddbc6035 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:23.041548 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4dc9dcb3-310a-4054-9633-88b3ddbc6035 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:23.041978 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4dc9dcb3-310a-4054-9633-88b3ddbc6035 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:23.045590 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c769cb10-3f02-418f-a3fd-43edf9b34ea6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:23.046201 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c769cb10-3f02-418f-a3fd-43edf9b34ea6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:23.052494 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c769cb10-3f02-418f-a3fd-43edf9b34ea6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:23.052952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c769cb10-3f02-418f-a3fd-43edf9b34ea6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:23.053718 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c769cb10-3f02-418f-a3fd-43edf9b34ea6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:23.054145 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c769cb10-3f02-418f-a3fd-43edf9b34ea6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:23.173111 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4dc9dcb3-310a-4054-9633-88b3ddbc6035 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:23.181257 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4dc9dcb3-310a-4054-9633-88b3ddbc6035 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.152317 Apr 05 12:08:23.181838 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1075/2170] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:23 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:23.189585 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c769cb10-3f02-418f-a3fd-43edf9b34ea6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:23.198141 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c769cb10-3f02-418f-a3fd-43edf9b34ea6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:23.199645 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c769cb10-3f02-418f-a3fd-43edf9b34ea6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:23.200822 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c769cb10-3f02-418f-a3fd-43edf9b34ea6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.159329 Apr 05 12:08:23.201377 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1096/2171] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:23 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:24.038394 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0463cd41-7aa0-4b2e-94d0-d0675de93d18 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:24.038962 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0463cd41-7aa0-4b2e-94d0-d0675de93d18 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:24.045348 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0463cd41-7aa0-4b2e-94d0-d0675de93d18 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:24.045821 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0463cd41-7aa0-4b2e-94d0-d0675de93d18 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:24.046604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0463cd41-7aa0-4b2e-94d0-d0675de93d18 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:24.047209 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0463cd41-7aa0-4b2e-94d0-d0675de93d18 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:24.071850 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0463cd41-7aa0-4b2e-94d0-d0675de93d18 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Going to try to terminate instance {{(pid=123357) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 12:08:24.150890 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0463cd41-7aa0-4b2e-94d0-d0675de93d18 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 204 len: 0 microversion: 2.1 time: 0.116059 Apr 05 12:08:24.151510 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1076/2172] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 12:08:24 2022] DELETE /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:08:24.160006 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-94071077-3dc7-4105-8740-ff946e68169c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:24.160659 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-94071077-3dc7-4105-8740-ff946e68169c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:24.167043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94071077-3dc7-4105-8740-ff946e68169c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:24.167497 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94071077-3dc7-4105-8740-ff946e68169c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:24.168282 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94071077-3dc7-4105-8740-ff946e68169c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:24.168719 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94071077-3dc7-4105-8740-ff946e68169c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:24.199350 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c94494b0-ae20-4628-b1d5-3be454b62702 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:24.200055 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c94494b0-ae20-4628-b1d5-3be454b62702 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:24.206032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c94494b0-ae20-4628-b1d5-3be454b62702 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:24.206462 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c94494b0-ae20-4628-b1d5-3be454b62702 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:24.207223 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c94494b0-ae20-4628-b1d5-3be454b62702 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:24.207656 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c94494b0-ae20-4628-b1d5-3be454b62702 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:24.303203 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-94071077-3dc7-4105-8740-ff946e68169c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:24.311288 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-94071077-3dc7-4105-8740-ff946e68169c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.155223 Apr 05 12:08:24.311904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1097/2173] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:24 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:24.316616 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c7f3adce-6367-48c3-a460-d2d3145b0630 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:24.317234 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c7f3adce-6367-48c3-a460-d2d3145b0630 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:24.323113 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c7f3adce-6367-48c3-a460-d2d3145b0630 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:24.323746 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c7f3adce-6367-48c3-a460-d2d3145b0630 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:24.324597 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c7f3adce-6367-48c3-a460-d2d3145b0630 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:24.325024 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c7f3adce-6367-48c3-a460-d2d3145b0630 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:24.341540 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c94494b0-ae20-4628-b1d5-3be454b62702 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:24.349309 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c94494b0-ae20-4628-b1d5-3be454b62702 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.154510 Apr 05 12:08:24.349885 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1077/2174] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:24 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:08:24.477858 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c7f3adce-6367-48c3-a460-d2d3145b0630 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:24.486998 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c7f3adce-6367-48c3-a460-d2d3145b0630 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:24.488507 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c7f3adce-6367-48c3-a460-d2d3145b0630 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:24.489667 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c7f3adce-6367-48c3-a460-d2d3145b0630 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.176596 Apr 05 12:08:24.490226 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1098/2175] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:24 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:25.333025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-56f2e376-a5ae-46ec-bf9f-3c335c639c1a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:25.333901 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-56f2e376-a5ae-46ec-bf9f-3c335c639c1a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:25.344555 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56f2e376-a5ae-46ec-bf9f-3c335c639c1a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:25.345205 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56f2e376-a5ae-46ec-bf9f-3c335c639c1a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:25.345958 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56f2e376-a5ae-46ec-bf9f-3c335c639c1a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:25.346388 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56f2e376-a5ae-46ec-bf9f-3c335c639c1a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:25.367140 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-42ccb258-9d04-41e4-85b4-798464702a96 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:25.367721 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-42ccb258-9d04-41e4-85b4-798464702a96 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:25.374368 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-42ccb258-9d04-41e4-85b4-798464702a96 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:25.374822 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-42ccb258-9d04-41e4-85b4-798464702a96 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:25.375588 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-42ccb258-9d04-41e4-85b4-798464702a96 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:25.376101 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-42ccb258-9d04-41e4-85b4-798464702a96 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:25.515663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-42ccb258-9d04-41e4-85b4-798464702a96 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:25.524206 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-42ccb258-9d04-41e4-85b4-798464702a96 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.161124 Apr 05 12:08:25.524792 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1099/2176] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:25 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:25.529552 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-583c8a3f-7102-416e-8cdc-4502b741fe5c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:25.530166 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-583c8a3f-7102-416e-8cdc-4502b741fe5c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:25.536820 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-583c8a3f-7102-416e-8cdc-4502b741fe5c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:25.537274 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-583c8a3f-7102-416e-8cdc-4502b741fe5c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:25.538047 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-583c8a3f-7102-416e-8cdc-4502b741fe5c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:25.538479 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-583c8a3f-7102-416e-8cdc-4502b741fe5c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:25.680020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-583c8a3f-7102-416e-8cdc-4502b741fe5c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:25.688518 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-583c8a3f-7102-416e-8cdc-4502b741fe5c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:25.690012 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-583c8a3f-7102-416e-8cdc-4502b741fe5c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:25.691174 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-583c8a3f-7102-416e-8cdc-4502b741fe5c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.165501 Apr 05 12:08:25.691744 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1100/2177] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:25 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:25.726036 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-56f2e376-a5ae-46ec-bf9f-3c335c639c1a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:25.733897 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-56f2e376-a5ae-46ec-bf9f-3c335c639c1a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.407468 Apr 05 12:08:25.734466 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1078/2178] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:25 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:26.541240 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-719ac18b-829f-44d2-ad78-ae69a47aff42 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:26.541847 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-719ac18b-829f-44d2-ad78-ae69a47aff42 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:26.548681 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-719ac18b-829f-44d2-ad78-ae69a47aff42 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:26.549131 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-719ac18b-829f-44d2-ad78-ae69a47aff42 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:26.549887 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-719ac18b-829f-44d2-ad78-ae69a47aff42 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:26.550318 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-719ac18b-829f-44d2-ad78-ae69a47aff42 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:26.683010 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-719ac18b-829f-44d2-ad78-ae69a47aff42 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:26.691073 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-719ac18b-829f-44d2-ad78-ae69a47aff42 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.153803 Apr 05 12:08:26.691646 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1101/2179] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:26 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:26.709715 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c1fbef44-6a1d-4397-8638-4cb522360ada tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:26.710422 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c1fbef44-6a1d-4397-8638-4cb522360ada tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:26.717817 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1fbef44-6a1d-4397-8638-4cb522360ada tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:26.718335 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1fbef44-6a1d-4397-8638-4cb522360ada tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:26.719128 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1fbef44-6a1d-4397-8638-4cb522360ada tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:26.719612 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1fbef44-6a1d-4397-8638-4cb522360ada tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:26.750996 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6e2ab04f-8e4b-4cca-8e16-a5a021efd8fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:26.751511 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6e2ab04f-8e4b-4cca-8e16-a5a021efd8fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:26.757778 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6e2ab04f-8e4b-4cca-8e16-a5a021efd8fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:26.758216 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6e2ab04f-8e4b-4cca-8e16-a5a021efd8fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:26.758963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6e2ab04f-8e4b-4cca-8e16-a5a021efd8fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:26.759387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6e2ab04f-8e4b-4cca-8e16-a5a021efd8fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:26.849497 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c1fbef44-6a1d-4397-8638-4cb522360ada tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:26.858103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c1fbef44-6a1d-4397-8638-4cb522360ada tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:26.859611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c1fbef44-6a1d-4397-8638-4cb522360ada tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:26.860819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c1fbef44-6a1d-4397-8638-4cb522360ada tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.155144 Apr 05 12:08:26.861386 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1079/2180] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:26 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:26.889766 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6e2ab04f-8e4b-4cca-8e16-a5a021efd8fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:26.897694 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6e2ab04f-8e4b-4cca-8e16-a5a021efd8fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.150682 Apr 05 12:08:26.898253 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1102/2181] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:26 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:08:27.712399 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0e7e2f9a-547d-4a3b-ac5a-6cc8b89122e2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:27.713463 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0e7e2f9a-547d-4a3b-ac5a-6cc8b89122e2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:27.722794 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0e7e2f9a-547d-4a3b-ac5a-6cc8b89122e2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:27.723224 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0e7e2f9a-547d-4a3b-ac5a-6cc8b89122e2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:27.723970 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0e7e2f9a-547d-4a3b-ac5a-6cc8b89122e2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:27.724427 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0e7e2f9a-547d-4a3b-ac5a-6cc8b89122e2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:27.875842 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0e7e2f9a-547d-4a3b-ac5a-6cc8b89122e2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:27.879833 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-91262d9b-362f-4d40-97c8-848dfad9e7c5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:27.880599 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-91262d9b-362f-4d40-97c8-848dfad9e7c5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:27.884116 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0e7e2f9a-547d-4a3b-ac5a-6cc8b89122e2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.178078 Apr 05 12:08:27.884680 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1080/2182] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:27 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:27.887366 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-91262d9b-362f-4d40-97c8-848dfad9e7c5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:27.887894 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-91262d9b-362f-4d40-97c8-848dfad9e7c5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:27.888755 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-91262d9b-362f-4d40-97c8-848dfad9e7c5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:27.889261 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-91262d9b-362f-4d40-97c8-848dfad9e7c5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:27.914500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-25fc2123-78b6-4be5-8cc1-cdebd0d7e163 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:27.915107 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-25fc2123-78b6-4be5-8cc1-cdebd0d7e163 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:27.920953 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-25fc2123-78b6-4be5-8cc1-cdebd0d7e163 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:27.921406 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-25fc2123-78b6-4be5-8cc1-cdebd0d7e163 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:27.922198 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-25fc2123-78b6-4be5-8cc1-cdebd0d7e163 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:27.922652 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-25fc2123-78b6-4be5-8cc1-cdebd0d7e163 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:28.027082 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-91262d9b-362f-4d40-97c8-848dfad9e7c5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:28.035213 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-91262d9b-362f-4d40-97c8-848dfad9e7c5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:28.036765 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-91262d9b-362f-4d40-97c8-848dfad9e7c5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:28.037918 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-91262d9b-362f-4d40-97c8-848dfad9e7c5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.163074 Apr 05 12:08:28.038475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1103/2183] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:27 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:28.056498 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-25fc2123-78b6-4be5-8cc1-cdebd0d7e163 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:28.064520 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-25fc2123-78b6-4be5-8cc1-cdebd0d7e163 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.153734 Apr 05 12:08:28.065096 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1081/2184] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:27 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:28.906268 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-69146bc6-94e7-4de9-99e1-3cef5b8ecc26 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:28.907260 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-69146bc6-94e7-4de9-99e1-3cef5b8ecc26 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:28.914646 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-69146bc6-94e7-4de9-99e1-3cef5b8ecc26 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:28.915090 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-69146bc6-94e7-4de9-99e1-3cef5b8ecc26 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:28.915836 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-69146bc6-94e7-4de9-99e1-3cef5b8ecc26 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:28.916305 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-69146bc6-94e7-4de9-99e1-3cef5b8ecc26 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:29.056342 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a4261e08-5914-422f-ae8a-4bd38a550437 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:29.056925 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a4261e08-5914-422f-ae8a-4bd38a550437 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:29.062205 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-69146bc6-94e7-4de9-99e1-3cef5b8ecc26 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:29.063342 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a4261e08-5914-422f-ae8a-4bd38a550437 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:29.063840 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a4261e08-5914-422f-ae8a-4bd38a550437 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:29.064636 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a4261e08-5914-422f-ae8a-4bd38a550437 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:29.065072 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a4261e08-5914-422f-ae8a-4bd38a550437 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:29.070427 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-69146bc6-94e7-4de9-99e1-3cef5b8ecc26 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.170653 Apr 05 12:08:29.071087 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1104/2185] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:28 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:29.081201 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b60ec578-e804-484b-b289-3e0a6efcd99a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:29.081925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b60ec578-e804-484b-b289-3e0a6efcd99a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:29.087741 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b60ec578-e804-484b-b289-3e0a6efcd99a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:29.088220 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b60ec578-e804-484b-b289-3e0a6efcd99a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:29.089003 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b60ec578-e804-484b-b289-3e0a6efcd99a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:29.089436 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b60ec578-e804-484b-b289-3e0a6efcd99a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:29.197937 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a4261e08-5914-422f-ae8a-4bd38a550437 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:29.206292 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a4261e08-5914-422f-ae8a-4bd38a550437 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:29.207786 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a4261e08-5914-422f-ae8a-4bd38a550437 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:29.208969 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a4261e08-5914-422f-ae8a-4bd38a550437 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.156649 Apr 05 12:08:29.209495 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1082/2186] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:29 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:29.222803 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b60ec578-e804-484b-b289-3e0a6efcd99a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:29.230466 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b60ec578-e804-484b-b289-3e0a6efcd99a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.153149 Apr 05 12:08:29.231031 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1105/2187] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:29 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:08:30.091513 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b367bb4f-1d31-4b3b-9fb5-8a8467c03202 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:30.092518 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b367bb4f-1d31-4b3b-9fb5-8a8467c03202 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:30.103392 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b367bb4f-1d31-4b3b-9fb5-8a8467c03202 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:30.104140 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b367bb4f-1d31-4b3b-9fb5-8a8467c03202 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:30.105406 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b367bb4f-1d31-4b3b-9fb5-8a8467c03202 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:30.106117 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b367bb4f-1d31-4b3b-9fb5-8a8467c03202 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:30.227086 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bc527c58-5364-479f-93d0-099e9af8db38 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:30.227786 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bc527c58-5364-479f-93d0-099e9af8db38 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:30.234460 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bc527c58-5364-479f-93d0-099e9af8db38 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:30.234994 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bc527c58-5364-479f-93d0-099e9af8db38 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:30.235888 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bc527c58-5364-479f-93d0-099e9af8db38 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:30.236361 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bc527c58-5364-479f-93d0-099e9af8db38 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:30.245125 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b367bb4f-1d31-4b3b-9fb5-8a8467c03202 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:30.253275 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b367bb4f-1d31-4b3b-9fb5-8a8467c03202 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.168320 Apr 05 12:08:30.253845 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1083/2188] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:30 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:30.258686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4c27358e-6f8a-440e-9c86-e3fc279fb31b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:30.259311 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4c27358e-6f8a-440e-9c86-e3fc279fb31b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:30.265211 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c27358e-6f8a-440e-9c86-e3fc279fb31b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:30.265653 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c27358e-6f8a-440e-9c86-e3fc279fb31b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:30.266414 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c27358e-6f8a-440e-9c86-e3fc279fb31b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:30.266887 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c27358e-6f8a-440e-9c86-e3fc279fb31b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:30.371902 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bc527c58-5364-479f-93d0-099e9af8db38 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:30.381533 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bc527c58-5364-479f-93d0-099e9af8db38 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:30.383470 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bc527c58-5364-479f-93d0-099e9af8db38 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:30.384223 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bc527c58-5364-479f-93d0-099e9af8db38 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.161099 Apr 05 12:08:30.395510 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1106/2189] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:30 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:30.398543 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4c27358e-6f8a-440e-9c86-e3fc279fb31b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:30.406590 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4c27358e-6f8a-440e-9c86-e3fc279fb31b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.151290 Apr 05 12:08:30.407192 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1084/2190] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:30 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:31.274890 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3404c8e9-8627-479e-8c61-bebb816e89d3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:31.275715 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3404c8e9-8627-479e-8c61-bebb816e89d3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:31.284947 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3404c8e9-8627-479e-8c61-bebb816e89d3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:31.285391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3404c8e9-8627-479e-8c61-bebb816e89d3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:31.286144 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3404c8e9-8627-479e-8c61-bebb816e89d3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:31.286575 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3404c8e9-8627-479e-8c61-bebb816e89d3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:31.402930 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a7853bb3-5651-4fe8-bf18-4f66dba55529 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:31.403525 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a7853bb3-5651-4fe8-bf18-4f66dba55529 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:31.410238 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a7853bb3-5651-4fe8-bf18-4f66dba55529 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:31.410688 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a7853bb3-5651-4fe8-bf18-4f66dba55529 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:31.411449 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a7853bb3-5651-4fe8-bf18-4f66dba55529 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:31.411884 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a7853bb3-5651-4fe8-bf18-4f66dba55529 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:31.426742 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3404c8e9-8627-479e-8c61-bebb816e89d3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:31.436008 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3404c8e9-8627-479e-8c61-bebb816e89d3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.167611 Apr 05 12:08:31.440415 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1107/2191] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:31 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:31.441811 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2584ec81-0f8e-4caa-b2b0-110882de4287 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:31.442423 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2584ec81-0f8e-4caa-b2b0-110882de4287 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:31.448767 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2584ec81-0f8e-4caa-b2b0-110882de4287 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:31.449221 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2584ec81-0f8e-4caa-b2b0-110882de4287 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:31.450124 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2584ec81-0f8e-4caa-b2b0-110882de4287 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:31.450563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2584ec81-0f8e-4caa-b2b0-110882de4287 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:31.564147 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a7853bb3-5651-4fe8-bf18-4f66dba55529 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:31.572362 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a7853bb3-5651-4fe8-bf18-4f66dba55529 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:31.573854 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a7853bb3-5651-4fe8-bf18-4f66dba55529 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:31.575005 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a7853bb3-5651-4fe8-bf18-4f66dba55529 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.176094 Apr 05 12:08:31.575571 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1085/2192] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:31 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:31.595096 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2584ec81-0f8e-4caa-b2b0-110882de4287 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:31.602799 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2584ec81-0f8e-4caa-b2b0-110882de4287 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.164886 Apr 05 12:08:31.603365 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1108/2193] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:31 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:32.456496 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-150daec0-2d03-4447-b47e-234046d85b0e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:32.457503 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-150daec0-2d03-4447-b47e-234046d85b0e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:32.468575 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-150daec0-2d03-4447-b47e-234046d85b0e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:32.469492 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-150daec0-2d03-4447-b47e-234046d85b0e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:32.470415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-150daec0-2d03-4447-b47e-234046d85b0e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:32.470846 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-150daec0-2d03-4447-b47e-234046d85b0e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:32.592853 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3d798a07-eb19-41e0-bf7d-19a360bfa34d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:32.593456 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3d798a07-eb19-41e0-bf7d-19a360bfa34d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:32.599904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3d798a07-eb19-41e0-bf7d-19a360bfa34d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:32.600322 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3d798a07-eb19-41e0-bf7d-19a360bfa34d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:32.601067 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3d798a07-eb19-41e0-bf7d-19a360bfa34d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:32.601492 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3d798a07-eb19-41e0-bf7d-19a360bfa34d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:32.602514 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-150daec0-2d03-4447-b47e-234046d85b0e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:32.610611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-150daec0-2d03-4447-b47e-234046d85b0e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.160561 Apr 05 12:08:32.611162 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1086/2194] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:32 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:32.619978 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-090f3c15-6a44-42b5-ae84-edda76f362e2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:32.620773 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-090f3c15-6a44-42b5-ae84-edda76f362e2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:32.627051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-090f3c15-6a44-42b5-ae84-edda76f362e2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:32.627501 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-090f3c15-6a44-42b5-ae84-edda76f362e2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:32.628314 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-090f3c15-6a44-42b5-ae84-edda76f362e2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:32.628861 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-090f3c15-6a44-42b5-ae84-edda76f362e2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:32.732629 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3d798a07-eb19-41e0-bf7d-19a360bfa34d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:32.741261 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3d798a07-eb19-41e0-bf7d-19a360bfa34d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:32.742743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3d798a07-eb19-41e0-bf7d-19a360bfa34d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:32.743901 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3d798a07-eb19-41e0-bf7d-19a360bfa34d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.154989 Apr 05 12:08:32.744564 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1109/2195] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:32 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:08:32.768759 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-090f3c15-6a44-42b5-ae84-edda76f362e2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:32.776752 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-090f3c15-6a44-42b5-ae84-edda76f362e2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.160555 Apr 05 12:08:32.777325 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1087/2196] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:32 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:33.676733 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2aafc839-860f-46d5-bbbf-c8c805eb92de tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:33.677443 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2aafc839-860f-46d5-bbbf-c8c805eb92de tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:33.683747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2aafc839-860f-46d5-bbbf-c8c805eb92de tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:33.684227 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2aafc839-860f-46d5-bbbf-c8c805eb92de tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:33.684986 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2aafc839-860f-46d5-bbbf-c8c805eb92de tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:33.685418 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2aafc839-860f-46d5-bbbf-c8c805eb92de tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:33.764989 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4df7e356-807e-460a-8c3e-0ca505642777 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:33.765562 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4df7e356-807e-460a-8c3e-0ca505642777 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:33.771736 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4df7e356-807e-460a-8c3e-0ca505642777 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:33.772215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4df7e356-807e-460a-8c3e-0ca505642777 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:33.773114 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4df7e356-807e-460a-8c3e-0ca505642777 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:33.773394 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4df7e356-807e-460a-8c3e-0ca505642777 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:33.824001 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2aafc839-860f-46d5-bbbf-c8c805eb92de tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:33.831897 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2aafc839-860f-46d5-bbbf-c8c805eb92de tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.207452 Apr 05 12:08:33.832697 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1110/2197] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:33 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:33.836930 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2f7c7224-147c-4f5f-b8f8-aac17547d9fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:33.837537 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2f7c7224-147c-4f5f-b8f8-aac17547d9fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:33.843858 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2f7c7224-147c-4f5f-b8f8-aac17547d9fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:33.844333 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2f7c7224-147c-4f5f-b8f8-aac17547d9fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:33.845174 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2f7c7224-147c-4f5f-b8f8-aac17547d9fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:33.845606 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2f7c7224-147c-4f5f-b8f8-aac17547d9fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:33.907879 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4df7e356-807e-460a-8c3e-0ca505642777 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:33.916608 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4df7e356-807e-460a-8c3e-0ca505642777 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:33.918085 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4df7e356-807e-460a-8c3e-0ca505642777 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:33.919245 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4df7e356-807e-460a-8c3e-0ca505642777 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.158292 Apr 05 12:08:33.919813 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1088/2198] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:33 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:08:33.976893 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2f7c7224-147c-4f5f-b8f8-aac17547d9fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:33.984786 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2f7c7224-147c-4f5f-b8f8-aac17547d9fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.151334 Apr 05 12:08:33.985362 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1111/2199] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:33 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:34.854016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f81145d1-814e-4de7-bfed-4ee9ca1f77be tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:34.854907 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f81145d1-814e-4de7-bfed-4ee9ca1f77be tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:34.865431 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f81145d1-814e-4de7-bfed-4ee9ca1f77be tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:34.866171 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f81145d1-814e-4de7-bfed-4ee9ca1f77be tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:34.867419 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f81145d1-814e-4de7-bfed-4ee9ca1f77be tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:34.868208 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f81145d1-814e-4de7-bfed-4ee9ca1f77be tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:34.937947 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b8aaf5fb-8e0a-47f4-b9c3-6f946a7b44f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:34.938554 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b8aaf5fb-8e0a-47f4-b9c3-6f946a7b44f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:34.945751 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b8aaf5fb-8e0a-47f4-b9c3-6f946a7b44f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:34.946226 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b8aaf5fb-8e0a-47f4-b9c3-6f946a7b44f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:34.947044 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b8aaf5fb-8e0a-47f4-b9c3-6f946a7b44f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:34.947479 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b8aaf5fb-8e0a-47f4-b9c3-6f946a7b44f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:35.008122 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f81145d1-814e-4de7-bfed-4ee9ca1f77be tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:35.016027 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f81145d1-814e-4de7-bfed-4ee9ca1f77be tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.168523 Apr 05 12:08:35.016686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1089/2200] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:34 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:35.021087 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-547c0d19-5e23-4ea1-be07-577325657476 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:35.021681 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-547c0d19-5e23-4ea1-be07-577325657476 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:35.027247 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-547c0d19-5e23-4ea1-be07-577325657476 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:35.027685 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-547c0d19-5e23-4ea1-be07-577325657476 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:35.028477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-547c0d19-5e23-4ea1-be07-577325657476 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:35.028901 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-547c0d19-5e23-4ea1-be07-577325657476 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:35.086468 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b8aaf5fb-8e0a-47f4-b9c3-6f946a7b44f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:35.095020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b8aaf5fb-8e0a-47f4-b9c3-6f946a7b44f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:35.096521 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b8aaf5fb-8e0a-47f4-b9c3-6f946a7b44f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:35.097668 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b8aaf5fb-8e0a-47f4-b9c3-6f946a7b44f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.163780 Apr 05 12:08:35.098432 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1112/2201] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:34 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:35.162902 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-547c0d19-5e23-4ea1-be07-577325657476 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:35.170903 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-547c0d19-5e23-4ea1-be07-577325657476 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.153245 Apr 05 12:08:35.171647 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1090/2202] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:35 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:36.037362 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-49548bd4-0fd7-4388-9a4b-32f250dc28db tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:36.038380 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-49548bd4-0fd7-4388-9a4b-32f250dc28db tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:36.048804 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-49548bd4-0fd7-4388-9a4b-32f250dc28db tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:36.049244 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-49548bd4-0fd7-4388-9a4b-32f250dc28db tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:36.050004 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-49548bd4-0fd7-4388-9a4b-32f250dc28db tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:36.050433 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-49548bd4-0fd7-4388-9a4b-32f250dc28db tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:36.115729 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-45b8c475-bace-4537-8607-3515482ca559 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:36.116476 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-45b8c475-bace-4537-8607-3515482ca559 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:36.123944 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-45b8c475-bace-4537-8607-3515482ca559 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:36.124176 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-45b8c475-bace-4537-8607-3515482ca559 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:36.124975 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-45b8c475-bace-4537-8607-3515482ca559 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:36.125407 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-45b8c475-bace-4537-8607-3515482ca559 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:36.183425 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-49548bd4-0fd7-4388-9a4b-32f250dc28db tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:36.192429 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-49548bd4-0fd7-4388-9a4b-32f250dc28db tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.161407 Apr 05 12:08:36.193028 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1113/2203] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:36 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:36.197476 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f2cfbbb1-25f8-4c3d-8e7e-84d05ab3df9e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:36.198044 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f2cfbbb1-25f8-4c3d-8e7e-84d05ab3df9e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:36.203702 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f2cfbbb1-25f8-4c3d-8e7e-84d05ab3df9e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:36.204230 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f2cfbbb1-25f8-4c3d-8e7e-84d05ab3df9e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:36.205039 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f2cfbbb1-25f8-4c3d-8e7e-84d05ab3df9e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:36.205449 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f2cfbbb1-25f8-4c3d-8e7e-84d05ab3df9e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:36.258423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-45b8c475-bace-4537-8607-3515482ca559 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:36.266871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-45b8c475-bace-4537-8607-3515482ca559 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:36.268401 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-45b8c475-bace-4537-8607-3515482ca559 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:36.269563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-45b8c475-bace-4537-8607-3515482ca559 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.157960 Apr 05 12:08:36.270127 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1091/2204] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:36 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:36.335990 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f2cfbbb1-25f8-4c3d-8e7e-84d05ab3df9e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:36.344480 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f2cfbbb1-25f8-4c3d-8e7e-84d05ab3df9e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.150492 Apr 05 12:08:36.345069 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1114/2205] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:36 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:37.214021 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bde56d35-3758-40ab-9597-1f413df522a0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:37.215060 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bde56d35-3758-40ab-9597-1f413df522a0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:37.223474 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bde56d35-3758-40ab-9597-1f413df522a0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:37.223920 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bde56d35-3758-40ab-9597-1f413df522a0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:37.224698 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bde56d35-3758-40ab-9597-1f413df522a0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:37.225135 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bde56d35-3758-40ab-9597-1f413df522a0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:37.288166 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-24ea3bc9-2d12-4fa7-a2a6-4bb00cf1f633 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:37.288727 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-24ea3bc9-2d12-4fa7-a2a6-4bb00cf1f633 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:37.295056 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24ea3bc9-2d12-4fa7-a2a6-4bb00cf1f633 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:37.295501 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24ea3bc9-2d12-4fa7-a2a6-4bb00cf1f633 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:37.296303 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24ea3bc9-2d12-4fa7-a2a6-4bb00cf1f633 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:37.296731 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24ea3bc9-2d12-4fa7-a2a6-4bb00cf1f633 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:37.361562 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-bde56d35-3758-40ab-9597-1f413df522a0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:37.369611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bde56d35-3758-40ab-9597-1f413df522a0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.162065 Apr 05 12:08:37.370363 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1092/2206] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:37 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:37.383108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d59e31d6-7c23-486a-b28d-ae533cc42967 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:37.383711 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d59e31d6-7c23-486a-b28d-ae533cc42967 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:37.389713 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d59e31d6-7c23-486a-b28d-ae533cc42967 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:37.390161 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d59e31d6-7c23-486a-b28d-ae533cc42967 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:37.390909 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d59e31d6-7c23-486a-b28d-ae533cc42967 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:37.391371 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d59e31d6-7c23-486a-b28d-ae533cc42967 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:37.432791 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-24ea3bc9-2d12-4fa7-a2a6-4bb00cf1f633 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:37.443457 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-24ea3bc9-2d12-4fa7-a2a6-4bb00cf1f633 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:37.444976 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-24ea3bc9-2d12-4fa7-a2a6-4bb00cf1f633 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:37.446165 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-24ea3bc9-2d12-4fa7-a2a6-4bb00cf1f633 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.162041 Apr 05 12:08:37.446729 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1115/2207] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:37 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:37.522085 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d59e31d6-7c23-486a-b28d-ae533cc42967 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:37.529679 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d59e31d6-7c23-486a-b28d-ae533cc42967 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.158562 Apr 05 12:08:37.530236 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1093/2208] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:37 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:38.390873 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-760bfc6c-07a8-4c27-b138-c9ed79d625d5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:38.391914 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-760bfc6c-07a8-4c27-b138-c9ed79d625d5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:38.398889 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-760bfc6c-07a8-4c27-b138-c9ed79d625d5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:38.399362 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-760bfc6c-07a8-4c27-b138-c9ed79d625d5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:38.400192 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-760bfc6c-07a8-4c27-b138-c9ed79d625d5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:38.400650 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-760bfc6c-07a8-4c27-b138-c9ed79d625d5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:38.465371 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7d56ece3-3abb-4c7a-8fdd-a7cf7cdbcc2c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:38.465977 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7d56ece3-3abb-4c7a-8fdd-a7cf7cdbcc2c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:38.472597 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7d56ece3-3abb-4c7a-8fdd-a7cf7cdbcc2c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:38.473149 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7d56ece3-3abb-4c7a-8fdd-a7cf7cdbcc2c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:38.473929 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7d56ece3-3abb-4c7a-8fdd-a7cf7cdbcc2c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:38.474368 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7d56ece3-3abb-4c7a-8fdd-a7cf7cdbcc2c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:38.542242 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-760bfc6c-07a8-4c27-b138-c9ed79d625d5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:38.550209 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-760bfc6c-07a8-4c27-b138-c9ed79d625d5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.165779 Apr 05 12:08:38.550808 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1116/2209] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:38 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:38.555214 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9d8e00f4-4d13-414c-b93f-16f69a214d37 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:38.555814 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9d8e00f4-4d13-414c-b93f-16f69a214d37 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:38.561667 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9d8e00f4-4d13-414c-b93f-16f69a214d37 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:38.562119 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9d8e00f4-4d13-414c-b93f-16f69a214d37 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:38.562873 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9d8e00f4-4d13-414c-b93f-16f69a214d37 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:38.563499 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9d8e00f4-4d13-414c-b93f-16f69a214d37 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:38.609313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7d56ece3-3abb-4c7a-8fdd-a7cf7cdbcc2c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:38.617644 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7d56ece3-3abb-4c7a-8fdd-a7cf7cdbcc2c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:38.619152 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7d56ece3-3abb-4c7a-8fdd-a7cf7cdbcc2c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:38.620337 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7d56ece3-3abb-4c7a-8fdd-a7cf7cdbcc2c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.158909 Apr 05 12:08:38.620905 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1094/2210] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:38 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:38.696282 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9d8e00f4-4d13-414c-b93f-16f69a214d37 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:38.704227 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9d8e00f4-4d13-414c-b93f-16f69a214d37 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.152356 Apr 05 12:08:38.704792 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1117/2211] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:38 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:39.567836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f173fcd0-5343-4df7-ac41-ace04becdf8d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:39.568817 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f173fcd0-5343-4df7-ac41-ace04becdf8d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:39.578189 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f173fcd0-5343-4df7-ac41-ace04becdf8d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:39.578850 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f173fcd0-5343-4df7-ac41-ace04becdf8d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:39.579986 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f173fcd0-5343-4df7-ac41-ace04becdf8d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:39.580673 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f173fcd0-5343-4df7-ac41-ace04becdf8d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:39.639075 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-722a200f-c835-4a19-8f4a-bf34001e68a4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:39.639730 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-722a200f-c835-4a19-8f4a-bf34001e68a4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:39.645995 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-722a200f-c835-4a19-8f4a-bf34001e68a4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:39.646498 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-722a200f-c835-4a19-8f4a-bf34001e68a4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:39.647263 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-722a200f-c835-4a19-8f4a-bf34001e68a4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:39.647692 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-722a200f-c835-4a19-8f4a-bf34001e68a4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:39.728301 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f173fcd0-5343-4df7-ac41-ace04becdf8d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:39.736378 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f173fcd0-5343-4df7-ac41-ace04becdf8d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.172772 Apr 05 12:08:39.737055 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1095/2212] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:39 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:39.741521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0f935c77-ee47-4f25-9a46-01baf2a7a72b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:39.742116 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0f935c77-ee47-4f25-9a46-01baf2a7a72b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:39.748145 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0f935c77-ee47-4f25-9a46-01baf2a7a72b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:39.748558 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0f935c77-ee47-4f25-9a46-01baf2a7a72b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:39.749297 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0f935c77-ee47-4f25-9a46-01baf2a7a72b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:39.749712 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0f935c77-ee47-4f25-9a46-01baf2a7a72b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:39.778994 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-722a200f-c835-4a19-8f4a-bf34001e68a4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:39.788248 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-722a200f-c835-4a19-8f4a-bf34001e68a4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:39.789904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-722a200f-c835-4a19-8f4a-bf34001e68a4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:39.791183 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-722a200f-c835-4a19-8f4a-bf34001e68a4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.156142 Apr 05 12:08:39.791829 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1118/2213] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:39 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:08:39.880625 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0f935c77-ee47-4f25-9a46-01baf2a7a72b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:39.888950 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0f935c77-ee47-4f25-9a46-01baf2a7a72b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.150892 Apr 05 12:08:39.889519 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1096/2214] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:39 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:40.758411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c90bd291-2e33-4a0b-a04b-673665c6fcf2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:40.759240 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c90bd291-2e33-4a0b-a04b-673665c6fcf2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:40.768817 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c90bd291-2e33-4a0b-a04b-673665c6fcf2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:40.769259 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c90bd291-2e33-4a0b-a04b-673665c6fcf2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:40.770003 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c90bd291-2e33-4a0b-a04b-673665c6fcf2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:40.770424 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c90bd291-2e33-4a0b-a04b-673665c6fcf2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:40.809512 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1907ad96-932c-4891-8985-81d208a6d6ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:40.812424 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1907ad96-932c-4891-8985-81d208a6d6ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:40.818887 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1907ad96-932c-4891-8985-81d208a6d6ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:40.819343 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1907ad96-932c-4891-8985-81d208a6d6ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:40.820132 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1907ad96-932c-4891-8985-81d208a6d6ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:40.820567 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1907ad96-932c-4891-8985-81d208a6d6ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:40.900742 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c90bd291-2e33-4a0b-a04b-673665c6fcf2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:40.908742 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c90bd291-2e33-4a0b-a04b-673665c6fcf2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.157242 Apr 05 12:08:40.909313 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1119/2215] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:40 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:40.914456 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f9caa706-6177-4c6e-9107-308a0d3297c9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:40.915046 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f9caa706-6177-4c6e-9107-308a0d3297c9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:40.920769 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9caa706-6177-4c6e-9107-308a0d3297c9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:40.921214 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9caa706-6177-4c6e-9107-308a0d3297c9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:40.921989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9caa706-6177-4c6e-9107-308a0d3297c9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:40.922410 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9caa706-6177-4c6e-9107-308a0d3297c9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:40.958206 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1907ad96-932c-4891-8985-81d208a6d6ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:40.976190 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1907ad96-932c-4891-8985-81d208a6d6ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:40.976898 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1907ad96-932c-4891-8985-81d208a6d6ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:40.978045 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1907ad96-932c-4891-8985-81d208a6d6ae tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.172465 Apr 05 12:08:40.982863 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1097/2216] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:40 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:41.060394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f9caa706-6177-4c6e-9107-308a0d3297c9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:41.068345 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f9caa706-6177-4c6e-9107-308a0d3297c9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.158099 Apr 05 12:08:41.068902 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1120/2217] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:40 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:41.930026 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-13b3fd2c-6522-4d1a-9531-574ef72f56cc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:41.930866 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-13b3fd2c-6522-4d1a-9531-574ef72f56cc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:41.941498 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13b3fd2c-6522-4d1a-9531-574ef72f56cc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:41.942209 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13b3fd2c-6522-4d1a-9531-574ef72f56cc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:41.942970 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13b3fd2c-6522-4d1a-9531-574ef72f56cc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:41.943393 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13b3fd2c-6522-4d1a-9531-574ef72f56cc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:41.997507 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cc08e564-d6da-4e46-92eb-41c2307c11d3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:41.998414 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cc08e564-d6da-4e46-92eb-41c2307c11d3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:42.005926 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cc08e564-d6da-4e46-92eb-41c2307c11d3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:42.006378 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cc08e564-d6da-4e46-92eb-41c2307c11d3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:42.007209 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cc08e564-d6da-4e46-92eb-41c2307c11d3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:42.007644 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cc08e564-d6da-4e46-92eb-41c2307c11d3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:42.090095 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-13b3fd2c-6522-4d1a-9531-574ef72f56cc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:42.098589 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-13b3fd2c-6522-4d1a-9531-574ef72f56cc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.175015 Apr 05 12:08:42.099179 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1098/2218] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:41 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:42.105345 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-487fe9d0-8f8a-419b-ace7-4b40d34cd57a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:42.105957 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-487fe9d0-8f8a-419b-ace7-4b40d34cd57a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:42.112797 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-487fe9d0-8f8a-419b-ace7-4b40d34cd57a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:42.113451 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-487fe9d0-8f8a-419b-ace7-4b40d34cd57a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:42.114244 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-487fe9d0-8f8a-419b-ace7-4b40d34cd57a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:42.114661 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-487fe9d0-8f8a-419b-ace7-4b40d34cd57a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:42.150483 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cc08e564-d6da-4e46-92eb-41c2307c11d3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:42.159157 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cc08e564-d6da-4e46-92eb-41c2307c11d3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:42.160707 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cc08e564-d6da-4e46-92eb-41c2307c11d3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:42.161881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cc08e564-d6da-4e46-92eb-41c2307c11d3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.168617 Apr 05 12:08:42.162455 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1121/2219] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:41 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:08:42.255656 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-487fe9d0-8f8a-419b-ace7-4b40d34cd57a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:42.263910 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-487fe9d0-8f8a-419b-ace7-4b40d34cd57a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.162771 Apr 05 12:08:42.264530 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1099/2220] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:42 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:43.116949 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cbdf6bf0-89ca-4636-8c2b-900e03e4ff27 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:43.117556 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cbdf6bf0-89ca-4636-8c2b-900e03e4ff27 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:43.124170 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cbdf6bf0-89ca-4636-8c2b-900e03e4ff27 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:43.124633 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cbdf6bf0-89ca-4636-8c2b-900e03e4ff27 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:43.125380 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cbdf6bf0-89ca-4636-8c2b-900e03e4ff27 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:43.125808 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cbdf6bf0-89ca-4636-8c2b-900e03e4ff27 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:43.180941 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2bed468e-1c49-4268-93b7-d80f0d6a26b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:43.181660 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2bed468e-1c49-4268-93b7-d80f0d6a26b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:43.188524 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2bed468e-1c49-4268-93b7-d80f0d6a26b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:43.188972 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2bed468e-1c49-4268-93b7-d80f0d6a26b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:43.189804 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2bed468e-1c49-4268-93b7-d80f0d6a26b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:43.190211 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2bed468e-1c49-4268-93b7-d80f0d6a26b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:43.262699 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cbdf6bf0-89ca-4636-8c2b-900e03e4ff27 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:43.270572 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cbdf6bf0-89ca-4636-8c2b-900e03e4ff27 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.157471 Apr 05 12:08:43.271146 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1122/2221] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:43 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:43.281192 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6e1d7b38-5099-4341-825d-b5f5ea3d2043 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:43.281801 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6e1d7b38-5099-4341-825d-b5f5ea3d2043 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:43.287978 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6e1d7b38-5099-4341-825d-b5f5ea3d2043 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:43.288466 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6e1d7b38-5099-4341-825d-b5f5ea3d2043 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:43.289236 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6e1d7b38-5099-4341-825d-b5f5ea3d2043 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:43.289670 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6e1d7b38-5099-4341-825d-b5f5ea3d2043 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:43.322552 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2bed468e-1c49-4268-93b7-d80f0d6a26b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:43.330945 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2bed468e-1c49-4268-93b7-d80f0d6a26b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:43.332477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2bed468e-1c49-4268-93b7-d80f0d6a26b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:43.333657 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2bed468e-1c49-4268-93b7-d80f0d6a26b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.156933 Apr 05 12:08:43.334228 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1100/2222] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:43 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:43.444362 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6e1d7b38-5099-4341-825d-b5f5ea3d2043 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:43.452771 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6e1d7b38-5099-4341-825d-b5f5ea3d2043 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.175232 Apr 05 12:08:43.453350 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1123/2223] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:43 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:44.290378 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3dddbc43-1f5e-4d86-aafc-737e491b3c05 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:44.291383 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3dddbc43-1f5e-4d86-aafc-737e491b3c05 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:44.301877 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3dddbc43-1f5e-4d86-aafc-737e491b3c05 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:44.302624 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3dddbc43-1f5e-4d86-aafc-737e491b3c05 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:44.303876 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3dddbc43-1f5e-4d86-aafc-737e491b3c05 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:44.304644 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3dddbc43-1f5e-4d86-aafc-737e491b3c05 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:44.351884 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bcebc778-56d6-4f1e-b92f-850e834a5abf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:44.352493 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bcebc778-56d6-4f1e-b92f-850e834a5abf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:44.358908 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bcebc778-56d6-4f1e-b92f-850e834a5abf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:44.359353 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bcebc778-56d6-4f1e-b92f-850e834a5abf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:44.360104 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bcebc778-56d6-4f1e-b92f-850e834a5abf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:44.360607 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bcebc778-56d6-4f1e-b92f-850e834a5abf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:44.447123 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3dddbc43-1f5e-4d86-aafc-737e491b3c05 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:44.455624 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3dddbc43-1f5e-4d86-aafc-737e491b3c05 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.171522 Apr 05 12:08:44.456383 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1101/2224] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:44 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:44.470022 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e107468b-fdde-4250-abfb-9c32fb21296b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:44.470621 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e107468b-fdde-4250-abfb-9c32fb21296b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:44.476705 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e107468b-fdde-4250-abfb-9c32fb21296b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:44.477158 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e107468b-fdde-4250-abfb-9c32fb21296b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:44.477922 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e107468b-fdde-4250-abfb-9c32fb21296b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:44.478393 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e107468b-fdde-4250-abfb-9c32fb21296b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:44.500489 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bcebc778-56d6-4f1e-b92f-850e834a5abf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:44.509180 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bcebc778-56d6-4f1e-b92f-850e834a5abf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:44.510738 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bcebc778-56d6-4f1e-b92f-850e834a5abf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:44.511915 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bcebc778-56d6-4f1e-b92f-850e834a5abf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.163950 Apr 05 12:08:44.512510 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1124/2225] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:44 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:08:44.616453 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e107468b-fdde-4250-abfb-9c32fb21296b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:44.624866 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e107468b-fdde-4250-abfb-9c32fb21296b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.158714 Apr 05 12:08:44.625438 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1102/2226] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:44 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:45.475101 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d513e05a-0ece-4f57-88ba-9634ef7b8683 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:45.475765 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d513e05a-0ece-4f57-88ba-9634ef7b8683 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:45.483036 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d513e05a-0ece-4f57-88ba-9634ef7b8683 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:45.483529 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d513e05a-0ece-4f57-88ba-9634ef7b8683 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:45.484399 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d513e05a-0ece-4f57-88ba-9634ef7b8683 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:45.484873 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d513e05a-0ece-4f57-88ba-9634ef7b8683 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:45.530607 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c15c2c6c-a1aa-4345-b770-2dda4dbe3df7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:45.531156 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c15c2c6c-a1aa-4345-b770-2dda4dbe3df7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:45.537750 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c15c2c6c-a1aa-4345-b770-2dda4dbe3df7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:45.538231 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c15c2c6c-a1aa-4345-b770-2dda4dbe3df7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:45.539204 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c15c2c6c-a1aa-4345-b770-2dda4dbe3df7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:45.539637 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c15c2c6c-a1aa-4345-b770-2dda4dbe3df7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:45.621819 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d513e05a-0ece-4f57-88ba-9634ef7b8683 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:45.629180 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d513e05a-0ece-4f57-88ba-9634ef7b8683 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.158595 Apr 05 12:08:45.630057 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1125/2227] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:45 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:45.644289 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fa5d45c7-254c-4079-92a4-c2f1b42cba39 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:45.644894 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fa5d45c7-254c-4079-92a4-c2f1b42cba39 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:45.650604 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fa5d45c7-254c-4079-92a4-c2f1b42cba39 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:45.651043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fa5d45c7-254c-4079-92a4-c2f1b42cba39 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:45.651787 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fa5d45c7-254c-4079-92a4-c2f1b42cba39 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:45.652249 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fa5d45c7-254c-4079-92a4-c2f1b42cba39 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:45.672575 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c15c2c6c-a1aa-4345-b770-2dda4dbe3df7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:45.681199 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c15c2c6c-a1aa-4345-b770-2dda4dbe3df7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:45.682708 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c15c2c6c-a1aa-4345-b770-2dda4dbe3df7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:45.683897 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c15c2c6c-a1aa-4345-b770-2dda4dbe3df7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.157316 Apr 05 12:08:45.684482 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1103/2228] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:45 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:45.782276 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fa5d45c7-254c-4079-92a4-c2f1b42cba39 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:45.790559 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fa5d45c7-254c-4079-92a4-c2f1b42cba39 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.150144 Apr 05 12:08:45.791139 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1126/2229] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:45 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:46.650891 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fef787e4-e909-450e-82b9-6d7b15b4cf00 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:46.651737 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fef787e4-e909-450e-82b9-6d7b15b4cf00 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:46.662363 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fef787e4-e909-450e-82b9-6d7b15b4cf00 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:46.663094 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fef787e4-e909-450e-82b9-6d7b15b4cf00 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:46.664440 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fef787e4-e909-450e-82b9-6d7b15b4cf00 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:46.665156 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fef787e4-e909-450e-82b9-6d7b15b4cf00 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:46.704179 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c658582e-cb48-46fd-90c9-90024d56a324 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:46.705179 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c658582e-cb48-46fd-90c9-90024d56a324 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:46.711534 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c658582e-cb48-46fd-90c9-90024d56a324 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:46.711983 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c658582e-cb48-46fd-90c9-90024d56a324 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:46.712774 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c658582e-cb48-46fd-90c9-90024d56a324 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:46.713198 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c658582e-cb48-46fd-90c9-90024d56a324 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:46.806555 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fef787e4-e909-450e-82b9-6d7b15b4cf00 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:46.814556 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fef787e4-e909-450e-82b9-6d7b15b4cf00 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.170280 Apr 05 12:08:46.815143 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1104/2230] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:46 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:46.819495 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3c2e6fca-2938-4ff8-90c3-1490f65b9a51 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:46.820166 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3c2e6fca-2938-4ff8-90c3-1490f65b9a51 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:46.825698 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3c2e6fca-2938-4ff8-90c3-1490f65b9a51 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:46.826147 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3c2e6fca-2938-4ff8-90c3-1490f65b9a51 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:46.827156 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3c2e6fca-2938-4ff8-90c3-1490f65b9a51 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:46.827587 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3c2e6fca-2938-4ff8-90c3-1490f65b9a51 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:46.849200 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c658582e-cb48-46fd-90c9-90024d56a324 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:46.859363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c658582e-cb48-46fd-90c9-90024d56a324 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:46.860894 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c658582e-cb48-46fd-90c9-90024d56a324 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:46.862055 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c658582e-cb48-46fd-90c9-90024d56a324 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.163438 Apr 05 12:08:46.862754 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1127/2231] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:46 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:46.958745 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3c2e6fca-2938-4ff8-90c3-1490f65b9a51 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:46.966593 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3c2e6fca-2938-4ff8-90c3-1490f65b9a51 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.150497 Apr 05 12:08:46.967168 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1105/2232] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:46 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:47.836143 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0dbad8e1-b7c8-4c96-a4bc-59ecd574013c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:47.837226 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0dbad8e1-b7c8-4c96-a4bc-59ecd574013c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:47.847465 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0dbad8e1-b7c8-4c96-a4bc-59ecd574013c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:47.847918 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0dbad8e1-b7c8-4c96-a4bc-59ecd574013c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:47.848780 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0dbad8e1-b7c8-4c96-a4bc-59ecd574013c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:47.849236 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0dbad8e1-b7c8-4c96-a4bc-59ecd574013c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:47.880409 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4b4a8d6c-fa7b-41fb-9891-4e9810e86517 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:47.881103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4b4a8d6c-fa7b-41fb-9891-4e9810e86517 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:47.887930 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4b4a8d6c-fa7b-41fb-9891-4e9810e86517 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:47.888406 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4b4a8d6c-fa7b-41fb-9891-4e9810e86517 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:47.889176 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4b4a8d6c-fa7b-41fb-9891-4e9810e86517 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:47.889627 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4b4a8d6c-fa7b-41fb-9891-4e9810e86517 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:47.980302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0dbad8e1-b7c8-4c96-a4bc-59ecd574013c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:47.988426 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0dbad8e1-b7c8-4c96-a4bc-59ecd574013c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.158873 Apr 05 12:08:47.989203 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1128/2233] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:47 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:48.001508 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-21f2ac7d-5477-4e97-8704-0ed4dfe73251 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:48.002556 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-21f2ac7d-5477-4e97-8704-0ed4dfe73251 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:48.009104 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-21f2ac7d-5477-4e97-8704-0ed4dfe73251 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:48.009546 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-21f2ac7d-5477-4e97-8704-0ed4dfe73251 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:48.010328 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-21f2ac7d-5477-4e97-8704-0ed4dfe73251 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:48.010756 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-21f2ac7d-5477-4e97-8704-0ed4dfe73251 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:48.022133 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4b4a8d6c-fa7b-41fb-9891-4e9810e86517 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:48.030953 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4b4a8d6c-fa7b-41fb-9891-4e9810e86517 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:48.032471 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4b4a8d6c-fa7b-41fb-9891-4e9810e86517 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:48.033694 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4b4a8d6c-fa7b-41fb-9891-4e9810e86517 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.157537 Apr 05 12:08:48.034264 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1106/2234] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:47 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:48.148893 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-21f2ac7d-5477-4e97-8704-0ed4dfe73251 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:48.156848 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-21f2ac7d-5477-4e97-8704-0ed4dfe73251 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.159194 Apr 05 12:08:48.157431 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1129/2235] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:47 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:49.010466 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0bc6a38a-e544-4fa1-85bc-af96fdcd0042 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:49.011474 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0bc6a38a-e544-4fa1-85bc-af96fdcd0042 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:49.020830 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0bc6a38a-e544-4fa1-85bc-af96fdcd0042 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:49.021268 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0bc6a38a-e544-4fa1-85bc-af96fdcd0042 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:49.022019 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0bc6a38a-e544-4fa1-85bc-af96fdcd0042 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:49.022446 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0bc6a38a-e544-4fa1-85bc-af96fdcd0042 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:49.052434 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8365992e-91da-47b1-88f9-ffd6dc836822 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:49.053112 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8365992e-91da-47b1-88f9-ffd6dc836822 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:49.059762 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8365992e-91da-47b1-88f9-ffd6dc836822 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:49.060329 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8365992e-91da-47b1-88f9-ffd6dc836822 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:49.061087 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8365992e-91da-47b1-88f9-ffd6dc836822 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:49.061515 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8365992e-91da-47b1-88f9-ffd6dc836822 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:49.158956 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0bc6a38a-e544-4fa1-85bc-af96fdcd0042 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:49.167378 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0bc6a38a-e544-4fa1-85bc-af96fdcd0042 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.163818 Apr 05 12:08:49.168754 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1107/2236] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:49 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:49.173989 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-25b976d8-cf0b-4825-8268-fc7ac06797c1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:49.174700 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-25b976d8-cf0b-4825-8268-fc7ac06797c1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:49.180625 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-25b976d8-cf0b-4825-8268-fc7ac06797c1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:49.181111 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-25b976d8-cf0b-4825-8268-fc7ac06797c1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:49.181872 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-25b976d8-cf0b-4825-8268-fc7ac06797c1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:49.182306 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-25b976d8-cf0b-4825-8268-fc7ac06797c1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:49.195631 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8365992e-91da-47b1-88f9-ffd6dc836822 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:49.204052 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8365992e-91da-47b1-88f9-ffd6dc836822 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:49.205566 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8365992e-91da-47b1-88f9-ffd6dc836822 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:49.206749 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8365992e-91da-47b1-88f9-ffd6dc836822 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.158332 Apr 05 12:08:49.207326 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1130/2237] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:49 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:49.315328 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-25b976d8-cf0b-4825-8268-fc7ac06797c1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:49.323791 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-25b976d8-cf0b-4825-8268-fc7ac06797c1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.153420 Apr 05 12:08:49.324408 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1108/2238] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:49 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:08:50.189156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-93a112b3-4ebb-4743-a9e2-f13d841da7ca tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:50.190140 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-93a112b3-4ebb-4743-a9e2-f13d841da7ca tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:50.198037 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-93a112b3-4ebb-4743-a9e2-f13d841da7ca tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:50.198557 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-93a112b3-4ebb-4743-a9e2-f13d841da7ca tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:50.199442 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-93a112b3-4ebb-4743-a9e2-f13d841da7ca tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:50.200034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-93a112b3-4ebb-4743-a9e2-f13d841da7ca tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:50.225503 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-dd225774-227d-4ce3-a324-cfaa329fe225 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:50.226116 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-dd225774-227d-4ce3-a324-cfaa329fe225 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:50.232693 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd225774-227d-4ce3-a324-cfaa329fe225 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:50.233149 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd225774-227d-4ce3-a324-cfaa329fe225 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:50.233918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd225774-227d-4ce3-a324-cfaa329fe225 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:50.234354 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dd225774-227d-4ce3-a324-cfaa329fe225 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:50.334629 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-93a112b3-4ebb-4743-a9e2-f13d841da7ca tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:50.342723 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-93a112b3-4ebb-4743-a9e2-f13d841da7ca tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.159934 Apr 05 12:08:50.343399 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1131/2239] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:50 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:50.347662 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-642bdc65-6d99-45fb-881e-061fedbe7d63 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:50.348295 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-642bdc65-6d99-45fb-881e-061fedbe7d63 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:50.354089 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-642bdc65-6d99-45fb-881e-061fedbe7d63 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:50.354541 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-642bdc65-6d99-45fb-881e-061fedbe7d63 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:50.355298 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-642bdc65-6d99-45fb-881e-061fedbe7d63 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:50.355729 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-642bdc65-6d99-45fb-881e-061fedbe7d63 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:50.372531 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-dd225774-227d-4ce3-a324-cfaa329fe225 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:50.381005 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-dd225774-227d-4ce3-a324-cfaa329fe225 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:50.382481 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-dd225774-227d-4ce3-a324-cfaa329fe225 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:50.383624 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-dd225774-227d-4ce3-a324-cfaa329fe225 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.162381 Apr 05 12:08:50.384204 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1109/2240] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:50 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:50.489915 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-642bdc65-6d99-45fb-881e-061fedbe7d63 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:50.501273 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-642bdc65-6d99-45fb-881e-061fedbe7d63 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.156737 Apr 05 12:08:50.502171 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1132/2241] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:50 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:51.364467 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0367ca75-544e-4a59-a4e7-202871fdcd52 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:51.365401 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0367ca75-544e-4a59-a4e7-202871fdcd52 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:51.376053 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0367ca75-544e-4a59-a4e7-202871fdcd52 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:51.376859 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0367ca75-544e-4a59-a4e7-202871fdcd52 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:51.378128 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0367ca75-544e-4a59-a4e7-202871fdcd52 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:51.378848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0367ca75-544e-4a59-a4e7-202871fdcd52 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:51.401755 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9e016123-4bba-485b-a019-dc1fdcfa4b4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:51.402481 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9e016123-4bba-485b-a019-dc1fdcfa4b4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:51.408912 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9e016123-4bba-485b-a019-dc1fdcfa4b4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:51.409415 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9e016123-4bba-485b-a019-dc1fdcfa4b4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:51.410306 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9e016123-4bba-485b-a019-dc1fdcfa4b4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:51.410738 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9e016123-4bba-485b-a019-dc1fdcfa4b4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:51.521498 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0367ca75-544e-4a59-a4e7-202871fdcd52 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:51.530263 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0367ca75-544e-4a59-a4e7-202871fdcd52 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.172520 Apr 05 12:08:51.530879 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1110/2242] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:51 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:51.535371 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3f223e9d-ce34-462f-b414-e5e520b2aced tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:51.535971 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3f223e9d-ce34-462f-b414-e5e520b2aced tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:51.541592 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f223e9d-ce34-462f-b414-e5e520b2aced tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:51.542034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f223e9d-ce34-462f-b414-e5e520b2aced tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:51.542784 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f223e9d-ce34-462f-b414-e5e520b2aced tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:51.543208 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f223e9d-ce34-462f-b414-e5e520b2aced tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:51.546612 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9e016123-4bba-485b-a019-dc1fdcfa4b4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:51.554780 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9e016123-4bba-485b-a019-dc1fdcfa4b4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:51.556295 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9e016123-4bba-485b-a019-dc1fdcfa4b4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:51.557431 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9e016123-4bba-485b-a019-dc1fdcfa4b4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.159645 Apr 05 12:08:51.558014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1133/2243] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:51 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:51.677026 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3f223e9d-ce34-462f-b414-e5e520b2aced tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:51.684747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3f223e9d-ce34-462f-b414-e5e520b2aced tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.152949 Apr 05 12:08:51.685332 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1111/2244] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:51 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:52.550782 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-90292612-52bb-4bda-aa8a-ab760f3f51c3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:52.551389 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-90292612-52bb-4bda-aa8a-ab760f3f51c3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:52.558150 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90292612-52bb-4bda-aa8a-ab760f3f51c3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:52.558601 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90292612-52bb-4bda-aa8a-ab760f3f51c3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:52.559363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90292612-52bb-4bda-aa8a-ab760f3f51c3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:52.559797 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90292612-52bb-4bda-aa8a-ab760f3f51c3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:52.574867 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8ac7c0ac-9355-4bd8-8e98-7b5c5e5715d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:52.575435 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8ac7c0ac-9355-4bd8-8e98-7b5c5e5715d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:52.582068 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8ac7c0ac-9355-4bd8-8e98-7b5c5e5715d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:52.582517 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8ac7c0ac-9355-4bd8-8e98-7b5c5e5715d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:52.583277 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8ac7c0ac-9355-4bd8-8e98-7b5c5e5715d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:52.583747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8ac7c0ac-9355-4bd8-8e98-7b5c5e5715d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:52.727606 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8ac7c0ac-9355-4bd8-8e98-7b5c5e5715d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:52.736575 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8ac7c0ac-9355-4bd8-8e98-7b5c5e5715d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:52.738220 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8ac7c0ac-9355-4bd8-8e98-7b5c5e5715d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:52.739390 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8ac7c0ac-9355-4bd8-8e98-7b5c5e5715d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.168452 Apr 05 12:08:52.739964 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1112/2245] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:52 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:52.744765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9f684f31-c165-4196-9c5b-9a425cbede2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:52.745377 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9f684f31-c165-4196-9c5b-9a425cbede2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:52.751593 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9f684f31-c165-4196-9c5b-9a425cbede2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:52.751966 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9f684f31-c165-4196-9c5b-9a425cbede2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:52.752838 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9f684f31-c165-4196-9c5b-9a425cbede2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:52.753265 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9f684f31-c165-4196-9c5b-9a425cbede2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:52.898535 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9f684f31-c165-4196-9c5b-9a425cbede2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:52.907036 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9f684f31-c165-4196-9c5b-9a425cbede2f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.165972 Apr 05 12:08:52.907627 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1113/2246] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:52 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:52.943051 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-90292612-52bb-4bda-aa8a-ab760f3f51c3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:52.950788 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-90292612-52bb-4bda-aa8a-ab760f3f51c3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.406176 Apr 05 12:08:52.951382 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1134/2247] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:52 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:53.758638 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d1647943-a2d3-4f0e-9c6f-124fce7b594a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:53.759889 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d1647943-a2d3-4f0e-9c6f-124fce7b594a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:53.766500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d1647943-a2d3-4f0e-9c6f-124fce7b594a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:53.766982 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d1647943-a2d3-4f0e-9c6f-124fce7b594a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:53.767742 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d1647943-a2d3-4f0e-9c6f-124fce7b594a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:53.768334 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d1647943-a2d3-4f0e-9c6f-124fce7b594a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:53.918106 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d1647943-a2d3-4f0e-9c6f-124fce7b594a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:53.923839 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9108cec8-6e30-4c08-b0ce-63455b59f809 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:53.924482 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9108cec8-6e30-4c08-b0ce-63455b59f809 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:53.926602 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d1647943-a2d3-4f0e-9c6f-124fce7b594a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:53.928163 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d1647943-a2d3-4f0e-9c6f-124fce7b594a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:53.929274 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d1647943-a2d3-4f0e-9c6f-124fce7b594a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.175140 Apr 05 12:08:53.929829 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1114/2248] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:53 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:53.930644 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9108cec8-6e30-4c08-b0ce-63455b59f809 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:53.931068 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9108cec8-6e30-4c08-b0ce-63455b59f809 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:53.931838 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9108cec8-6e30-4c08-b0ce-63455b59f809 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:53.932307 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9108cec8-6e30-4c08-b0ce-63455b59f809 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:53.968429 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-268ba073-ec2a-44a0-929a-72dcad9848b4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:53.969031 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-268ba073-ec2a-44a0-929a-72dcad9848b4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:53.975104 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-268ba073-ec2a-44a0-929a-72dcad9848b4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:53.975541 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-268ba073-ec2a-44a0-929a-72dcad9848b4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:53.976333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-268ba073-ec2a-44a0-929a-72dcad9848b4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:53.976759 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-268ba073-ec2a-44a0-929a-72dcad9848b4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:54.063856 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9108cec8-6e30-4c08-b0ce-63455b59f809 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:54.072022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9108cec8-6e30-4c08-b0ce-63455b59f809 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.152222 Apr 05 12:08:54.072669 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1135/2249] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:53 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:54.106353 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-268ba073-ec2a-44a0-929a-72dcad9848b4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:54.114376 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-268ba073-ec2a-44a0-929a-72dcad9848b4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.149586 Apr 05 12:08:54.115067 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1115/2250] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:53 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:08:54.951806 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-34dcf63f-142f-405b-89da-68aebc2a23c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:54.952853 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-34dcf63f-142f-405b-89da-68aebc2a23c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:54.960812 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34dcf63f-142f-405b-89da-68aebc2a23c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:54.961264 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34dcf63f-142f-405b-89da-68aebc2a23c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:54.962027 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34dcf63f-142f-405b-89da-68aebc2a23c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:54.962465 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34dcf63f-142f-405b-89da-68aebc2a23c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:55.089709 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4a576894-98ac-4967-8534-7a61527ebf34 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:55.090453 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4a576894-98ac-4967-8534-7a61527ebf34 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:55.096509 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-34dcf63f-142f-405b-89da-68aebc2a23c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:55.097252 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4a576894-98ac-4967-8534-7a61527ebf34 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:55.097708 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4a576894-98ac-4967-8534-7a61527ebf34 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:55.098492 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4a576894-98ac-4967-8534-7a61527ebf34 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:55.098927 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4a576894-98ac-4967-8534-7a61527ebf34 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:55.105038 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-34dcf63f-142f-405b-89da-68aebc2a23c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:55.106545 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-34dcf63f-142f-405b-89da-68aebc2a23c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:55.107742 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-34dcf63f-142f-405b-89da-68aebc2a23c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.162427 Apr 05 12:08:55.108313 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1136/2251] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:54 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:55.134280 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3b654445-e88e-4b9a-9fb7-636d51a7cfb1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:55.134894 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3b654445-e88e-4b9a-9fb7-636d51a7cfb1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:55.140946 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b654445-e88e-4b9a-9fb7-636d51a7cfb1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:55.141397 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b654445-e88e-4b9a-9fb7-636d51a7cfb1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:55.142271 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b654445-e88e-4b9a-9fb7-636d51a7cfb1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:55.142738 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b654445-e88e-4b9a-9fb7-636d51a7cfb1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:55.235063 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4a576894-98ac-4967-8534-7a61527ebf34 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:55.243243 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4a576894-98ac-4967-8534-7a61527ebf34 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.157428 Apr 05 12:08:55.243820 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1116/2252] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:55 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:55.274227 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3b654445-e88e-4b9a-9fb7-636d51a7cfb1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:55.282081 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3b654445-e88e-4b9a-9fb7-636d51a7cfb1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.151572 Apr 05 12:08:55.282651 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1137/2253] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:55 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:56.131590 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b9bec4b5-18e7-4e24-aeff-2e2a3b4a4157 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:56.132591 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b9bec4b5-18e7-4e24-aeff-2e2a3b4a4157 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:56.142995 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b9bec4b5-18e7-4e24-aeff-2e2a3b4a4157 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:56.143747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b9bec4b5-18e7-4e24-aeff-2e2a3b4a4157 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:56.145047 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b9bec4b5-18e7-4e24-aeff-2e2a3b4a4157 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:56.145779 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b9bec4b5-18e7-4e24-aeff-2e2a3b4a4157 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:56.261062 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-63dcfa03-1469-436f-a7ef-91338b1b8e41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:56.261648 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-63dcfa03-1469-436f-a7ef-91338b1b8e41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:56.268269 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-63dcfa03-1469-436f-a7ef-91338b1b8e41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:56.268710 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-63dcfa03-1469-436f-a7ef-91338b1b8e41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:56.269607 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-63dcfa03-1469-436f-a7ef-91338b1b8e41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:56.270031 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-63dcfa03-1469-436f-a7ef-91338b1b8e41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:56.284517 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b9bec4b5-18e7-4e24-aeff-2e2a3b4a4157 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:56.293028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b9bec4b5-18e7-4e24-aeff-2e2a3b4a4157 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:56.294629 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b9bec4b5-18e7-4e24-aeff-2e2a3b4a4157 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:56.295797 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b9bec4b5-18e7-4e24-aeff-2e2a3b4a4157 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.171358 Apr 05 12:08:56.296389 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1117/2254] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:56 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:56.300763 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6fe05e5c-cbf6-41f1-ac80-6a3d15799cb0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:56.301336 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6fe05e5c-cbf6-41f1-ac80-6a3d15799cb0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:56.307312 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6fe05e5c-cbf6-41f1-ac80-6a3d15799cb0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:56.307758 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6fe05e5c-cbf6-41f1-ac80-6a3d15799cb0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:56.308559 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6fe05e5c-cbf6-41f1-ac80-6a3d15799cb0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:56.308975 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6fe05e5c-cbf6-41f1-ac80-6a3d15799cb0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:56.404791 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-63dcfa03-1469-436f-a7ef-91338b1b8e41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:56.412671 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-63dcfa03-1469-436f-a7ef-91338b1b8e41 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.155557 Apr 05 12:08:56.413276 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1138/2255] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:56 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:56.438871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6fe05e5c-cbf6-41f1-ac80-6a3d15799cb0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:56.446726 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6fe05e5c-cbf6-41f1-ac80-6a3d15799cb0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.149437 Apr 05 12:08:56.447446 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1118/2256] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:56 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:57.318973 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a905d23c-ad5a-4e48-a7db-8c23495dcf32 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:57.319900 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a905d23c-ad5a-4e48-a7db-8c23495dcf32 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:57.330919 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a905d23c-ad5a-4e48-a7db-8c23495dcf32 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:57.331687 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a905d23c-ad5a-4e48-a7db-8c23495dcf32 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:57.332998 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a905d23c-ad5a-4e48-a7db-8c23495dcf32 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:57.333641 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a905d23c-ad5a-4e48-a7db-8c23495dcf32 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:57.430939 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-755267cf-3423-4f44-81f6-5e5475c7bd5a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:57.431548 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-755267cf-3423-4f44-81f6-5e5475c7bd5a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:57.438358 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-755267cf-3423-4f44-81f6-5e5475c7bd5a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:57.439068 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-755267cf-3423-4f44-81f6-5e5475c7bd5a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:57.440018 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-755267cf-3423-4f44-81f6-5e5475c7bd5a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:57.440676 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-755267cf-3423-4f44-81f6-5e5475c7bd5a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:57.476276 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a905d23c-ad5a-4e48-a7db-8c23495dcf32 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:57.485192 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a905d23c-ad5a-4e48-a7db-8c23495dcf32 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:57.486743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a905d23c-ad5a-4e48-a7db-8c23495dcf32 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:57.487922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a905d23c-ad5a-4e48-a7db-8c23495dcf32 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.175926 Apr 05 12:08:57.488849 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1139/2257] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:57 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:57.493785 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-553f081d-bfc6-4f6a-8729-126c468cbe1c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:57.494399 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-553f081d-bfc6-4f6a-8729-126c468cbe1c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:57.500548 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-553f081d-bfc6-4f6a-8729-126c468cbe1c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:57.501004 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-553f081d-bfc6-4f6a-8729-126c468cbe1c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:57.501802 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-553f081d-bfc6-4f6a-8729-126c468cbe1c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:57.502236 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-553f081d-bfc6-4f6a-8729-126c468cbe1c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:57.588317 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-755267cf-3423-4f44-81f6-5e5475c7bd5a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:57.596812 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-755267cf-3423-4f44-81f6-5e5475c7bd5a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.169801 Apr 05 12:08:57.597410 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1119/2258] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:57 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:08:57.639989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-553f081d-bfc6-4f6a-8729-126c468cbe1c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:57.649758 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-553f081d-bfc6-4f6a-8729-126c468cbe1c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.159670 Apr 05 12:08:57.650333 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1140/2259] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:57 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:58.511031 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-858aeafa-0386-4bec-9fb9-5b00d19ab02f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:58.512038 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-858aeafa-0386-4bec-9fb9-5b00d19ab02f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:58.522131 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-858aeafa-0386-4bec-9fb9-5b00d19ab02f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:58.522577 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-858aeafa-0386-4bec-9fb9-5b00d19ab02f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:58.523342 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-858aeafa-0386-4bec-9fb9-5b00d19ab02f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:58.523777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-858aeafa-0386-4bec-9fb9-5b00d19ab02f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:58.616613 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ca10a8d0-d5eb-4874-a1a9-770a8ca8f107 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:58.617251 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ca10a8d0-d5eb-4874-a1a9-770a8ca8f107 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:58.623496 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ca10a8d0-d5eb-4874-a1a9-770a8ca8f107 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:58.623938 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ca10a8d0-d5eb-4874-a1a9-770a8ca8f107 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:58.624755 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ca10a8d0-d5eb-4874-a1a9-770a8ca8f107 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:58.625184 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ca10a8d0-d5eb-4874-a1a9-770a8ca8f107 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:58.672452 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-858aeafa-0386-4bec-9fb9-5b00d19ab02f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:58.681320 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-858aeafa-0386-4bec-9fb9-5b00d19ab02f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:58.682830 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-858aeafa-0386-4bec-9fb9-5b00d19ab02f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:58.683984 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-858aeafa-0386-4bec-9fb9-5b00d19ab02f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.179814 Apr 05 12:08:58.694755 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1120/2260] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:58 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:58.694755 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-48669f8a-bafd-45ac-ae3c-80f08692c64e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:58.694755 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-48669f8a-bafd-45ac-ae3c-80f08692c64e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:58.695313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-48669f8a-bafd-45ac-ae3c-80f08692c64e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:58.695760 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-48669f8a-bafd-45ac-ae3c-80f08692c64e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:58.696565 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-48669f8a-bafd-45ac-ae3c-80f08692c64e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:58.697000 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-48669f8a-bafd-45ac-ae3c-80f08692c64e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:58.760769 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ca10a8d0-d5eb-4874-a1a9-770a8ca8f107 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:58.768590 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ca10a8d0-d5eb-4874-a1a9-770a8ca8f107 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.157526 Apr 05 12:08:58.769167 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1141/2261] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:58 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:58.831642 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-48669f8a-bafd-45ac-ae3c-80f08692c64e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:58.840389 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-48669f8a-bafd-45ac-ae3c-80f08692c64e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.154835 Apr 05 12:08:58.840965 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1121/2262] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:58 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:59.706546 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fc5c3214-6a22-4f13-9762-dcc69b339c41 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:59.708508 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fc5c3214-6a22-4f13-9762-dcc69b339c41 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:59.719288 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc5c3214-6a22-4f13-9762-dcc69b339c41 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:59.720024 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc5c3214-6a22-4f13-9762-dcc69b339c41 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:59.721391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc5c3214-6a22-4f13-9762-dcc69b339c41 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:59.722292 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc5c3214-6a22-4f13-9762-dcc69b339c41 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:59.786581 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ec1692ff-5adc-4785-8ab2-1df537e714b5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:59.787150 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ec1692ff-5adc-4785-8ab2-1df537e714b5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:59.793503 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec1692ff-5adc-4785-8ab2-1df537e714b5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:59.793950 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec1692ff-5adc-4785-8ab2-1df537e714b5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:59.794705 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec1692ff-5adc-4785-8ab2-1df537e714b5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:59.795132 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec1692ff-5adc-4785-8ab2-1df537e714b5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:59.858746 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fc5c3214-6a22-4f13-9762-dcc69b339c41 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:59.867743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fc5c3214-6a22-4f13-9762-dcc69b339c41 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:59.869319 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fc5c3214-6a22-4f13-9762-dcc69b339c41 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:59.870484 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fc5c3214-6a22-4f13-9762-dcc69b339c41 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.170514 Apr 05 12:08:59.871020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1142/2263] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:08:59 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:08:59.875512 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5625e2df-2355-4906-a4c1-7407937dfeb2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:08:59.876446 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5625e2df-2355-4906-a4c1-7407937dfeb2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:08:59.882429 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5625e2df-2355-4906-a4c1-7407937dfeb2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:59.882852 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5625e2df-2355-4906-a4c1-7407937dfeb2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:59.883611 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5625e2df-2355-4906-a4c1-7407937dfeb2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:08:59.884667 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5625e2df-2355-4906-a4c1-7407937dfeb2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:08:59.928019 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ec1692ff-5adc-4785-8ab2-1df537e714b5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:08:59.935825 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ec1692ff-5adc-4785-8ab2-1df537e714b5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.153407 Apr 05 12:08:59.936445 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1122/2264] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:59 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:09:00.021573 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5625e2df-2355-4906-a4c1-7407937dfeb2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:00.029430 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5625e2df-2355-4906-a4c1-7407937dfeb2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.157456 Apr 05 12:09:00.030034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1143/2265] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:08:59 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:00.889777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b7f50dc6-5234-489c-92c4-6da4ce71f0c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:00.890399 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b7f50dc6-5234-489c-92c4-6da4ce71f0c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:00.896981 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b7f50dc6-5234-489c-92c4-6da4ce71f0c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:00.897430 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b7f50dc6-5234-489c-92c4-6da4ce71f0c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:00.898184 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b7f50dc6-5234-489c-92c4-6da4ce71f0c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:00.898609 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b7f50dc6-5234-489c-92c4-6da4ce71f0c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:00.953629 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3fc5918a-fae8-4fcf-a4bb-24d3a165fcdd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:00.954223 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3fc5918a-fae8-4fcf-a4bb-24d3a165fcdd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:00.961210 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3fc5918a-fae8-4fcf-a4bb-24d3a165fcdd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:00.961679 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3fc5918a-fae8-4fcf-a4bb-24d3a165fcdd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:00.962443 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3fc5918a-fae8-4fcf-a4bb-24d3a165fcdd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:00.962848 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3fc5918a-fae8-4fcf-a4bb-24d3a165fcdd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:01.037914 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b7f50dc6-5234-489c-92c4-6da4ce71f0c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:01.047381 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b7f50dc6-5234-489c-92c4-6da4ce71f0c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:01.048961 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b7f50dc6-5234-489c-92c4-6da4ce71f0c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:01.050139 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b7f50dc6-5234-489c-92c4-6da4ce71f0c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.164418 Apr 05 12:09:01.050702 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1123/2266] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:00 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:01.055603 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2224b10d-46a5-4f63-93f9-4ba4ab763255 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:01.056931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2224b10d-46a5-4f63-93f9-4ba4ab763255 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:01.062953 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2224b10d-46a5-4f63-93f9-4ba4ab763255 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:01.063407 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2224b10d-46a5-4f63-93f9-4ba4ab763255 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:01.064228 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2224b10d-46a5-4f63-93f9-4ba4ab763255 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:01.064670 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2224b10d-46a5-4f63-93f9-4ba4ab763255 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:01.200377 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3fc5918a-fae8-4fcf-a4bb-24d3a165fcdd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:01.200679 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2224b10d-46a5-4f63-93f9-4ba4ab763255 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:01.210567 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2224b10d-46a5-4f63-93f9-4ba4ab763255 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.158846 Apr 05 12:09:01.211146 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1124/2267] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:01 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:01.213757 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3fc5918a-fae8-4fcf-a4bb-24d3a165fcdd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.264026 Apr 05 12:09:01.215442 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1144/2268] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:00 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:01.352024 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-03230bdd-4a18-4495-bdb2-d95f46c35dc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:01.352536 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-03230bdd-4a18-4495-bdb2-d95f46c35dc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:01.358549 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03230bdd-4a18-4495-bdb2-d95f46c35dc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:01.359001 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03230bdd-4a18-4495-bdb2-d95f46c35dc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:01.359769 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03230bdd-4a18-4495-bdb2-d95f46c35dc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:01.360226 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03230bdd-4a18-4495-bdb2-d95f46c35dc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:01.384565 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-03230bdd-4a18-4495-bdb2-d95f46c35dc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Going to try to terminate instance {{(pid=123357) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 12:09:01.464117 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-03230bdd-4a18-4495-bdb2-d95f46c35dc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "DELETE /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 204 len: 0 microversion: 2.1 time: 0.115659 Apr 05 12:09:01.465000 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1125/2269] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 12:09:01 2022] DELETE /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:09:01.473012 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2d6106db-3e77-4837-b554-9b3333d2a10c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:01.473628 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2d6106db-3e77-4837-b554-9b3333d2a10c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:01.479534 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2d6106db-3e77-4837-b554-9b3333d2a10c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:01.479981 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2d6106db-3e77-4837-b554-9b3333d2a10c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:01.480780 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2d6106db-3e77-4837-b554-9b3333d2a10c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:01.481216 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2d6106db-3e77-4837-b554-9b3333d2a10c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:01.614729 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2d6106db-3e77-4837-b554-9b3333d2a10c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:01.622599 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2d6106db-3e77-4837-b554-9b3333d2a10c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.153478 Apr 05 12:09:01.623172 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1145/2270] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:01 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:02.073917 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0b2a7640-6c32-42c4-8c5c-21cb1f0d5206 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:02.075059 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0b2a7640-6c32-42c4-8c5c-21cb1f0d5206 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:02.085522 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0b2a7640-6c32-42c4-8c5c-21cb1f0d5206 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:02.086274 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0b2a7640-6c32-42c4-8c5c-21cb1f0d5206 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:02.087507 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0b2a7640-6c32-42c4-8c5c-21cb1f0d5206 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:02.088358 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0b2a7640-6c32-42c4-8c5c-21cb1f0d5206 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:02.234871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0b2a7640-6c32-42c4-8c5c-21cb1f0d5206 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:02.236884 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6ee396a5-9730-4b00-994f-cc496af208f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:02.237857 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6ee396a5-9730-4b00-994f-cc496af208f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:02.243384 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0b2a7640-6c32-42c4-8c5c-21cb1f0d5206 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:02.244381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6ee396a5-9730-4b00-994f-cc496af208f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:02.244832 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6ee396a5-9730-4b00-994f-cc496af208f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:02.245138 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0b2a7640-6c32-42c4-8c5c-21cb1f0d5206 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:02.245582 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6ee396a5-9730-4b00-994f-cc496af208f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:02.246006 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6ee396a5-9730-4b00-994f-cc496af208f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:02.246545 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0b2a7640-6c32-42c4-8c5c-21cb1f0d5206 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.179915 Apr 05 12:09:02.247174 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1126/2271] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:02 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:02.251517 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c3bdae8f-e9da-4d38-9214-fc9cc580ccfd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:02.252234 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c3bdae8f-e9da-4d38-9214-fc9cc580ccfd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:02.258351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3bdae8f-e9da-4d38-9214-fc9cc580ccfd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:02.258869 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3bdae8f-e9da-4d38-9214-fc9cc580ccfd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:02.259695 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3bdae8f-e9da-4d38-9214-fc9cc580ccfd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:02.260227 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3bdae8f-e9da-4d38-9214-fc9cc580ccfd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:02.377273 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6ee396a5-9730-4b00-994f-cc496af208f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:02.385543 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6ee396a5-9730-4b00-994f-cc496af208f3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.152451 Apr 05 12:09:02.386109 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1146/2272] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:02 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:02.397921 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c3bdae8f-e9da-4d38-9214-fc9cc580ccfd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:02.405816 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c3bdae8f-e9da-4d38-9214-fc9cc580ccfd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.157633 Apr 05 12:09:02.406377 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1127/2273] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:02 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:02.644428 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5573f2de-4c7b-4cc3-9395-176356db9bb1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:02.645320 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5573f2de-4c7b-4cc3-9395-176356db9bb1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:02.655592 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5573f2de-4c7b-4cc3-9395-176356db9bb1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:02.656388 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5573f2de-4c7b-4cc3-9395-176356db9bb1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:02.657631 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5573f2de-4c7b-4cc3-9395-176356db9bb1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:02.658342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5573f2de-4c7b-4cc3-9395-176356db9bb1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:02.800574 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5573f2de-4c7b-4cc3-9395-176356db9bb1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:02.811895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5573f2de-4c7b-4cc3-9395-176356db9bb1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.173975 Apr 05 12:09:02.812730 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1147/2274] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:02 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:03.265737 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a98392f6-068c-4c36-9ff9-5666e5b7b11e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:03.266349 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a98392f6-068c-4c36-9ff9-5666e5b7b11e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:03.273203 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a98392f6-068c-4c36-9ff9-5666e5b7b11e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:03.273656 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a98392f6-068c-4c36-9ff9-5666e5b7b11e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:03.274420 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a98392f6-068c-4c36-9ff9-5666e5b7b11e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:03.274852 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a98392f6-068c-4c36-9ff9-5666e5b7b11e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:03.402825 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bea8874e-71f2-4439-8307-3d4018f9707d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:03.403415 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bea8874e-71f2-4439-8307-3d4018f9707d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:03.409749 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bea8874e-71f2-4439-8307-3d4018f9707d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:03.410189 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bea8874e-71f2-4439-8307-3d4018f9707d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:03.410917 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bea8874e-71f2-4439-8307-3d4018f9707d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:03.411411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bea8874e-71f2-4439-8307-3d4018f9707d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:03.420975 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a98392f6-068c-4c36-9ff9-5666e5b7b11e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:03.429526 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a98392f6-068c-4c36-9ff9-5666e5b7b11e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:03.431092 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a98392f6-068c-4c36-9ff9-5666e5b7b11e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:03.432476 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a98392f6-068c-4c36-9ff9-5666e5b7b11e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.170572 Apr 05 12:09:03.433018 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1128/2275] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:03 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:03.438022 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ac620643-8797-4bd1-bb81-138b2b6d6a08 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:03.438637 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ac620643-8797-4bd1-bb81-138b2b6d6a08 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:03.444747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ac620643-8797-4bd1-bb81-138b2b6d6a08 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:03.445200 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ac620643-8797-4bd1-bb81-138b2b6d6a08 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:03.445964 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ac620643-8797-4bd1-bb81-138b2b6d6a08 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:03.446396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ac620643-8797-4bd1-bb81-138b2b6d6a08 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:03.547462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bea8874e-71f2-4439-8307-3d4018f9707d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:03.555660 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bea8874e-71f2-4439-8307-3d4018f9707d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.156681 Apr 05 12:09:03.556479 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1148/2276] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:03 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:03.582379 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ac620643-8797-4bd1-bb81-138b2b6d6a08 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:03.590427 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ac620643-8797-4bd1-bb81-138b2b6d6a08 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.156489 Apr 05 12:09:03.591011 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1129/2277] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:03 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:03.831423 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1a3686f8-8153-4fb0-a968-2373ea04e0ca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:03.832016 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1a3686f8-8153-4fb0-a968-2373ea04e0ca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:03.838628 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a3686f8-8153-4fb0-a968-2373ea04e0ca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:03.839083 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a3686f8-8153-4fb0-a968-2373ea04e0ca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:03.839860 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a3686f8-8153-4fb0-a968-2373ea04e0ca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:03.840369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a3686f8-8153-4fb0-a968-2373ea04e0ca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:03.975451 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1a3686f8-8153-4fb0-a968-2373ea04e0ca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:03.983942 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1a3686f8-8153-4fb0-a968-2373ea04e0ca tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.156576 Apr 05 12:09:03.984571 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1149/2278] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:03 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:04.452941 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a1b35776-ba15-487c-8613-d45bd0559dba tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:04.453743 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a1b35776-ba15-487c-8613-d45bd0559dba tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:04.462366 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a1b35776-ba15-487c-8613-d45bd0559dba tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:04.462935 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a1b35776-ba15-487c-8613-d45bd0559dba tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:04.463967 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a1b35776-ba15-487c-8613-d45bd0559dba tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:04.464588 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a1b35776-ba15-487c-8613-d45bd0559dba tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:04.572748 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a40a061b-c3d3-443e-abf2-87de26ca5a66 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:04.573343 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a40a061b-c3d3-443e-abf2-87de26ca5a66 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:04.580056 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a40a061b-c3d3-443e-abf2-87de26ca5a66 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:04.580537 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a40a061b-c3d3-443e-abf2-87de26ca5a66 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:04.581298 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a40a061b-c3d3-443e-abf2-87de26ca5a66 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:04.581727 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a40a061b-c3d3-443e-abf2-87de26ca5a66 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:04.599673 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a1b35776-ba15-487c-8613-d45bd0559dba tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:04.608324 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a1b35776-ba15-487c-8613-d45bd0559dba tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:04.609824 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a1b35776-ba15-487c-8613-d45bd0559dba tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:04.610991 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a1b35776-ba15-487c-8613-d45bd0559dba tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.163337 Apr 05 12:09:04.611524 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1130/2279] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:04 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:04.617573 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cbb13b3d-8b35-450c-b52b-82fb318d9df5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:04.618180 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cbb13b3d-8b35-450c-b52b-82fb318d9df5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:04.624280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cbb13b3d-8b35-450c-b52b-82fb318d9df5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:04.624714 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cbb13b3d-8b35-450c-b52b-82fb318d9df5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:04.625489 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cbb13b3d-8b35-450c-b52b-82fb318d9df5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:04.625913 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cbb13b3d-8b35-450c-b52b-82fb318d9df5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:04.719016 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a40a061b-c3d3-443e-abf2-87de26ca5a66 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:04.727177 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a40a061b-c3d3-443e-abf2-87de26ca5a66 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.158285 Apr 05 12:09:04.727758 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1150/2280] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:04 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:04.760061 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-cbb13b3d-8b35-450c-b52b-82fb318d9df5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:04.768000 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cbb13b3d-8b35-450c-b52b-82fb318d9df5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.155529 Apr 05 12:09:04.768606 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1131/2281] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:04 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:05.005663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1e165c38-d242-4409-89ba-08cb2cfe397f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:05.006386 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1e165c38-d242-4409-89ba-08cb2cfe397f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:05.012579 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1e165c38-d242-4409-89ba-08cb2cfe397f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:05.013028 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1e165c38-d242-4409-89ba-08cb2cfe397f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:05.013784 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1e165c38-d242-4409-89ba-08cb2cfe397f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:05.014215 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1e165c38-d242-4409-89ba-08cb2cfe397f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:05.147122 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1e165c38-d242-4409-89ba-08cb2cfe397f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:05.155003 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1e165c38-d242-4409-89ba-08cb2cfe397f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.155971 Apr 05 12:09:05.155573 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1151/2282] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:04 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:05.630284 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7952d857-3090-4c27-ba9c-174e116b298f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:05.630798 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7952d857-3090-4c27-ba9c-174e116b298f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:05.637207 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7952d857-3090-4c27-ba9c-174e116b298f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:05.637652 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7952d857-3090-4c27-ba9c-174e116b298f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:05.638400 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7952d857-3090-4c27-ba9c-174e116b298f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:05.638829 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7952d857-3090-4c27-ba9c-174e116b298f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:05.744411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4fe516e7-9c55-4523-8de5-e44e3dd3bd51 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:05.745013 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4fe516e7-9c55-4523-8de5-e44e3dd3bd51 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:05.751162 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4fe516e7-9c55-4523-8de5-e44e3dd3bd51 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:05.751593 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4fe516e7-9c55-4523-8de5-e44e3dd3bd51 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:05.752379 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4fe516e7-9c55-4523-8de5-e44e3dd3bd51 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:05.752803 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4fe516e7-9c55-4523-8de5-e44e3dd3bd51 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:05.782143 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7952d857-3090-4c27-ba9c-174e116b298f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:05.790606 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7952d857-3090-4c27-ba9c-174e116b298f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:05.792114 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7952d857-3090-4c27-ba9c-174e116b298f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:05.793306 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7952d857-3090-4c27-ba9c-174e116b298f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.167531 Apr 05 12:09:05.793865 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1132/2283] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:05 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:05.798394 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7bca6d31-ea03-4550-b68d-e654e3adb97a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:05.798999 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7bca6d31-ea03-4550-b68d-e654e3adb97a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:05.804944 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7bca6d31-ea03-4550-b68d-e654e3adb97a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:05.805387 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7bca6d31-ea03-4550-b68d-e654e3adb97a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:05.806148 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7bca6d31-ea03-4550-b68d-e654e3adb97a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:05.806578 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7bca6d31-ea03-4550-b68d-e654e3adb97a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:05.893016 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4fe516e7-9c55-4523-8de5-e44e3dd3bd51 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:05.901154 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4fe516e7-9c55-4523-8de5-e44e3dd3bd51 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.160533 Apr 05 12:09:05.901741 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1152/2284] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:05 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:05.940373 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7bca6d31-ea03-4550-b68d-e654e3adb97a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:05.948822 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7bca6d31-ea03-4550-b68d-e654e3adb97a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.154021 Apr 05 12:09:05.949379 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1133/2285] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:05 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:06.176958 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4cbb9765-ca6e-42cb-ba9b-2cded1b01ae3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:06.177704 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4cbb9765-ca6e-42cb-ba9b-2cded1b01ae3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:06.185135 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cbb9765-ca6e-42cb-ba9b-2cded1b01ae3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:06.185649 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cbb9765-ca6e-42cb-ba9b-2cded1b01ae3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:06.186528 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cbb9765-ca6e-42cb-ba9b-2cded1b01ae3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:06.187029 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cbb9765-ca6e-42cb-ba9b-2cded1b01ae3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:06.327108 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4cbb9765-ca6e-42cb-ba9b-2cded1b01ae3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:06.336739 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4cbb9765-ca6e-42cb-ba9b-2cded1b01ae3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.166720 Apr 05 12:09:06.337291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1153/2286] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:06 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:06.815705 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3e93e8e3-5cff-42e2-a309-305e6ab0be9f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:06.816743 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3e93e8e3-5cff-42e2-a309-305e6ab0be9f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:06.827284 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e93e8e3-5cff-42e2-a309-305e6ab0be9f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:06.828016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e93e8e3-5cff-42e2-a309-305e6ab0be9f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:06.829298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e93e8e3-5cff-42e2-a309-305e6ab0be9f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:06.830009 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e93e8e3-5cff-42e2-a309-305e6ab0be9f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:06.918585 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-90cb471b-a062-42c2-a34f-dad4f800d3d9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:06.919244 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-90cb471b-a062-42c2-a34f-dad4f800d3d9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:06.927755 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90cb471b-a062-42c2-a34f-dad4f800d3d9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:06.928228 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90cb471b-a062-42c2-a34f-dad4f800d3d9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:06.928987 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90cb471b-a062-42c2-a34f-dad4f800d3d9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:06.929418 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90cb471b-a062-42c2-a34f-dad4f800d3d9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:06.969860 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3e93e8e3-5cff-42e2-a309-305e6ab0be9f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:06.978460 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3e93e8e3-5cff-42e2-a309-305e6ab0be9f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:06.979946 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3e93e8e3-5cff-42e2-a309-305e6ab0be9f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:06.981145 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3e93e8e3-5cff-42e2-a309-305e6ab0be9f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.171988 Apr 05 12:09:06.981708 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1134/2287] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:06 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:06.986328 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-702c1412-8dac-4994-8728-7d1607a0df20 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:06.986901 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-702c1412-8dac-4994-8728-7d1607a0df20 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:06.992818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-702c1412-8dac-4994-8728-7d1607a0df20 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:06.993267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-702c1412-8dac-4994-8728-7d1607a0df20 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:06.994174 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-702c1412-8dac-4994-8728-7d1607a0df20 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:06.994605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-702c1412-8dac-4994-8728-7d1607a0df20 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:07.067820 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-90cb471b-a062-42c2-a34f-dad4f800d3d9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:07.075675 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-90cb471b-a062-42c2-a34f-dad4f800d3d9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.161110 Apr 05 12:09:07.076501 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1154/2288] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:06 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:07.128265 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-702c1412-8dac-4994-8728-7d1607a0df20 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:07.136964 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-702c1412-8dac-4994-8728-7d1607a0df20 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.154356 Apr 05 12:09:07.137537 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1135/2289] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:06 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:07.362506 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e9199bd9-6f29-4586-9940-5fa398987494 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:07.363351 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e9199bd9-6f29-4586-9940-5fa398987494 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:07.373557 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e9199bd9-6f29-4586-9940-5fa398987494 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:07.374306 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e9199bd9-6f29-4586-9940-5fa398987494 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:07.375554 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e9199bd9-6f29-4586-9940-5fa398987494 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:07.376329 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e9199bd9-6f29-4586-9940-5fa398987494 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:07.516642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e9199bd9-6f29-4586-9940-5fa398987494 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:07.526290 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e9199bd9-6f29-4586-9940-5fa398987494 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.170368 Apr 05 12:09:07.526862 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1155/2290] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:07 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:07.999765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bd266d9c-57d1-42a2-80b1-fffcd8ec3e3d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:08.000416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bd266d9c-57d1-42a2-80b1-fffcd8ec3e3d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:08.008855 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bd266d9c-57d1-42a2-80b1-fffcd8ec3e3d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:08.009381 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bd266d9c-57d1-42a2-80b1-fffcd8ec3e3d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:08.010187 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bd266d9c-57d1-42a2-80b1-fffcd8ec3e3d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:08.010735 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bd266d9c-57d1-42a2-80b1-fffcd8ec3e3d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:08.093720 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-213442c6-0a2b-4bad-99fa-ea06ade178ad tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:08.094114 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-213442c6-0a2b-4bad-99fa-ea06ade178ad tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:08.100657 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-213442c6-0a2b-4bad-99fa-ea06ade178ad tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:08.101189 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-213442c6-0a2b-4bad-99fa-ea06ade178ad tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:08.101865 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-213442c6-0a2b-4bad-99fa-ea06ade178ad tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:08.102284 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-213442c6-0a2b-4bad-99fa-ea06ade178ad tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:08.152481 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-bd266d9c-57d1-42a2-80b1-fffcd8ec3e3d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:08.162044 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-bd266d9c-57d1-42a2-80b1-fffcd8ec3e3d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:08.163662 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-bd266d9c-57d1-42a2-80b1-fffcd8ec3e3d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:08.165514 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bd266d9c-57d1-42a2-80b1-fffcd8ec3e3d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.169233 Apr 05 12:09:08.165514 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1136/2291] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:07 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:08.169811 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c4eba15a-a9ba-48c4-813b-957ce8947aff tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:08.170429 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c4eba15a-a9ba-48c4-813b-957ce8947aff tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:08.176990 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c4eba15a-a9ba-48c4-813b-957ce8947aff tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:08.177439 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c4eba15a-a9ba-48c4-813b-957ce8947aff tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:08.178200 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c4eba15a-a9ba-48c4-813b-957ce8947aff tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:08.178632 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c4eba15a-a9ba-48c4-813b-957ce8947aff tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:08.256628 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-213442c6-0a2b-4bad-99fa-ea06ade178ad tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:08.264459 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-213442c6-0a2b-4bad-99fa-ea06ade178ad tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.174774 Apr 05 12:09:08.265327 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1156/2292] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:08 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:09:08.315075 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c4eba15a-a9ba-48c4-813b-957ce8947aff tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:08.326036 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c4eba15a-a9ba-48c4-813b-957ce8947aff tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.159359 Apr 05 12:09:08.326888 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1137/2293] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:08 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:08.542909 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fd1877f6-bfbe-4aee-9611-924efca0bccc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:08.543468 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fd1877f6-bfbe-4aee-9611-924efca0bccc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:08.549856 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fd1877f6-bfbe-4aee-9611-924efca0bccc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:08.550303 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fd1877f6-bfbe-4aee-9611-924efca0bccc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:08.551061 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fd1877f6-bfbe-4aee-9611-924efca0bccc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:08.551491 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fd1877f6-bfbe-4aee-9611-924efca0bccc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:08.690612 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fd1877f6-bfbe-4aee-9611-924efca0bccc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:08.698671 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fd1877f6-bfbe-4aee-9611-924efca0bccc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.159741 Apr 05 12:09:08.699236 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1157/2294] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:08 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:09.187268 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-63a382f0-f60c-4258-818b-a85171816956 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:09.188338 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-63a382f0-f60c-4258-818b-a85171816956 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:09.199278 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63a382f0-f60c-4258-818b-a85171816956 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:09.200036 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63a382f0-f60c-4258-818b-a85171816956 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:09.201347 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63a382f0-f60c-4258-818b-a85171816956 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:09.202077 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63a382f0-f60c-4258-818b-a85171816956 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:09.282690 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e95507fd-d11c-4f86-ab17-80900bd29670 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:09.283306 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e95507fd-d11c-4f86-ab17-80900bd29670 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:09.291772 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e95507fd-d11c-4f86-ab17-80900bd29670 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:09.292433 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e95507fd-d11c-4f86-ab17-80900bd29670 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:09.293521 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e95507fd-d11c-4f86-ab17-80900bd29670 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:09.294126 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e95507fd-d11c-4f86-ab17-80900bd29670 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:09.347826 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-63a382f0-f60c-4258-818b-a85171816956 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:09.360236 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-63a382f0-f60c-4258-818b-a85171816956 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:09.362123 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-63a382f0-f60c-4258-818b-a85171816956 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:09.363744 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-63a382f0-f60c-4258-818b-a85171816956 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.182958 Apr 05 12:09:09.364377 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1138/2295] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:09 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:09.368948 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cbff8d1f-7d95-468a-b7ba-a169a9163220 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:09.369547 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cbff8d1f-7d95-468a-b7ba-a169a9163220 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:09.375261 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cbff8d1f-7d95-468a-b7ba-a169a9163220 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:09.375708 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cbff8d1f-7d95-468a-b7ba-a169a9163220 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:09.376499 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cbff8d1f-7d95-468a-b7ba-a169a9163220 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:09.377138 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cbff8d1f-7d95-468a-b7ba-a169a9163220 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:09.427638 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e95507fd-d11c-4f86-ab17-80900bd29670 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:09.435450 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e95507fd-d11c-4f86-ab17-80900bd29670 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.157629 Apr 05 12:09:09.443569 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1158/2296] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:09 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:09:09.515640 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-cbff8d1f-7d95-468a-b7ba-a169a9163220 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:09.523533 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cbff8d1f-7d95-468a-b7ba-a169a9163220 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.158020 Apr 05 12:09:09.524096 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1139/2297] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:09 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:09.717010 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-94ddda6d-82f1-40ae-9f4b-561a33ad33ed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:09.718023 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-94ddda6d-82f1-40ae-9f4b-561a33ad33ed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:09.726698 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94ddda6d-82f1-40ae-9f4b-561a33ad33ed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:09.727179 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94ddda6d-82f1-40ae-9f4b-561a33ad33ed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:09.728045 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94ddda6d-82f1-40ae-9f4b-561a33ad33ed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:09.728514 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94ddda6d-82f1-40ae-9f4b-561a33ad33ed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:09.872495 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-94ddda6d-82f1-40ae-9f4b-561a33ad33ed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:09.881060 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-94ddda6d-82f1-40ae-9f4b-561a33ad33ed tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.168978 Apr 05 12:09:09.881603 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1159/2298] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:09 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:10.386753 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c1e5a031-a7d4-433d-afce-73faa187fe79 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:10.387836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c1e5a031-a7d4-433d-afce-73faa187fe79 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:10.398668 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1e5a031-a7d4-433d-afce-73faa187fe79 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:10.399463 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1e5a031-a7d4-433d-afce-73faa187fe79 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:10.400870 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1e5a031-a7d4-433d-afce-73faa187fe79 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:10.401605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1e5a031-a7d4-433d-afce-73faa187fe79 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:10.452745 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a0893de3-fea2-4a9b-a8b1-0b7f5ce3973d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:10.453373 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a0893de3-fea2-4a9b-a8b1-0b7f5ce3973d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:10.459934 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a0893de3-fea2-4a9b-a8b1-0b7f5ce3973d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:10.460417 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a0893de3-fea2-4a9b-a8b1-0b7f5ce3973d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:10.461352 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a0893de3-fea2-4a9b-a8b1-0b7f5ce3973d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:10.461789 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a0893de3-fea2-4a9b-a8b1-0b7f5ce3973d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:10.539278 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c1e5a031-a7d4-433d-afce-73faa187fe79 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:10.547644 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c1e5a031-a7d4-433d-afce-73faa187fe79 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:10.549242 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c1e5a031-a7d4-433d-afce-73faa187fe79 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:10.550407 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c1e5a031-a7d4-433d-afce-73faa187fe79 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.170701 Apr 05 12:09:10.550958 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1140/2299] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:10 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:10.555262 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6834f648-50b1-471a-93df-00820c29a3f8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:10.555860 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6834f648-50b1-471a-93df-00820c29a3f8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:10.564671 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6834f648-50b1-471a-93df-00820c29a3f8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:10.565119 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6834f648-50b1-471a-93df-00820c29a3f8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:10.565894 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6834f648-50b1-471a-93df-00820c29a3f8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:10.566321 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6834f648-50b1-471a-93df-00820c29a3f8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:10.594382 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a0893de3-fea2-4a9b-a8b1-0b7f5ce3973d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:10.602242 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a0893de3-fea2-4a9b-a8b1-0b7f5ce3973d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.153352 Apr 05 12:09:10.602818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1160/2300] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:10 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:10.700671 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6834f648-50b1-471a-93df-00820c29a3f8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:10.708606 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6834f648-50b1-471a-93df-00820c29a3f8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.156604 Apr 05 12:09:10.709175 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1141/2301] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:10 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:10.901774 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4a873a7f-26fc-4b00-aacb-4e2dd55227ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:10.902653 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4a873a7f-26fc-4b00-aacb-4e2dd55227ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:10.912283 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a873a7f-26fc-4b00-aacb-4e2dd55227ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:10.912726 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a873a7f-26fc-4b00-aacb-4e2dd55227ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:10.913477 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a873a7f-26fc-4b00-aacb-4e2dd55227ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:10.913902 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a873a7f-26fc-4b00-aacb-4e2dd55227ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:11.060417 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4a873a7f-26fc-4b00-aacb-4e2dd55227ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:11.070486 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4a873a7f-26fc-4b00-aacb-4e2dd55227ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.175414 Apr 05 12:09:11.071050 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1161/2302] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:10 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:11.573184 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-26e39d1e-c861-4553-a166-166b1c624c7d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:11.574189 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-26e39d1e-c861-4553-a166-166b1c624c7d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:11.584358 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-26e39d1e-c861-4553-a166-166b1c624c7d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:11.584812 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-26e39d1e-c861-4553-a166-166b1c624c7d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:11.585565 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-26e39d1e-c861-4553-a166-166b1c624c7d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:11.585997 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-26e39d1e-c861-4553-a166-166b1c624c7d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:11.618746 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2a4c9cf2-fd26-461d-bdcc-412a3a8e9c5e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:11.619350 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2a4c9cf2-fd26-461d-bdcc-412a3a8e9c5e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:11.625755 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2a4c9cf2-fd26-461d-bdcc-412a3a8e9c5e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:11.626202 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2a4c9cf2-fd26-461d-bdcc-412a3a8e9c5e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:11.626960 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2a4c9cf2-fd26-461d-bdcc-412a3a8e9c5e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:11.627391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2a4c9cf2-fd26-461d-bdcc-412a3a8e9c5e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:11.728806 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-26e39d1e-c861-4553-a166-166b1c624c7d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:11.738128 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-26e39d1e-c861-4553-a166-166b1c624c7d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:11.739621 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-26e39d1e-c861-4553-a166-166b1c624c7d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:11.740984 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-26e39d1e-c861-4553-a166-166b1c624c7d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.174416 Apr 05 12:09:11.741722 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1142/2303] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:11 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:11.745965 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-91d088f1-7104-45f7-a05b-460499e429c0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:11.746527 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-91d088f1-7104-45f7-a05b-460499e429c0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:11.752235 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-91d088f1-7104-45f7-a05b-460499e429c0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:11.752684 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-91d088f1-7104-45f7-a05b-460499e429c0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:11.753443 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-91d088f1-7104-45f7-a05b-460499e429c0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:11.753876 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-91d088f1-7104-45f7-a05b-460499e429c0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:11.769245 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2a4c9cf2-fd26-461d-bdcc-412a3a8e9c5e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:11.777031 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2a4c9cf2-fd26-461d-bdcc-412a3a8e9c5e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.162047 Apr 05 12:09:11.777579 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1162/2304] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:11 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:11.894335 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-91d088f1-7104-45f7-a05b-460499e429c0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:11.902521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-91d088f1-7104-45f7-a05b-460499e429c0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.160013 Apr 05 12:09:11.903091 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1143/2305] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:11 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:12.093673 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-08d69119-c7c7-44ca-8fe5-c658a3923e7e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:12.094547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-08d69119-c7c7-44ca-8fe5-c658a3923e7e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:12.104883 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-08d69119-c7c7-44ca-8fe5-c658a3923e7e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:12.105638 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-08d69119-c7c7-44ca-8fe5-c658a3923e7e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:12.106880 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-08d69119-c7c7-44ca-8fe5-c658a3923e7e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:12.107578 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-08d69119-c7c7-44ca-8fe5-c658a3923e7e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:12.247780 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-08d69119-c7c7-44ca-8fe5-c658a3923e7e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:12.261102 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-08d69119-c7c7-44ca-8fe5-c658a3923e7e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.173627 Apr 05 12:09:12.261909 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1163/2306] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:12 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:12.759388 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0ddf7a1f-7978-4472-939c-9ca8ba8cb797 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:12.759967 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0ddf7a1f-7978-4472-939c-9ca8ba8cb797 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:12.766785 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0ddf7a1f-7978-4472-939c-9ca8ba8cb797 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:12.767236 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0ddf7a1f-7978-4472-939c-9ca8ba8cb797 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:12.768004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0ddf7a1f-7978-4472-939c-9ca8ba8cb797 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:12.768489 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0ddf7a1f-7978-4472-939c-9ca8ba8cb797 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:12.794257 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0fe3abf9-b10a-43d5-a77b-02c2a2c7d8aa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:12.795816 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0fe3abf9-b10a-43d5-a77b-02c2a2c7d8aa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:12.802403 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0fe3abf9-b10a-43d5-a77b-02c2a2c7d8aa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:12.802848 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0fe3abf9-b10a-43d5-a77b-02c2a2c7d8aa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:12.803604 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0fe3abf9-b10a-43d5-a77b-02c2a2c7d8aa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:12.804061 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0fe3abf9-b10a-43d5-a77b-02c2a2c7d8aa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:12.911088 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0ddf7a1f-7978-4472-939c-9ca8ba8cb797 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:12.919622 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0ddf7a1f-7978-4472-939c-9ca8ba8cb797 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:12.921143 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0ddf7a1f-7978-4472-939c-9ca8ba8cb797 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:12.922323 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0ddf7a1f-7978-4472-939c-9ca8ba8cb797 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.166994 Apr 05 12:09:12.923109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1144/2307] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:12 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:12.937500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fdb3a836-b6ed-4fa4-af5c-e92f20d366ed tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:12.938114 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fdb3a836-b6ed-4fa4-af5c-e92f20d366ed tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:12.943546 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0fe3abf9-b10a-43d5-a77b-02c2a2c7d8aa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:12.944110 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fdb3a836-b6ed-4fa4-af5c-e92f20d366ed tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:12.944568 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fdb3a836-b6ed-4fa4-af5c-e92f20d366ed tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:12.945286 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fdb3a836-b6ed-4fa4-af5c-e92f20d366ed tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:12.945743 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fdb3a836-b6ed-4fa4-af5c-e92f20d366ed tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:12.951683 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0fe3abf9-b10a-43d5-a77b-02c2a2c7d8aa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.161261 Apr 05 12:09:12.952259 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1164/2308] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:12 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:13.082182 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fdb3a836-b6ed-4fa4-af5c-e92f20d366ed tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:13.090354 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fdb3a836-b6ed-4fa4-af5c-e92f20d366ed tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.166534 Apr 05 12:09:13.090928 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1145/2309] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:12 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:13.285468 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-77bd1bb0-32ab-4037-8bec-2d5da418c91a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:13.286456 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-77bd1bb0-32ab-4037-8bec-2d5da418c91a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:13.294009 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-77bd1bb0-32ab-4037-8bec-2d5da418c91a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:13.294547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-77bd1bb0-32ab-4037-8bec-2d5da418c91a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:13.295442 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-77bd1bb0-32ab-4037-8bec-2d5da418c91a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:13.295957 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-77bd1bb0-32ab-4037-8bec-2d5da418c91a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:13.435152 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-77bd1bb0-32ab-4037-8bec-2d5da418c91a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:13.443595 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-77bd1bb0-32ab-4037-8bec-2d5da418c91a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.164996 Apr 05 12:09:13.444200 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1165/2310] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:13 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:13.944801 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b15f8c2a-9ef2-4874-b850-17aa97694de0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:13.945465 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b15f8c2a-9ef2-4874-b850-17aa97694de0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:13.952816 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b15f8c2a-9ef2-4874-b850-17aa97694de0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:13.953335 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b15f8c2a-9ef2-4874-b850-17aa97694de0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:13.954164 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b15f8c2a-9ef2-4874-b850-17aa97694de0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:13.954651 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b15f8c2a-9ef2-4874-b850-17aa97694de0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:13.969887 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a7131185-315f-46bc-96c6-062d9eaccc20 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:13.970575 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a7131185-315f-46bc-96c6-062d9eaccc20 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:13.977547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7131185-315f-46bc-96c6-062d9eaccc20 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:13.977997 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7131185-315f-46bc-96c6-062d9eaccc20 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:13.978760 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7131185-315f-46bc-96c6-062d9eaccc20 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:13.979195 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7131185-315f-46bc-96c6-062d9eaccc20 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:14.093108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b15f8c2a-9ef2-4874-b850-17aa97694de0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:14.101852 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b15f8c2a-9ef2-4874-b850-17aa97694de0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:14.103394 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b15f8c2a-9ef2-4874-b850-17aa97694de0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:14.104593 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b15f8c2a-9ef2-4874-b850-17aa97694de0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.165624 Apr 05 12:09:14.105337 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1146/2311] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:13 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:14.109609 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a71330b7-bb2a-4150-bd84-1a2858449800 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:14.110212 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a71330b7-bb2a-4150-bd84-1a2858449800 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:14.112418 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a7131185-315f-46bc-96c6-062d9eaccc20 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:14.116185 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a71330b7-bb2a-4150-bd84-1a2858449800 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:14.116629 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a71330b7-bb2a-4150-bd84-1a2858449800 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:14.117388 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a71330b7-bb2a-4150-bd84-1a2858449800 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:14.117818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a71330b7-bb2a-4150-bd84-1a2858449800 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:14.120892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a7131185-315f-46bc-96c6-062d9eaccc20 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.155230 Apr 05 12:09:14.121562 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1166/2312] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:13 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:14.251041 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a71330b7-bb2a-4150-bd84-1a2858449800 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:14.259189 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a71330b7-bb2a-4150-bd84-1a2858449800 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.153048 Apr 05 12:09:14.259764 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1147/2313] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:14 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:14.463811 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-db3e5b2a-8615-4778-88ee-1bcc9b06118a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:14.464458 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-db3e5b2a-8615-4778-88ee-1bcc9b06118a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:14.470912 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-db3e5b2a-8615-4778-88ee-1bcc9b06118a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:14.471360 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-db3e5b2a-8615-4778-88ee-1bcc9b06118a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:14.472101 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-db3e5b2a-8615-4778-88ee-1bcc9b06118a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:14.472579 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-db3e5b2a-8615-4778-88ee-1bcc9b06118a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:14.615675 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-db3e5b2a-8615-4778-88ee-1bcc9b06118a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:14.624222 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-db3e5b2a-8615-4778-88ee-1bcc9b06118a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.164260 Apr 05 12:09:14.624800 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1167/2314] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:14 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:15.127004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9fa5d99b-4450-45cf-b5d1-c8193c4495db tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:15.127831 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9fa5d99b-4450-45cf-b5d1-c8193c4495db tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:15.138931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9fa5d99b-4450-45cf-b5d1-c8193c4495db tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:15.139675 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9fa5d99b-4450-45cf-b5d1-c8193c4495db tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:15.141023 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9fa5d99b-4450-45cf-b5d1-c8193c4495db tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:15.141773 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9fa5d99b-4450-45cf-b5d1-c8193c4495db tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:15.142704 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1fb6fc26-0204-4bc5-885b-266130b32710 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:15.143692 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1fb6fc26-0204-4bc5-885b-266130b32710 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:15.152795 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1fb6fc26-0204-4bc5-885b-266130b32710 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:15.153452 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1fb6fc26-0204-4bc5-885b-266130b32710 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:15.154593 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1fb6fc26-0204-4bc5-885b-266130b32710 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:15.155233 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1fb6fc26-0204-4bc5-885b-266130b32710 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:15.285927 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9fa5d99b-4450-45cf-b5d1-c8193c4495db tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:15.294335 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9fa5d99b-4450-45cf-b5d1-c8193c4495db tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:15.295829 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9fa5d99b-4450-45cf-b5d1-c8193c4495db tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:15.297012 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9fa5d99b-4450-45cf-b5d1-c8193c4495db tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.176677 Apr 05 12:09:15.297762 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1148/2315] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:15 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:15.302233 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f2e06c89-d8f6-4037-93d0-a68c56c12bc7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:15.302865 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f2e06c89-d8f6-4037-93d0-a68c56c12bc7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:15.308610 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f2e06c89-d8f6-4037-93d0-a68c56c12bc7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:15.309062 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f2e06c89-d8f6-4037-93d0-a68c56c12bc7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:15.309830 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f2e06c89-d8f6-4037-93d0-a68c56c12bc7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:15.309964 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1fb6fc26-0204-4bc5-885b-266130b32710 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:15.310262 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f2e06c89-d8f6-4037-93d0-a68c56c12bc7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:15.317774 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1fb6fc26-0204-4bc5-885b-266130b32710 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.181777 Apr 05 12:09:15.318333 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1168/2316] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:15 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:15.447324 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f2e06c89-d8f6-4037-93d0-a68c56c12bc7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:15.455499 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f2e06c89-d8f6-4037-93d0-a68c56c12bc7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.156882 Apr 05 12:09:15.456123 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1149/2317] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:15 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:15.643481 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e82fb040-2239-453b-aedf-4036b2914d55 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:15.644104 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e82fb040-2239-453b-aedf-4036b2914d55 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:15.650447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e82fb040-2239-453b-aedf-4036b2914d55 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:15.650825 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e82fb040-2239-453b-aedf-4036b2914d55 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:15.651572 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e82fb040-2239-453b-aedf-4036b2914d55 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:15.651998 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e82fb040-2239-453b-aedf-4036b2914d55 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:15.793866 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e82fb040-2239-453b-aedf-4036b2914d55 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:15.801703 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e82fb040-2239-453b-aedf-4036b2914d55 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.162152 Apr 05 12:09:15.802355 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1169/2318] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:15 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:16.318997 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8433d2df-b819-4a7b-ac75-b1012e27483f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:16.320000 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8433d2df-b819-4a7b-ac75-b1012e27483f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:16.330688 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8433d2df-b819-4a7b-ac75-b1012e27483f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:16.331458 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8433d2df-b819-4a7b-ac75-b1012e27483f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:16.332769 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8433d2df-b819-4a7b-ac75-b1012e27483f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:16.333499 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8433d2df-b819-4a7b-ac75-b1012e27483f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:16.338596 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2c26bd23-7273-4471-b033-9626515b3fb4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:16.339586 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2c26bd23-7273-4471-b033-9626515b3fb4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:16.349731 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2c26bd23-7273-4471-b033-9626515b3fb4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:16.350172 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2c26bd23-7273-4471-b033-9626515b3fb4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:16.350922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2c26bd23-7273-4471-b033-9626515b3fb4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:16.351343 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2c26bd23-7273-4471-b033-9626515b3fb4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:16.471635 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8433d2df-b819-4a7b-ac75-b1012e27483f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:16.480240 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8433d2df-b819-4a7b-ac75-b1012e27483f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:16.481812 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8433d2df-b819-4a7b-ac75-b1012e27483f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:16.482887 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8433d2df-b819-4a7b-ac75-b1012e27483f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.170678 Apr 05 12:09:16.483484 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1150/2319] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:16 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:16.484285 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2c26bd23-7273-4471-b033-9626515b3fb4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:16.488011 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1eeb5154-aa82-4eb1-a9b3-46448024f37e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:16.488669 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1eeb5154-aa82-4eb1-a9b3-46448024f37e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:16.494733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1eeb5154-aa82-4eb1-a9b3-46448024f37e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:16.495173 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1eeb5154-aa82-4eb1-a9b3-46448024f37e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:16.495958 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1eeb5154-aa82-4eb1-a9b3-46448024f37e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:16.496382 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1eeb5154-aa82-4eb1-a9b3-46448024f37e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:16.496883 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2c26bd23-7273-4471-b033-9626515b3fb4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.164789 Apr 05 12:09:16.497468 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1170/2320] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:16 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:16.631297 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1eeb5154-aa82-4eb1-a9b3-46448024f37e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:16.639029 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1eeb5154-aa82-4eb1-a9b3-46448024f37e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.154537 Apr 05 12:09:16.639631 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1151/2321] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:16 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:16.823394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-370bdd7b-e630-4ff7-a03a-6458a79d1377 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:16.824432 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-370bdd7b-e630-4ff7-a03a-6458a79d1377 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:16.834222 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-370bdd7b-e630-4ff7-a03a-6458a79d1377 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:16.834595 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-370bdd7b-e630-4ff7-a03a-6458a79d1377 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:16.835340 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-370bdd7b-e630-4ff7-a03a-6458a79d1377 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:16.835767 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-370bdd7b-e630-4ff7-a03a-6458a79d1377 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:16.970174 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-370bdd7b-e630-4ff7-a03a-6458a79d1377 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:16.979020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-370bdd7b-e630-4ff7-a03a-6458a79d1377 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.161668 Apr 05 12:09:16.979604 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1171/2322] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:16 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:17.505430 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c6a5e55a-fb82-4da3-a613-6f04a9807572 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:17.506504 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c6a5e55a-fb82-4da3-a613-6f04a9807572 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:17.517385 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c6a5e55a-fb82-4da3-a613-6f04a9807572 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:17.518129 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c6a5e55a-fb82-4da3-a613-6f04a9807572 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:17.518497 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-be501778-af7a-43fc-a3fa-dae947b76ad2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:17.519349 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c6a5e55a-fb82-4da3-a613-6f04a9807572 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:17.519790 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-be501778-af7a-43fc-a3fa-dae947b76ad2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:17.520057 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c6a5e55a-fb82-4da3-a613-6f04a9807572 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:17.526777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-be501778-af7a-43fc-a3fa-dae947b76ad2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:17.527216 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-be501778-af7a-43fc-a3fa-dae947b76ad2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:17.527956 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-be501778-af7a-43fc-a3fa-dae947b76ad2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:17.528413 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-be501778-af7a-43fc-a3fa-dae947b76ad2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:17.653086 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c6a5e55a-fb82-4da3-a613-6f04a9807572 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:17.660278 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-be501778-af7a-43fc-a3fa-dae947b76ad2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:17.661556 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c6a5e55a-fb82-4da3-a613-6f04a9807572 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:17.663126 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c6a5e55a-fb82-4da3-a613-6f04a9807572 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:17.664361 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c6a5e55a-fb82-4da3-a613-6f04a9807572 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.165831 Apr 05 12:09:17.664925 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1152/2323] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:17 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:17.668741 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-be501778-af7a-43fc-a3fa-dae947b76ad2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.156819 Apr 05 12:09:17.669277 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b54846dc-7c7f-44e7-8814-dd8f2d01c04f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:17.669885 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b54846dc-7c7f-44e7-8814-dd8f2d01c04f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:17.675672 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b54846dc-7c7f-44e7-8814-dd8f2d01c04f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:17.676146 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b54846dc-7c7f-44e7-8814-dd8f2d01c04f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:17.676913 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b54846dc-7c7f-44e7-8814-dd8f2d01c04f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:17.677349 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b54846dc-7c7f-44e7-8814-dd8f2d01c04f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:17.678490 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1172/2324] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:17 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:17.812569 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b54846dc-7c7f-44e7-8814-dd8f2d01c04f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:17.820520 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b54846dc-7c7f-44e7-8814-dd8f2d01c04f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.154601 Apr 05 12:09:17.821089 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1153/2325] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:17 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:17.999345 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-46c0c910-28a0-4b48-b229-62812c4966ce tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:18.000452 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-46c0c910-28a0-4b48-b229-62812c4966ce tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:18.011297 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-46c0c910-28a0-4b48-b229-62812c4966ce tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:18.011804 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-46c0c910-28a0-4b48-b229-62812c4966ce tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:18.013158 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-46c0c910-28a0-4b48-b229-62812c4966ce tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:18.013938 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-46c0c910-28a0-4b48-b229-62812c4966ce tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:18.158451 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-46c0c910-28a0-4b48-b229-62812c4966ce tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:18.169437 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-46c0c910-28a0-4b48-b229-62812c4966ce tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.176325 Apr 05 12:09:18.170132 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1173/2326] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:17 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:18.686701 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-03d9ea33-d96b-4b9e-acad-59714bb91c82 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:18.687687 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-03d9ea33-d96b-4b9e-acad-59714bb91c82 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:18.690156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5b2aed2e-5896-45e0-a0f6-60d9b1058a71 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:18.691152 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5b2aed2e-5896-45e0-a0f6-60d9b1058a71 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:18.696570 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03d9ea33-d96b-4b9e-acad-59714bb91c82 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:18.697025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03d9ea33-d96b-4b9e-acad-59714bb91c82 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:18.697799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03d9ea33-d96b-4b9e-acad-59714bb91c82 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:18.698283 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03d9ea33-d96b-4b9e-acad-59714bb91c82 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:18.698450 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5b2aed2e-5896-45e0-a0f6-60d9b1058a71 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:18.698800 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5b2aed2e-5896-45e0-a0f6-60d9b1058a71 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:18.699565 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5b2aed2e-5896-45e0-a0f6-60d9b1058a71 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:18.699979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5b2aed2e-5896-45e0-a0f6-60d9b1058a71 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:18.833765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-03d9ea33-d96b-4b9e-acad-59714bb91c82 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:18.838118 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5b2aed2e-5896-45e0-a0f6-60d9b1058a71 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:18.842716 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-03d9ea33-d96b-4b9e-acad-59714bb91c82 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:18.844221 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-03d9ea33-d96b-4b9e-acad-59714bb91c82 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:18.845391 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-03d9ea33-d96b-4b9e-acad-59714bb91c82 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.165352 Apr 05 12:09:18.845946 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5b2aed2e-5896-45e0-a0f6-60d9b1058a71 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.163063 Apr 05 12:09:18.846083 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1154/2327] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:18 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:18.846501 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1174/2328] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:18 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:18.850352 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5a93de32-1611-4093-bfd9-9dd574867030 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:18.850966 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5a93de32-1611-4093-bfd9-9dd574867030 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:18.857105 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5a93de32-1611-4093-bfd9-9dd574867030 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:18.857520 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5a93de32-1611-4093-bfd9-9dd574867030 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:18.858267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5a93de32-1611-4093-bfd9-9dd574867030 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:18.858693 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5a93de32-1611-4093-bfd9-9dd574867030 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:18.987690 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5a93de32-1611-4093-bfd9-9dd574867030 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:18.995566 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5a93de32-1611-4093-bfd9-9dd574867030 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.148665 Apr 05 12:09:18.996122 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1155/2329] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:18 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:19.190165 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-82614e4e-4727-41d4-b761-9f2580aa5228 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:19.191017 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-82614e4e-4727-41d4-b761-9f2580aa5228 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:19.197802 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-82614e4e-4727-41d4-b761-9f2580aa5228 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:19.198246 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-82614e4e-4727-41d4-b761-9f2580aa5228 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:19.198991 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-82614e4e-4727-41d4-b761-9f2580aa5228 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:19.199414 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-82614e4e-4727-41d4-b761-9f2580aa5228 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:19.335168 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-82614e4e-4727-41d4-b761-9f2580aa5228 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:19.343461 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-82614e4e-4727-41d4-b761-9f2580aa5228 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.159487 Apr 05 12:09:19.343956 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1175/2330] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:19 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:19.867131 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e9e03dcd-2718-43e8-ae33-c5bceff500cf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:19.868064 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1fff9e18-7b76-4df5-9455-99d042a65319 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:19.868841 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e9e03dcd-2718-43e8-ae33-c5bceff500cf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:19.869033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1fff9e18-7b76-4df5-9455-99d042a65319 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:19.878665 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e9e03dcd-2718-43e8-ae33-c5bceff500cf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:19.878953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1fff9e18-7b76-4df5-9455-99d042a65319 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:19.879394 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e9e03dcd-2718-43e8-ae33-c5bceff500cf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:19.880034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1fff9e18-7b76-4df5-9455-99d042a65319 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:19.880785 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e9e03dcd-2718-43e8-ae33-c5bceff500cf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:19.880943 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1fff9e18-7b76-4df5-9455-99d042a65319 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:19.881186 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e9e03dcd-2718-43e8-ae33-c5bceff500cf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:19.881322 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1fff9e18-7b76-4df5-9455-99d042a65319 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:20.017406 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e9e03dcd-2718-43e8-ae33-c5bceff500cf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:20.018814 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1fff9e18-7b76-4df5-9455-99d042a65319 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:20.026066 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e9e03dcd-2718-43e8-ae33-c5bceff500cf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:20.026710 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1fff9e18-7b76-4df5-9455-99d042a65319 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.165913 Apr 05 12:09:20.027295 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1176/2331] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:19 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:20.030194 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e9e03dcd-2718-43e8-ae33-c5bceff500cf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:20.031566 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e9e03dcd-2718-43e8-ae33-c5bceff500cf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.171177 Apr 05 12:09:20.031837 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a3f57873-a338-4b1f-a771-ff98293caae4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:20.032337 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1156/2332] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:19 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:20.032467 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a3f57873-a338-4b1f-a771-ff98293caae4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:20.038330 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a3f57873-a338-4b1f-a771-ff98293caae4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:20.038820 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a3f57873-a338-4b1f-a771-ff98293caae4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:20.039581 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a3f57873-a338-4b1f-a771-ff98293caae4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:20.039987 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a3f57873-a338-4b1f-a771-ff98293caae4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:20.177928 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a3f57873-a338-4b1f-a771-ff98293caae4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:20.186166 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a3f57873-a338-4b1f-a771-ff98293caae4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.157924 Apr 05 12:09:20.186737 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1177/2333] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:20 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:20.365254 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-aca02891-30e1-4cd1-a8ff-6d01192d64fd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:20.366350 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-aca02891-30e1-4cd1-a8ff-6d01192d64fd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:20.376590 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aca02891-30e1-4cd1-a8ff-6d01192d64fd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:20.377242 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aca02891-30e1-4cd1-a8ff-6d01192d64fd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:20.378494 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aca02891-30e1-4cd1-a8ff-6d01192d64fd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:20.379211 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aca02891-30e1-4cd1-a8ff-6d01192d64fd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:20.523951 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-aca02891-30e1-4cd1-a8ff-6d01192d64fd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:20.531852 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-aca02891-30e1-4cd1-a8ff-6d01192d64fd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.173286 Apr 05 12:09:20.532451 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1157/2334] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:20 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:21.048305 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8bfa9aad-56dd-4c0c-bcbe-eff3fdab3784 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:21.049508 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8bfa9aad-56dd-4c0c-bcbe-eff3fdab3784 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:21.053351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d5d53aec-6805-4e3f-97d0-cb92c1c20dea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:21.053966 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d5d53aec-6805-4e3f-97d0-cb92c1c20dea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:21.057389 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8bfa9aad-56dd-4c0c-bcbe-eff3fdab3784 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:21.057884 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8bfa9aad-56dd-4c0c-bcbe-eff3fdab3784 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:21.058636 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8bfa9aad-56dd-4c0c-bcbe-eff3fdab3784 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:21.059074 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8bfa9aad-56dd-4c0c-bcbe-eff3fdab3784 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:21.060591 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d5d53aec-6805-4e3f-97d0-cb92c1c20dea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:21.061049 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d5d53aec-6805-4e3f-97d0-cb92c1c20dea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:21.061824 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d5d53aec-6805-4e3f-97d0-cb92c1c20dea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:21.062302 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d5d53aec-6805-4e3f-97d0-cb92c1c20dea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:21.195343 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8bfa9aad-56dd-4c0c-bcbe-eff3fdab3784 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:21.203245 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d5d53aec-6805-4e3f-97d0-cb92c1c20dea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:21.205564 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8bfa9aad-56dd-4c0c-bcbe-eff3fdab3784 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.163813 Apr 05 12:09:21.206418 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1178/2335] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:21 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:21.211885 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d5d53aec-6805-4e3f-97d0-cb92c1c20dea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:21.213479 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d5d53aec-6805-4e3f-97d0-cb92c1c20dea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:21.214641 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d5d53aec-6805-4e3f-97d0-cb92c1c20dea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.167234 Apr 05 12:09:21.218539 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-60a6d95b-d1f8-4f37-b324-74d63b76e374 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:21.219623 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-60a6d95b-d1f8-4f37-b324-74d63b76e374 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:21.222313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1158/2336] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:21 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:21.225841 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-60a6d95b-d1f8-4f37-b324-74d63b76e374 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:21.226272 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-60a6d95b-d1f8-4f37-b324-74d63b76e374 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:21.227023 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-60a6d95b-d1f8-4f37-b324-74d63b76e374 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:21.227452 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-60a6d95b-d1f8-4f37-b324-74d63b76e374 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:21.365658 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-60a6d95b-d1f8-4f37-b324-74d63b76e374 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:21.378132 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-60a6d95b-d1f8-4f37-b324-74d63b76e374 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.164349 Apr 05 12:09:21.378979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1179/2337] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:21 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:21.553215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6cf53aec-f8dc-42f8-ac9e-b004a935273b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:21.554222 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6cf53aec-f8dc-42f8-ac9e-b004a935273b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:21.564490 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6cf53aec-f8dc-42f8-ac9e-b004a935273b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:21.565144 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6cf53aec-f8dc-42f8-ac9e-b004a935273b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:21.566401 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6cf53aec-f8dc-42f8-ac9e-b004a935273b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:21.567120 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6cf53aec-f8dc-42f8-ac9e-b004a935273b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:21.711114 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6cf53aec-f8dc-42f8-ac9e-b004a935273b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:21.719266 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6cf53aec-f8dc-42f8-ac9e-b004a935273b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.172602 Apr 05 12:09:21.719808 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1159/2338] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:21 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:22.226406 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4cec1355-8031-48e0-8a3b-ada362214e03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:22.227232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4cec1355-8031-48e0-8a3b-ada362214e03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:22.233978 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-845c0287-110f-40c4-bf7f-d6a4c0c4dc8f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:22.234740 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-845c0287-110f-40c4-bf7f-d6a4c0c4dc8f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:22.235851 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cec1355-8031-48e0-8a3b-ada362214e03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:22.236535 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cec1355-8031-48e0-8a3b-ada362214e03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:22.237547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cec1355-8031-48e0-8a3b-ada362214e03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:22.238128 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cec1355-8031-48e0-8a3b-ada362214e03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:22.243173 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-845c0287-110f-40c4-bf7f-d6a4c0c4dc8f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:22.243776 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-845c0287-110f-40c4-bf7f-d6a4c0c4dc8f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:22.244834 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-845c0287-110f-40c4-bf7f-d6a4c0c4dc8f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:22.245415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-845c0287-110f-40c4-bf7f-d6a4c0c4dc8f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:22.378227 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4cec1355-8031-48e0-8a3b-ada362214e03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:22.380836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-845c0287-110f-40c4-bf7f-d6a4c0c4dc8f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:22.386609 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4cec1355-8031-48e0-8a3b-ada362214e03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.166398 Apr 05 12:09:22.387183 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1180/2339] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:22 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:22.389315 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-845c0287-110f-40c4-bf7f-d6a4c0c4dc8f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:22.390932 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-845c0287-110f-40c4-bf7f-d6a4c0c4dc8f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:22.392022 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-845c0287-110f-40c4-bf7f-d6a4c0c4dc8f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.163181 Apr 05 12:09:22.392892 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1160/2340] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:22 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:22.395918 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d5d7b0d1-044c-4dc5-847e-74dc9d876886 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:22.396615 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d5d7b0d1-044c-4dc5-847e-74dc9d876886 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:22.402465 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d5d7b0d1-044c-4dc5-847e-74dc9d876886 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:22.402977 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d5d7b0d1-044c-4dc5-847e-74dc9d876886 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:22.403830 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d5d7b0d1-044c-4dc5-847e-74dc9d876886 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:22.404355 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d5d7b0d1-044c-4dc5-847e-74dc9d876886 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:22.543956 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d5d7b0d1-044c-4dc5-847e-74dc9d876886 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:22.552592 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d5d7b0d1-044c-4dc5-847e-74dc9d876886 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.160475 Apr 05 12:09:22.553170 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1181/2341] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:22 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:22.740439 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ba0f5251-01ae-43a9-80e0-5a064ba9727c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:22.741074 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ba0f5251-01ae-43a9-80e0-5a064ba9727c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:22.747557 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ba0f5251-01ae-43a9-80e0-5a064ba9727c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:22.747941 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ba0f5251-01ae-43a9-80e0-5a064ba9727c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:22.748730 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ba0f5251-01ae-43a9-80e0-5a064ba9727c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:22.749160 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ba0f5251-01ae-43a9-80e0-5a064ba9727c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:22.894585 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ba0f5251-01ae-43a9-80e0-5a064ba9727c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:22.906962 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ba0f5251-01ae-43a9-80e0-5a064ba9727c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.172278 Apr 05 12:09:22.907771 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1161/2342] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:22 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:23.415140 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c677c40c-2d72-4cfe-ba58-4c81546252e2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:23.416099 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c677c40c-2d72-4cfe-ba58-4c81546252e2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:23.416331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-150ae02d-9d1d-4410-bc20-30ad37645ace tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:23.417344 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-150ae02d-9d1d-4410-bc20-30ad37645ace tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:23.427373 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c677c40c-2d72-4cfe-ba58-4c81546252e2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:23.427543 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-150ae02d-9d1d-4410-bc20-30ad37645ace tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:23.427816 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c677c40c-2d72-4cfe-ba58-4c81546252e2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:23.427973 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-150ae02d-9d1d-4410-bc20-30ad37645ace tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:23.428610 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c677c40c-2d72-4cfe-ba58-4c81546252e2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:23.428755 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-150ae02d-9d1d-4410-bc20-30ad37645ace tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:23.429036 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c677c40c-2d72-4cfe-ba58-4c81546252e2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:23.429184 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-150ae02d-9d1d-4410-bc20-30ad37645ace tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:23.562243 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-150ae02d-9d1d-4410-bc20-30ad37645ace tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:23.562902 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c677c40c-2d72-4cfe-ba58-4c81546252e2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:23.570821 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c677c40c-2d72-4cfe-ba58-4c81546252e2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.162045 Apr 05 12:09:23.571427 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1182/2343] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:23 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:23.571571 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-150ae02d-9d1d-4410-bc20-30ad37645ace tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:23.573203 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-150ae02d-9d1d-4410-bc20-30ad37645ace tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:23.574374 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-150ae02d-9d1d-4410-bc20-30ad37645ace tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.164376 Apr 05 12:09:23.575059 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1162/2344] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:23 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:23.575949 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b6e6ea42-4d0e-4c67-a199-16fa53605005 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:23.576575 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b6e6ea42-4d0e-4c67-a199-16fa53605005 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:23.582124 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6e6ea42-4d0e-4c67-a199-16fa53605005 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:23.582562 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6e6ea42-4d0e-4c67-a199-16fa53605005 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:23.583356 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6e6ea42-4d0e-4c67-a199-16fa53605005 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:23.583776 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6e6ea42-4d0e-4c67-a199-16fa53605005 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:23.739477 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b6e6ea42-4d0e-4c67-a199-16fa53605005 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:23.747743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b6e6ea42-4d0e-4c67-a199-16fa53605005 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.175343 Apr 05 12:09:23.748387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1183/2345] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:23 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:23.929085 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-49810c1d-3870-4e7a-8d90-0a3df3e848d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:23.929891 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-49810c1d-3870-4e7a-8d90-0a3df3e848d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:23.940140 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-49810c1d-3870-4e7a-8d90-0a3df3e848d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:23.940928 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-49810c1d-3870-4e7a-8d90-0a3df3e848d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:23.942174 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-49810c1d-3870-4e7a-8d90-0a3df3e848d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:23.942887 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-49810c1d-3870-4e7a-8d90-0a3df3e848d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:24.095162 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-49810c1d-3870-4e7a-8d90-0a3df3e848d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:24.107249 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-49810c1d-3870-4e7a-8d90-0a3df3e848d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.184630 Apr 05 12:09:24.108048 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1163/2346] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:23 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:24.592196 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0676e75e-679b-4533-82b4-2dfdde06a666 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:24.593301 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0676e75e-679b-4533-82b4-2dfdde06a666 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:24.596138 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ef3ab5e6-a123-4c38-9fe6-07f2619ff36e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:24.597170 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ef3ab5e6-a123-4c38-9fe6-07f2619ff36e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:24.602475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0676e75e-679b-4533-82b4-2dfdde06a666 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:24.603055 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0676e75e-679b-4533-82b4-2dfdde06a666 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:24.603817 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0676e75e-679b-4533-82b4-2dfdde06a666 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:24.604108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef3ab5e6-a123-4c38-9fe6-07f2619ff36e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:24.604270 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0676e75e-679b-4533-82b4-2dfdde06a666 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:24.604588 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef3ab5e6-a123-4c38-9fe6-07f2619ff36e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:24.605336 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef3ab5e6-a123-4c38-9fe6-07f2619ff36e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:24.605759 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ef3ab5e6-a123-4c38-9fe6-07f2619ff36e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:24.658051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:09:24.658286 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Tue Apr 5 12:09:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d (ip 10.222.0.61) !!! Apr 05 12:09:24.737792 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ef3ab5e6-a123-4c38-9fe6-07f2619ff36e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:24.738898 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0676e75e-679b-4533-82b4-2dfdde06a666 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:24.746332 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ef3ab5e6-a123-4c38-9fe6-07f2619ff36e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:24.746852 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0676e75e-679b-4533-82b4-2dfdde06a666 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.160957 Apr 05 12:09:24.747429 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1184/2347] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:24 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:24.747803 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ef3ab5e6-a123-4c38-9fe6-07f2619ff36e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:24.748978 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ef3ab5e6-a123-4c38-9fe6-07f2619ff36e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.159387 Apr 05 12:09:24.749525 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1164/2348] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:24 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:24.765391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-324e8b06-aff2-4d22-8b71-a9bef2972a43 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:24.765998 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-324e8b06-aff2-4d22-8b71-a9bef2972a43 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:24.772106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-324e8b06-aff2-4d22-8b71-a9bef2972a43 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:24.772547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-324e8b06-aff2-4d22-8b71-a9bef2972a43 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:24.773301 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-324e8b06-aff2-4d22-8b71-a9bef2972a43 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:24.773734 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-324e8b06-aff2-4d22-8b71-a9bef2972a43 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:24.910982 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-324e8b06-aff2-4d22-8b71-a9bef2972a43 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:24.918829 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-324e8b06-aff2-4d22-8b71-a9bef2972a43 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.157065 Apr 05 12:09:24.919395 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1185/2349] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:24 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:09:25.128692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-adda244b-54f9-457e-b290-9c1b47330d0e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:25.130064 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-adda244b-54f9-457e-b290-9c1b47330d0e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:25.137973 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-adda244b-54f9-457e-b290-9c1b47330d0e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:25.138506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-adda244b-54f9-457e-b290-9c1b47330d0e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:25.139390 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-adda244b-54f9-457e-b290-9c1b47330d0e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:25.139899 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-adda244b-54f9-457e-b290-9c1b47330d0e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:25.282422 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-adda244b-54f9-457e-b290-9c1b47330d0e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:25.290218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-adda244b-54f9-457e-b290-9c1b47330d0e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.167914 Apr 05 12:09:25.290789 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1165/2350] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:25 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:25.768844 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4c12cb5f-7c42-4915-bf56-07717bf05914 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:25.769746 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4c12cb5f-7c42-4915-bf56-07717bf05914 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:25.770596 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fe0ff1f5-73be-4b95-a2f3-a592a6650642 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:25.771711 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fe0ff1f5-73be-4b95-a2f3-a592a6650642 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:25.777027 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4c12cb5f-7c42-4915-bf56-07717bf05914 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:25.777468 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4c12cb5f-7c42-4915-bf56-07717bf05914 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:25.778218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe0ff1f5-73be-4b95-a2f3-a592a6650642 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:25.778401 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4c12cb5f-7c42-4915-bf56-07717bf05914 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:25.778642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4c12cb5f-7c42-4915-bf56-07717bf05914 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:25.778818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe0ff1f5-73be-4b95-a2f3-a592a6650642 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:25.779543 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe0ff1f5-73be-4b95-a2f3-a592a6650642 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:25.780025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe0ff1f5-73be-4b95-a2f3-a592a6650642 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:25.913592 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fe0ff1f5-73be-4b95-a2f3-a592a6650642 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:25.913819 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4c12cb5f-7c42-4915-bf56-07717bf05914 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:25.921833 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4c12cb5f-7c42-4915-bf56-07717bf05914 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.159396 Apr 05 12:09:25.922435 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1186/2351] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:25 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:25.922735 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fe0ff1f5-73be-4b95-a2f3-a592a6650642 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:25.924108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fe0ff1f5-73be-4b95-a2f3-a592a6650642 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:25.925226 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fe0ff1f5-73be-4b95-a2f3-a592a6650642 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.161167 Apr 05 12:09:25.925778 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1166/2352] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:25 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:25.936217 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b1cd64fb-efb9-47b7-aa57-c9bb99ab9fb8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:25.936817 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b1cd64fb-efb9-47b7-aa57-c9bb99ab9fb8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:25.942705 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b1cd64fb-efb9-47b7-aa57-c9bb99ab9fb8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:25.943273 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b1cd64fb-efb9-47b7-aa57-c9bb99ab9fb8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:25.944033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b1cd64fb-efb9-47b7-aa57-c9bb99ab9fb8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:25.944495 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b1cd64fb-efb9-47b7-aa57-c9bb99ab9fb8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:26.074953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b1cd64fb-efb9-47b7-aa57-c9bb99ab9fb8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:26.082758 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b1cd64fb-efb9-47b7-aa57-c9bb99ab9fb8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.150436 Apr 05 12:09:26.083326 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1187/2353] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:25 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:09:26.311562 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7302347c-4fc5-4236-b406-d969ecf4765b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:26.312516 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7302347c-4fc5-4236-b406-d969ecf4765b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:26.323170 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7302347c-4fc5-4236-b406-d969ecf4765b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:26.323919 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7302347c-4fc5-4236-b406-d969ecf4765b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:26.325233 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7302347c-4fc5-4236-b406-d969ecf4765b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:26.325978 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7302347c-4fc5-4236-b406-d969ecf4765b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:26.465048 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7302347c-4fc5-4236-b406-d969ecf4765b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:26.473226 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7302347c-4fc5-4236-b406-d969ecf4765b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.168368 Apr 05 12:09:26.473792 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1167/2354] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:26 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:26.940462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-64998d9b-9c94-492c-91f9-51b14b1e17bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:26.941791 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-64998d9b-9c94-492c-91f9-51b14b1e17bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:26.943123 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3eb2c0d8-e107-4b55-87fe-06fce61dc660 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:26.944254 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3eb2c0d8-e107-4b55-87fe-06fce61dc660 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:26.948484 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-64998d9b-9c94-492c-91f9-51b14b1e17bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:26.948938 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-64998d9b-9c94-492c-91f9-51b14b1e17bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:26.949737 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-64998d9b-9c94-492c-91f9-51b14b1e17bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:26.950172 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-64998d9b-9c94-492c-91f9-51b14b1e17bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:26.950535 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3eb2c0d8-e107-4b55-87fe-06fce61dc660 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:26.951112 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3eb2c0d8-e107-4b55-87fe-06fce61dc660 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:26.952121 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3eb2c0d8-e107-4b55-87fe-06fce61dc660 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:26.952556 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3eb2c0d8-e107-4b55-87fe-06fce61dc660 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:27.090705 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3eb2c0d8-e107-4b55-87fe-06fce61dc660 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:27.092007 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-64998d9b-9c94-492c-91f9-51b14b1e17bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:27.099569 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3eb2c0d8-e107-4b55-87fe-06fce61dc660 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:27.100203 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-64998d9b-9c94-492c-91f9-51b14b1e17bb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.165062 Apr 05 12:09:27.100779 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1188/2355] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:26 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:27.101108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3eb2c0d8-e107-4b55-87fe-06fce61dc660 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:27.102283 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3eb2c0d8-e107-4b55-87fe-06fce61dc660 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.163643 Apr 05 12:09:27.105190 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0546ee5b-260c-4a31-b2b7-9e6f011de893 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:27.105784 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0546ee5b-260c-4a31-b2b7-9e6f011de893 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:27.111433 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0546ee5b-260c-4a31-b2b7-9e6f011de893 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:27.111941 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0546ee5b-260c-4a31-b2b7-9e6f011de893 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:27.112844 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0546ee5b-260c-4a31-b2b7-9e6f011de893 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:27.113254 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1168/2356] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:26 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:27.113412 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0546ee5b-260c-4a31-b2b7-9e6f011de893 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:27.244739 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0546ee5b-260c-4a31-b2b7-9e6f011de893 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:27.252503 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0546ee5b-260c-4a31-b2b7-9e6f011de893 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.150743 Apr 05 12:09:27.253081 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1189/2357] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:27 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:27.494864 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-eed0d2dd-f9ab-480f-a80f-d4b4847cfdc0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:27.495982 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-eed0d2dd-f9ab-480f-a80f-d4b4847cfdc0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:27.506501 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eed0d2dd-f9ab-480f-a80f-d4b4847cfdc0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:27.506946 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eed0d2dd-f9ab-480f-a80f-d4b4847cfdc0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:27.507704 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eed0d2dd-f9ab-480f-a80f-d4b4847cfdc0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:27.508141 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eed0d2dd-f9ab-480f-a80f-d4b4847cfdc0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:27.641784 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-eed0d2dd-f9ab-480f-a80f-d4b4847cfdc0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:27.650286 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-eed0d2dd-f9ab-480f-a80f-d4b4847cfdc0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.162100 Apr 05 12:09:27.650856 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1169/2358] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:27 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:28.121912 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ad8a9a5b-d26d-42ca-858e-ced633d3964d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:28.122988 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ad8a9a5b-d26d-42ca-858e-ced633d3964d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:28.124621 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f02fe9fc-b6f7-4cb9-889c-7f11c563bbce tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:28.125614 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f02fe9fc-b6f7-4cb9-889c-7f11c563bbce tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:28.132974 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ad8a9a5b-d26d-42ca-858e-ced633d3964d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:28.133399 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ad8a9a5b-d26d-42ca-858e-ced633d3964d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:28.134030 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f02fe9fc-b6f7-4cb9-889c-7f11c563bbce tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:28.134160 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ad8a9a5b-d26d-42ca-858e-ced633d3964d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:28.134477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f02fe9fc-b6f7-4cb9-889c-7f11c563bbce tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:28.134581 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ad8a9a5b-d26d-42ca-858e-ced633d3964d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:28.135241 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f02fe9fc-b6f7-4cb9-889c-7f11c563bbce tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:28.135668 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f02fe9fc-b6f7-4cb9-889c-7f11c563bbce tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:28.265747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ad8a9a5b-d26d-42ca-858e-ced633d3964d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:28.267668 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f02fe9fc-b6f7-4cb9-889c-7f11c563bbce tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:28.273961 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ad8a9a5b-d26d-42ca-858e-ced633d3964d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.158694 Apr 05 12:09:28.274541 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1190/2359] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:28 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:28.275880 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f02fe9fc-b6f7-4cb9-889c-7f11c563bbce tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:28.277395 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f02fe9fc-b6f7-4cb9-889c-7f11c563bbce tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:28.278546 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f02fe9fc-b6f7-4cb9-889c-7f11c563bbce tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.160620 Apr 05 12:09:28.278928 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-105de265-f011-45e9-96cb-634e41e789d0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:28.279522 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-105de265-f011-45e9-96cb-634e41e789d0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:28.280380 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1170/2360] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:28 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:28.285300 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-105de265-f011-45e9-96cb-634e41e789d0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:28.285749 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-105de265-f011-45e9-96cb-634e41e789d0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:28.286502 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-105de265-f011-45e9-96cb-634e41e789d0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:28.287034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-105de265-f011-45e9-96cb-634e41e789d0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:28.432752 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-105de265-f011-45e9-96cb-634e41e789d0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:28.441993 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-105de265-f011-45e9-96cb-634e41e789d0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.166451 Apr 05 12:09:28.442658 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1191/2361] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:28 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:28.667290 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cd41c4d5-f3b6-4783-851f-1944123a5121 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:28.667983 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cd41c4d5-f3b6-4783-851f-1944123a5121 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:28.674819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd41c4d5-f3b6-4783-851f-1944123a5121 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:28.675273 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd41c4d5-f3b6-4783-851f-1944123a5121 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:28.676035 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd41c4d5-f3b6-4783-851f-1944123a5121 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:28.676516 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd41c4d5-f3b6-4783-851f-1944123a5121 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:28.830136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-cd41c4d5-f3b6-4783-851f-1944123a5121 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:28.838662 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cd41c4d5-f3b6-4783-851f-1944123a5121 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.175183 Apr 05 12:09:28.839236 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1171/2362] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:28 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:29.295487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5639c168-5c31-4a75-8845-c1647c80cd39 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:29.296474 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5639c168-5c31-4a75-8845-c1647c80cd39 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:29.301048 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-abca3382-5d54-4df5-b031-fbb300c57c30 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:29.301904 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-abca3382-5d54-4df5-b031-fbb300c57c30 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:29.305648 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5639c168-5c31-4a75-8845-c1647c80cd39 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:29.306107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5639c168-5c31-4a75-8845-c1647c80cd39 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:29.306876 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5639c168-5c31-4a75-8845-c1647c80cd39 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:29.307296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5639c168-5c31-4a75-8845-c1647c80cd39 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:29.308570 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-abca3382-5d54-4df5-b031-fbb300c57c30 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:29.309017 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-abca3382-5d54-4df5-b031-fbb300c57c30 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:29.309774 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-abca3382-5d54-4df5-b031-fbb300c57c30 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:29.310200 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-abca3382-5d54-4df5-b031-fbb300c57c30 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:29.443183 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-abca3382-5d54-4df5-b031-fbb300c57c30 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:29.445777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5639c168-5c31-4a75-8845-c1647c80cd39 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:29.453204 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-abca3382-5d54-4df5-b031-fbb300c57c30 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:29.454665 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5639c168-5c31-4a75-8845-c1647c80cd39 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.165646 Apr 05 12:09:29.454830 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-abca3382-5d54-4df5-b031-fbb300c57c30 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:29.455231 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1192/2363] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:29 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:29.455809 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-abca3382-5d54-4df5-b031-fbb300c57c30 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.161719 Apr 05 12:09:29.456384 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1172/2364] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:29 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:29.459872 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f14aedf4-2387-40f4-86e5-c88b54a5a511 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:29.460499 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f14aedf4-2387-40f4-86e5-c88b54a5a511 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:29.466655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f14aedf4-2387-40f4-86e5-c88b54a5a511 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:29.467107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f14aedf4-2387-40f4-86e5-c88b54a5a511 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:29.467866 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f14aedf4-2387-40f4-86e5-c88b54a5a511 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:29.468326 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f14aedf4-2387-40f4-86e5-c88b54a5a511 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:29.611409 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f14aedf4-2387-40f4-86e5-c88b54a5a511 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:29.619730 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f14aedf4-2387-40f4-86e5-c88b54a5a511 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.163540 Apr 05 12:09:29.620327 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1193/2365] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:29 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:29.860032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0977c8a9-9e7e-4d03-bef4-229bc15b1ffc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:29.861096 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0977c8a9-9e7e-4d03-bef4-229bc15b1ffc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:29.871883 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0977c8a9-9e7e-4d03-bef4-229bc15b1ffc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:29.872765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0977c8a9-9e7e-4d03-bef4-229bc15b1ffc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:29.874067 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0977c8a9-9e7e-4d03-bef4-229bc15b1ffc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:29.874847 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0977c8a9-9e7e-4d03-bef4-229bc15b1ffc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:30.015211 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0977c8a9-9e7e-4d03-bef4-229bc15b1ffc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:30.023795 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0977c8a9-9e7e-4d03-bef4-229bc15b1ffc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.170300 Apr 05 12:09:30.024415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1173/2366] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:29 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:30.475501 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7bc7a8ec-3035-4437-a5a7-ba2d68051bc2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:30.476127 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7bc7a8ec-3035-4437-a5a7-ba2d68051bc2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:30.476850 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3090319d-fd87-4c83-9e34-2b09de6fd993 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:30.477461 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3090319d-fd87-4c83-9e34-2b09de6fd993 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:30.482911 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7bc7a8ec-3035-4437-a5a7-ba2d68051bc2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:30.483358 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7bc7a8ec-3035-4437-a5a7-ba2d68051bc2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:30.484143 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7bc7a8ec-3035-4437-a5a7-ba2d68051bc2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:30.484599 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7bc7a8ec-3035-4437-a5a7-ba2d68051bc2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:30.484874 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3090319d-fd87-4c83-9e34-2b09de6fd993 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:30.485552 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3090319d-fd87-4c83-9e34-2b09de6fd993 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:30.486733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3090319d-fd87-4c83-9e34-2b09de6fd993 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:30.488710 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3090319d-fd87-4c83-9e34-2b09de6fd993 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:30.619077 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7bc7a8ec-3035-4437-a5a7-ba2d68051bc2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:30.619632 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3090319d-fd87-4c83-9e34-2b09de6fd993 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:30.627473 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7bc7a8ec-3035-4437-a5a7-ba2d68051bc2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.157850 Apr 05 12:09:30.627712 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3090319d-fd87-4c83-9e34-2b09de6fd993 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:30.628048 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1194/2367] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:30 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:30.629222 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3090319d-fd87-4c83-9e34-2b09de6fd993 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:30.630794 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3090319d-fd87-4c83-9e34-2b09de6fd993 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.160051 Apr 05 12:09:30.631496 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1174/2368] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:30 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:30.636414 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6c264d7d-de8a-4aa1-a531-9034d66bb4c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:30.637128 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6c264d7d-de8a-4aa1-a531-9034d66bb4c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:30.643031 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6c264d7d-de8a-4aa1-a531-9034d66bb4c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:30.643450 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6c264d7d-de8a-4aa1-a531-9034d66bb4c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:30.644234 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6c264d7d-de8a-4aa1-a531-9034d66bb4c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:30.644666 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6c264d7d-de8a-4aa1-a531-9034d66bb4c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:30.775894 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6c264d7d-de8a-4aa1-a531-9034d66bb4c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:30.784572 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6c264d7d-de8a-4aa1-a531-9034d66bb4c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.151598 Apr 05 12:09:30.785164 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1195/2369] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:30 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:31.045100 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a119d415-4a95-423b-9d16-e25b8128db72 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:31.046104 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a119d415-4a95-423b-9d16-e25b8128db72 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:31.055321 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a119d415-4a95-423b-9d16-e25b8128db72 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:31.055769 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a119d415-4a95-423b-9d16-e25b8128db72 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:31.056573 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a119d415-4a95-423b-9d16-e25b8128db72 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:31.057089 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a119d415-4a95-423b-9d16-e25b8128db72 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:31.195157 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a119d415-4a95-423b-9d16-e25b8128db72 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:31.202969 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a119d415-4a95-423b-9d16-e25b8128db72 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.164366 Apr 05 12:09:31.203542 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1175/2370] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:31 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:31.649043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1a097e38-81d3-4790-b98c-eda6306509f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:31.649851 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1a097e38-81d3-4790-b98c-eda6306509f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:31.651901 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8d67ac85-477d-4c25-978e-92e893bb4fd7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:31.652762 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8d67ac85-477d-4c25-978e-92e893bb4fd7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:31.658404 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a097e38-81d3-4790-b98c-eda6306509f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:31.658999 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a097e38-81d3-4790-b98c-eda6306509f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:31.660004 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a097e38-81d3-4790-b98c-eda6306509f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:31.660557 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8d67ac85-477d-4c25-978e-92e893bb4fd7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:31.660775 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a097e38-81d3-4790-b98c-eda6306509f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:31.661155 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8d67ac85-477d-4c25-978e-92e893bb4fd7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:31.662146 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8d67ac85-477d-4c25-978e-92e893bb4fd7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:31.662810 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8d67ac85-477d-4c25-978e-92e893bb4fd7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:31.797614 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8d67ac85-477d-4c25-978e-92e893bb4fd7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:31.798622 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1a097e38-81d3-4790-b98c-eda6306509f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:31.806625 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1a097e38-81d3-4790-b98c-eda6306509f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.163633 Apr 05 12:09:31.807210 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1196/2371] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:31 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:31.811552 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ba59a829-2d2c-458a-b5ea-d162935d37d7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:31.812166 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ba59a829-2d2c-458a-b5ea-d162935d37d7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:31.813742 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8d67ac85-477d-4c25-978e-92e893bb4fd7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:31.815227 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8d67ac85-477d-4c25-978e-92e893bb4fd7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:31.816412 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8d67ac85-477d-4c25-978e-92e893bb4fd7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.169629 Apr 05 12:09:31.816962 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1176/2372] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:31 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:31.817731 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ba59a829-2d2c-458a-b5ea-d162935d37d7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:31.818213 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ba59a829-2d2c-458a-b5ea-d162935d37d7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:31.818966 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ba59a829-2d2c-458a-b5ea-d162935d37d7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:31.819392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ba59a829-2d2c-458a-b5ea-d162935d37d7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:31.951965 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ba59a829-2d2c-458a-b5ea-d162935d37d7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:31.960458 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ba59a829-2d2c-458a-b5ea-d162935d37d7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.152249 Apr 05 12:09:31.961007 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1197/2373] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:31 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:32.223868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-29492ade-560e-418e-bd1e-ab12e99e3515 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:32.224914 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-29492ade-560e-418e-bd1e-ab12e99e3515 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:32.235522 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-29492ade-560e-418e-bd1e-ab12e99e3515 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:32.236310 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-29492ade-560e-418e-bd1e-ab12e99e3515 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:32.237673 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-29492ade-560e-418e-bd1e-ab12e99e3515 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:32.238287 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-29492ade-560e-418e-bd1e-ab12e99e3515 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:32.388959 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-29492ade-560e-418e-bd1e-ab12e99e3515 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:32.397281 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-29492ade-560e-418e-bd1e-ab12e99e3515 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.180000 Apr 05 12:09:32.397823 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1177/2374] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:32 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:32.824394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3d2c2322-7def-4d17-9210-13d529f5cbe9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:32.825113 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3d2c2322-7def-4d17-9210-13d529f5cbe9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:32.832861 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3d2c2322-7def-4d17-9210-13d529f5cbe9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:32.833429 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3d2c2322-7def-4d17-9210-13d529f5cbe9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:32.834313 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3d2c2322-7def-4d17-9210-13d529f5cbe9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:32.834820 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3d2c2322-7def-4d17-9210-13d529f5cbe9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:32.835658 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f8d6d8c8-0fea-4a77-a0ad-05a12c654724 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:32.836612 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f8d6d8c8-0fea-4a77-a0ad-05a12c654724 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:32.843963 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f8d6d8c8-0fea-4a77-a0ad-05a12c654724 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:32.844580 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f8d6d8c8-0fea-4a77-a0ad-05a12c654724 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:32.845405 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f8d6d8c8-0fea-4a77-a0ad-05a12c654724 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:32.845908 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f8d6d8c8-0fea-4a77-a0ad-05a12c654724 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:32.976803 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3d2c2322-7def-4d17-9210-13d529f5cbe9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:32.977039 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f8d6d8c8-0fea-4a77-a0ad-05a12c654724 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:32.985215 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3d2c2322-7def-4d17-9210-13d529f5cbe9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.165296 Apr 05 12:09:32.985410 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f8d6d8c8-0fea-4a77-a0ad-05a12c654724 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:32.985763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1198/2375] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:32 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:32.987070 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f8d6d8c8-0fea-4a77-a0ad-05a12c654724 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:32.988319 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f8d6d8c8-0fea-4a77-a0ad-05a12c654724 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.157474 Apr 05 12:09:32.988833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1178/2376] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:32 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:09:32.990746 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a9d77aad-f047-4cae-bd10-8ac5b3ef6fc2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:32.991349 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a9d77aad-f047-4cae-bd10-8ac5b3ef6fc2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:32.997231 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a9d77aad-f047-4cae-bd10-8ac5b3ef6fc2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:32.997683 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a9d77aad-f047-4cae-bd10-8ac5b3ef6fc2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:32.998444 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a9d77aad-f047-4cae-bd10-8ac5b3ef6fc2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:32.998881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a9d77aad-f047-4cae-bd10-8ac5b3ef6fc2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:33.136888 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a9d77aad-f047-4cae-bd10-8ac5b3ef6fc2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:33.145253 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a9d77aad-f047-4cae-bd10-8ac5b3ef6fc2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.158357 Apr 05 12:09:33.145824 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1199/2377] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:32 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:33.417993 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0cc87783-15e7-4041-a2f1-b25e287784dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:33.418940 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0cc87783-15e7-4041-a2f1-b25e287784dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:33.429547 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0cc87783-15e7-4041-a2f1-b25e287784dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:33.430351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0cc87783-15e7-4041-a2f1-b25e287784dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:33.431607 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0cc87783-15e7-4041-a2f1-b25e287784dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:33.432383 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0cc87783-15e7-4041-a2f1-b25e287784dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:33.572357 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0cc87783-15e7-4041-a2f1-b25e287784dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:33.584243 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0cc87783-15e7-4041-a2f1-b25e287784dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.172673 Apr 05 12:09:33.585014 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1179/2378] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:33 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:34.006296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a4798a26-4422-4b6d-b14f-6c65aa4ac609 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:34.007302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a4798a26-4422-4b6d-b14f-6c65aa4ac609 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:34.010188 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f3e6bbc5-69c9-4c5e-aa00-11ec8007607f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:34.011195 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f3e6bbc5-69c9-4c5e-aa00-11ec8007607f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:34.017802 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a4798a26-4422-4b6d-b14f-6c65aa4ac609 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:34.018523 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a4798a26-4422-4b6d-b14f-6c65aa4ac609 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:34.019804 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a4798a26-4422-4b6d-b14f-6c65aa4ac609 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:34.020576 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a4798a26-4422-4b6d-b14f-6c65aa4ac609 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:34.021311 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f3e6bbc5-69c9-4c5e-aa00-11ec8007607f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:34.021809 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f3e6bbc5-69c9-4c5e-aa00-11ec8007607f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:34.022566 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f3e6bbc5-69c9-4c5e-aa00-11ec8007607f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:34.022967 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f3e6bbc5-69c9-4c5e-aa00-11ec8007607f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:34.156807 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a4798a26-4422-4b6d-b14f-6c65aa4ac609 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:34.157834 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f3e6bbc5-69c9-4c5e-aa00-11ec8007607f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:34.165062 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a4798a26-4422-4b6d-b14f-6c65aa4ac609 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.165646 Apr 05 12:09:34.165647 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1200/2379] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:33 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:34.166191 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f3e6bbc5-69c9-4c5e-aa00-11ec8007607f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:34.167757 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f3e6bbc5-69c9-4c5e-aa00-11ec8007607f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:34.168945 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f3e6bbc5-69c9-4c5e-aa00-11ec8007607f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.165710 Apr 05 12:09:34.169644 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1180/2380] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:34 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:34.170018 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-55f495cb-29d9-4fef-976f-492ec4324084 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:34.170627 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-55f495cb-29d9-4fef-976f-492ec4324084 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:34.176236 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-55f495cb-29d9-4fef-976f-492ec4324084 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:34.176682 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-55f495cb-29d9-4fef-976f-492ec4324084 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:34.177435 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-55f495cb-29d9-4fef-976f-492ec4324084 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:34.177866 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-55f495cb-29d9-4fef-976f-492ec4324084 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:34.310949 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-55f495cb-29d9-4fef-976f-492ec4324084 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:34.318850 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-55f495cb-29d9-4fef-976f-492ec4324084 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.152239 Apr 05 12:09:34.319443 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1201/2381] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:34 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:34.611458 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d29cf1fa-4ab6-48a9-aaa2-f2ebc12ac87e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:34.612517 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d29cf1fa-4ab6-48a9-aaa2-f2ebc12ac87e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:34.620387 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d29cf1fa-4ab6-48a9-aaa2-f2ebc12ac87e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:34.620858 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d29cf1fa-4ab6-48a9-aaa2-f2ebc12ac87e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:34.621657 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d29cf1fa-4ab6-48a9-aaa2-f2ebc12ac87e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:34.622113 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d29cf1fa-4ab6-48a9-aaa2-f2ebc12ac87e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:34.768438 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d29cf1fa-4ab6-48a9-aaa2-f2ebc12ac87e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:34.776447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d29cf1fa-4ab6-48a9-aaa2-f2ebc12ac87e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.171366 Apr 05 12:09:34.776994 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1181/2382] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:34 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:35.186089 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9fd61666-4545-445b-ab51-294f394f9208 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:35.187103 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9fd61666-4545-445b-ab51-294f394f9208 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:35.192827 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-02d736eb-fb73-4028-becb-70a80b87690c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:35.193614 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-02d736eb-fb73-4028-becb-70a80b87690c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:35.196197 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fd61666-4545-445b-ab51-294f394f9208 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:35.196648 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fd61666-4545-445b-ab51-294f394f9208 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:35.199046 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fd61666-4545-445b-ab51-294f394f9208 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:35.199471 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fd61666-4545-445b-ab51-294f394f9208 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:35.199685 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02d736eb-fb73-4028-becb-70a80b87690c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:35.200169 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02d736eb-fb73-4028-becb-70a80b87690c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:35.200934 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02d736eb-fb73-4028-becb-70a80b87690c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:35.201384 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02d736eb-fb73-4028-becb-70a80b87690c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:35.337538 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9fd61666-4545-445b-ab51-294f394f9208 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:35.338435 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-02d736eb-fb73-4028-becb-70a80b87690c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:35.345349 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9fd61666-4545-445b-ab51-294f394f9208 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.165764 Apr 05 12:09:35.345924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1202/2383] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:35 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:35.346636 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-02d736eb-fb73-4028-becb-70a80b87690c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:35.348166 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-02d736eb-fb73-4028-becb-70a80b87690c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:35.349323 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-02d736eb-fb73-4028-becb-70a80b87690c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.163358 Apr 05 12:09:35.350032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1182/2384] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:35 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:35.350454 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-85ec21fe-1f90-4e39-bad5-c76b80aa454f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:35.351121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-85ec21fe-1f90-4e39-bad5-c76b80aa454f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:35.356795 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-85ec21fe-1f90-4e39-bad5-c76b80aa454f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:35.357237 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-85ec21fe-1f90-4e39-bad5-c76b80aa454f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:35.357989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-85ec21fe-1f90-4e39-bad5-c76b80aa454f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:35.358420 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-85ec21fe-1f90-4e39-bad5-c76b80aa454f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:35.503028 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-85ec21fe-1f90-4e39-bad5-c76b80aa454f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:35.516234 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-85ec21fe-1f90-4e39-bad5-c76b80aa454f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.169100 Apr 05 12:09:35.517229 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1203/2385] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:35 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:35.798128 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-42a899bc-989a-463d-a639-fe5eb273862b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:35.799220 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-42a899bc-989a-463d-a639-fe5eb273862b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:35.809747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-42a899bc-989a-463d-a639-fe5eb273862b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:35.810494 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-42a899bc-989a-463d-a639-fe5eb273862b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:35.811744 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-42a899bc-989a-463d-a639-fe5eb273862b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:35.812526 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-42a899bc-989a-463d-a639-fe5eb273862b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:35.955605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-42a899bc-989a-463d-a639-fe5eb273862b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:35.963563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-42a899bc-989a-463d-a639-fe5eb273862b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.172021 Apr 05 12:09:35.964131 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1183/2386] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:35 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:36.366874 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3f37a77b-27cc-4a71-bce0-9b370b024504 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:36.367860 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3f37a77b-27cc-4a71-bce0-9b370b024504 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:36.370493 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-40bc7c9f-fda1-4f92-9b82-f57b8a3fa073 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:36.371491 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-40bc7c9f-fda1-4f92-9b82-f57b8a3fa073 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:36.378126 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f37a77b-27cc-4a71-bce0-9b370b024504 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:36.379075 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f37a77b-27cc-4a71-bce0-9b370b024504 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:36.380669 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f37a77b-27cc-4a71-bce0-9b370b024504 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:36.381099 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f37a77b-27cc-4a71-bce0-9b370b024504 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:36.381245 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-40bc7c9f-fda1-4f92-9b82-f57b8a3fa073 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:36.381685 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-40bc7c9f-fda1-4f92-9b82-f57b8a3fa073 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:36.382447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-40bc7c9f-fda1-4f92-9b82-f57b8a3fa073 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:36.382879 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-40bc7c9f-fda1-4f92-9b82-f57b8a3fa073 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:36.519294 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-40bc7c9f-fda1-4f92-9b82-f57b8a3fa073 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:36.519467 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3f37a77b-27cc-4a71-bce0-9b370b024504 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:36.529662 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-40bc7c9f-fda1-4f92-9b82-f57b8a3fa073 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:36.529944 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3f37a77b-27cc-4a71-bce0-9b370b024504 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.169738 Apr 05 12:09:36.530600 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1204/2387] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:36 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:36.531211 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-40bc7c9f-fda1-4f92-9b82-f57b8a3fa073 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:36.532410 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-40bc7c9f-fda1-4f92-9b82-f57b8a3fa073 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.168361 Apr 05 12:09:36.533174 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1184/2388] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:36 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:36.535857 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6951594c-a8e2-44aa-8007-eacb64227a5a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:36.536929 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6951594c-a8e2-44aa-8007-eacb64227a5a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:36.543299 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6951594c-a8e2-44aa-8007-eacb64227a5a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:36.543736 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6951594c-a8e2-44aa-8007-eacb64227a5a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:36.544517 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6951594c-a8e2-44aa-8007-eacb64227a5a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:36.544942 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6951594c-a8e2-44aa-8007-eacb64227a5a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:36.682248 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6951594c-a8e2-44aa-8007-eacb64227a5a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:36.690367 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6951594c-a8e2-44aa-8007-eacb64227a5a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.158719 Apr 05 12:09:36.691148 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1205/2389] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:36 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:36.985130 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fca6e3c0-56ef-4b78-b6e3-2284644d1f38 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:36.986126 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fca6e3c0-56ef-4b78-b6e3-2284644d1f38 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:36.994262 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fca6e3c0-56ef-4b78-b6e3-2284644d1f38 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:36.994711 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fca6e3c0-56ef-4b78-b6e3-2284644d1f38 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:36.995464 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fca6e3c0-56ef-4b78-b6e3-2284644d1f38 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:36.995896 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fca6e3c0-56ef-4b78-b6e3-2284644d1f38 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:37.104534 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:09:37.104717 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Tue Apr 5 12:09:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:09:37.137692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fca6e3c0-56ef-4b78-b6e3-2284644d1f38 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:37.145884 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fca6e3c0-56ef-4b78-b6e3-2284644d1f38 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.167436 Apr 05 12:09:37.146490 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1185/2390] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:36 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:37.551764 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-68bd65e1-48f5-4d05-944b-5f3fe5233ace tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:37.552885 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-68bd65e1-48f5-4d05-944b-5f3fe5233ace tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:37.553790 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-64caad94-ceed-4457-ae4d-7f7d076d27b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:37.554392 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-64caad94-ceed-4457-ae4d-7f7d076d27b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:37.559606 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-68bd65e1-48f5-4d05-944b-5f3fe5233ace tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:37.560053 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-68bd65e1-48f5-4d05-944b-5f3fe5233ace tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:37.560576 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64caad94-ceed-4457-ae4d-7f7d076d27b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:37.560839 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-68bd65e1-48f5-4d05-944b-5f3fe5233ace tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:37.560985 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64caad94-ceed-4457-ae4d-7f7d076d27b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:37.561281 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-68bd65e1-48f5-4d05-944b-5f3fe5233ace tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:37.561760 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64caad94-ceed-4457-ae4d-7f7d076d27b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:37.562186 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64caad94-ceed-4457-ae4d-7f7d076d27b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:37.692096 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-68bd65e1-48f5-4d05-944b-5f3fe5233ace tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:37.693074 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-64caad94-ceed-4457-ae4d-7f7d076d27b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:37.699957 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-68bd65e1-48f5-4d05-944b-5f3fe5233ace tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.154634 Apr 05 12:09:37.701245 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-64caad94-ceed-4457-ae4d-7f7d076d27b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:37.702943 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-64caad94-ceed-4457-ae4d-7f7d076d27b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:37.704350 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-64caad94-ceed-4457-ae4d-7f7d076d27b6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.157068 Apr 05 12:09:37.704903 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1186/2391] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:37 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:37.709679 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-89768cfd-f305-4bde-bdba-98c3da0f26c7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:37.710251 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1206/2392] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:37 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:37.710785 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-89768cfd-f305-4bde-bdba-98c3da0f26c7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:37.717165 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-89768cfd-f305-4bde-bdba-98c3da0f26c7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:37.717608 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-89768cfd-f305-4bde-bdba-98c3da0f26c7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:37.718399 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-89768cfd-f305-4bde-bdba-98c3da0f26c7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:37.718852 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-89768cfd-f305-4bde-bdba-98c3da0f26c7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:37.860710 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-89768cfd-f305-4bde-bdba-98c3da0f26c7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:37.870449 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-89768cfd-f305-4bde-bdba-98c3da0f26c7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.164427 Apr 05 12:09:37.871054 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1187/2393] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:37 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:38.164120 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0b3a0cce-30ac-49d1-a812-d29a100ddb74 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:38.164120 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0b3a0cce-30ac-49d1-a812-d29a100ddb74 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:38.170371 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0b3a0cce-30ac-49d1-a812-d29a100ddb74 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:38.170823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0b3a0cce-30ac-49d1-a812-d29a100ddb74 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:38.171584 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0b3a0cce-30ac-49d1-a812-d29a100ddb74 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:38.172019 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0b3a0cce-30ac-49d1-a812-d29a100ddb74 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:38.326199 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0b3a0cce-30ac-49d1-a812-d29a100ddb74 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:38.337498 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0b3a0cce-30ac-49d1-a812-d29a100ddb74 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.178329 Apr 05 12:09:38.338074 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1207/2394] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:38 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:38.721734 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7f73ed82-8db0-4349-aa23-a3f47c7f50e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:38.722696 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7f73ed82-8db0-4349-aa23-a3f47c7f50e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:38.726345 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ca270e38-5569-4a97-9f5c-12cbafab361f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:38.726946 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ca270e38-5569-4a97-9f5c-12cbafab361f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:38.730584 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f73ed82-8db0-4349-aa23-a3f47c7f50e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:38.731032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f73ed82-8db0-4349-aa23-a3f47c7f50e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:38.731797 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f73ed82-8db0-4349-aa23-a3f47c7f50e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:38.732341 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f73ed82-8db0-4349-aa23-a3f47c7f50e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:38.734100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ca270e38-5569-4a97-9f5c-12cbafab361f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:38.734661 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ca270e38-5569-4a97-9f5c-12cbafab361f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:38.735291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ca270e38-5569-4a97-9f5c-12cbafab361f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:38.735869 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ca270e38-5569-4a97-9f5c-12cbafab361f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:38.864053 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7f73ed82-8db0-4349-aa23-a3f47c7f50e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:38.866660 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ca270e38-5569-4a97-9f5c-12cbafab361f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:38.872415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7f73ed82-8db0-4349-aa23-a3f47c7f50e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.157083 Apr 05 12:09:38.873005 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1188/2395] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:38 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:38.874725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ca270e38-5569-4a97-9f5c-12cbafab361f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:38.876227 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ca270e38-5569-4a97-9f5c-12cbafab361f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:38.877383 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ca270e38-5569-4a97-9f5c-12cbafab361f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.157232 Apr 05 12:09:38.877922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1208/2396] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:38 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:38.887839 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3a6e1630-9089-4108-bdb6-e1a96ccb2fdf tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:38.888613 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3a6e1630-9089-4108-bdb6-e1a96ccb2fdf tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:38.894408 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3a6e1630-9089-4108-bdb6-e1a96ccb2fdf tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:38.894852 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3a6e1630-9089-4108-bdb6-e1a96ccb2fdf tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:38.895602 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3a6e1630-9089-4108-bdb6-e1a96ccb2fdf tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:38.896034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3a6e1630-9089-4108-bdb6-e1a96ccb2fdf tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:39.036020 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3a6e1630-9089-4108-bdb6-e1a96ccb2fdf tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:39.048180 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3a6e1630-9089-4108-bdb6-e1a96ccb2fdf tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.163706 Apr 05 12:09:39.048878 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1189/2397] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:38 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:09:39.358958 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-26abc885-5dfd-412b-9970-93d25914cd26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:39.360034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-26abc885-5dfd-412b-9970-93d25914cd26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:39.370284 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-26abc885-5dfd-412b-9970-93d25914cd26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:39.371013 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-26abc885-5dfd-412b-9970-93d25914cd26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:39.372314 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-26abc885-5dfd-412b-9970-93d25914cd26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:39.373023 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-26abc885-5dfd-412b-9970-93d25914cd26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:39.514885 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-26abc885-5dfd-412b-9970-93d25914cd26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:39.523563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-26abc885-5dfd-412b-9970-93d25914cd26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.171037 Apr 05 12:09:39.524182 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1209/2398] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:39 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:39.894911 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-016fc742-6d18-4d00-805a-cb4e7c257aa7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:39.895777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-016fc742-6d18-4d00-805a-cb4e7c257aa7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:39.898685 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e9e9ba28-52de-44d2-b607-cb91d69730c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:39.899283 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e9e9ba28-52de-44d2-b607-cb91d69730c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:39.902786 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-016fc742-6d18-4d00-805a-cb4e7c257aa7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:39.903236 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-016fc742-6d18-4d00-805a-cb4e7c257aa7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:39.904040 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-016fc742-6d18-4d00-805a-cb4e7c257aa7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:39.905100 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-016fc742-6d18-4d00-805a-cb4e7c257aa7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:39.906121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e9e9ba28-52de-44d2-b607-cb91d69730c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:39.906547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e9e9ba28-52de-44d2-b607-cb91d69730c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:39.907310 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e9e9ba28-52de-44d2-b607-cb91d69730c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:39.907755 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e9e9ba28-52de-44d2-b607-cb91d69730c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:40.039033 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-016fc742-6d18-4d00-805a-cb4e7c257aa7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:40.042904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e9e9ba28-52de-44d2-b607-cb91d69730c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:40.046852 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-016fc742-6d18-4d00-805a-cb4e7c257aa7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.158758 Apr 05 12:09:40.047430 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1190/2399] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:39 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:40.050998 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e9e9ba28-52de-44d2-b607-cb91d69730c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:40.052522 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e9e9ba28-52de-44d2-b607-cb91d69730c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:40.053730 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e9e9ba28-52de-44d2-b607-cb91d69730c2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.160290 Apr 05 12:09:40.054270 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1210/2400] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:39 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:40.066494 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7780e68f-54b6-45e4-96e9-102c8f6ceaaf tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:40.067102 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7780e68f-54b6-45e4-96e9-102c8f6ceaaf tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:40.073280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7780e68f-54b6-45e4-96e9-102c8f6ceaaf tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:40.073846 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7780e68f-54b6-45e4-96e9-102c8f6ceaaf tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:40.074770 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7780e68f-54b6-45e4-96e9-102c8f6ceaaf tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:40.075409 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7780e68f-54b6-45e4-96e9-102c8f6ceaaf tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:40.217211 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7780e68f-54b6-45e4-96e9-102c8f6ceaaf tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:40.225874 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7780e68f-54b6-45e4-96e9-102c8f6ceaaf tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.163100 Apr 05 12:09:40.226458 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1191/2401] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:40 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:09:40.545037 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7105037c-8572-4935-8c0e-744720ef0be6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:40.546091 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7105037c-8572-4935-8c0e-744720ef0be6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:40.555070 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7105037c-8572-4935-8c0e-744720ef0be6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:40.555513 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7105037c-8572-4935-8c0e-744720ef0be6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:40.556395 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7105037c-8572-4935-8c0e-744720ef0be6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:40.556819 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7105037c-8572-4935-8c0e-744720ef0be6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:40.692809 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7105037c-8572-4935-8c0e-744720ef0be6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:40.703978 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7105037c-8572-4935-8c0e-744720ef0be6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.165303 Apr 05 12:09:40.704793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1211/2402] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:40 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:41.068636 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5a63c908-ecbe-4a42-bad9-b2c1949f3388 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:41.069781 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5a63c908-ecbe-4a42-bad9-b2c1949f3388 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:41.073790 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-956c289a-b424-4df4-87cd-4932af9b8466 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:41.074446 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-956c289a-b424-4df4-87cd-4932af9b8466 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:41.076952 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5a63c908-ecbe-4a42-bad9-b2c1949f3388 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:41.077423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5a63c908-ecbe-4a42-bad9-b2c1949f3388 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:41.078215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5a63c908-ecbe-4a42-bad9-b2c1949f3388 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:41.078668 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5a63c908-ecbe-4a42-bad9-b2c1949f3388 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:41.081156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-956c289a-b424-4df4-87cd-4932af9b8466 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:41.081629 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-956c289a-b424-4df4-87cd-4932af9b8466 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:41.082430 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-956c289a-b424-4df4-87cd-4932af9b8466 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:41.082891 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-956c289a-b424-4df4-87cd-4932af9b8466 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:41.221991 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-956c289a-b424-4df4-87cd-4932af9b8466 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:41.225200 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5a63c908-ecbe-4a42-bad9-b2c1949f3388 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:41.230580 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-956c289a-b424-4df4-87cd-4932af9b8466 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:41.232058 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-956c289a-b424-4df4-87cd-4932af9b8466 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:41.233042 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5a63c908-ecbe-4a42-bad9-b2c1949f3388 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.171275 Apr 05 12:09:41.233189 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-956c289a-b424-4df4-87cd-4932af9b8466 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.164037 Apr 05 12:09:41.233605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1192/2403] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:41 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:41.233734 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1212/2404] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:41 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:41.242406 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8d49bdbd-c537-4412-892f-52384ce50ce4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:41.243018 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8d49bdbd-c537-4412-892f-52384ce50ce4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:41.248976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8d49bdbd-c537-4412-892f-52384ce50ce4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:41.249427 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8d49bdbd-c537-4412-892f-52384ce50ce4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:41.250179 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8d49bdbd-c537-4412-892f-52384ce50ce4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:41.250647 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8d49bdbd-c537-4412-892f-52384ce50ce4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:41.383764 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8d49bdbd-c537-4412-892f-52384ce50ce4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:41.392195 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8d49bdbd-c537-4412-892f-52384ce50ce4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.153301 Apr 05 12:09:41.392771 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1193/2405] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:41 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:09:41.726850 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-41d93683-a1ce-45c7-ba9f-f6cea2041e09 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:41.728062 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-41d93683-a1ce-45c7-ba9f-f6cea2041e09 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:41.738832 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-41d93683-a1ce-45c7-ba9f-f6cea2041e09 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:41.739623 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-41d93683-a1ce-45c7-ba9f-f6cea2041e09 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:41.740916 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-41d93683-a1ce-45c7-ba9f-f6cea2041e09 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:41.741629 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-41d93683-a1ce-45c7-ba9f-f6cea2041e09 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:41.880357 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-41d93683-a1ce-45c7-ba9f-f6cea2041e09 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:41.888876 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-41d93683-a1ce-45c7-ba9f-f6cea2041e09 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.168625 Apr 05 12:09:41.889462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1213/2406] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:41 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:42.253285 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e3016b27-f791-4270-9e85-ac9676b297a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:42.253908 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-030f3d84-de1d-4ceb-91d4-ebb123d3cc40 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:42.254275 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e3016b27-f791-4270-9e85-ac9676b297a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:42.254381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-030f3d84-de1d-4ceb-91d4-ebb123d3cc40 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:42.262109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e3016b27-f791-4270-9e85-ac9676b297a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:42.262329 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-030f3d84-de1d-4ceb-91d4-ebb123d3cc40 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:42.262638 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e3016b27-f791-4270-9e85-ac9676b297a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:42.262811 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-030f3d84-de1d-4ceb-91d4-ebb123d3cc40 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:42.263978 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-030f3d84-de1d-4ceb-91d4-ebb123d3cc40 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:42.264166 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e3016b27-f791-4270-9e85-ac9676b297a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:42.264432 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-030f3d84-de1d-4ceb-91d4-ebb123d3cc40 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:42.264568 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e3016b27-f791-4270-9e85-ac9676b297a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:42.403255 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-030f3d84-de1d-4ceb-91d4-ebb123d3cc40 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:42.404780 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e3016b27-f791-4270-9e85-ac9676b297a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:42.411831 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-030f3d84-de1d-4ceb-91d4-ebb123d3cc40 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:42.412604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e3016b27-f791-4270-9e85-ac9676b297a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.165231 Apr 05 12:09:42.413179 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1194/2407] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:42 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:42.413455 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-030f3d84-de1d-4ceb-91d4-ebb123d3cc40 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:42.414774 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-030f3d84-de1d-4ceb-91d4-ebb123d3cc40 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.167038 Apr 05 12:09:42.416120 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1214/2408] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:42 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:42.417862 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6862c2f2-68a1-45c5-8c05-65f572ac80b3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:42.418461 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6862c2f2-68a1-45c5-8c05-65f572ac80b3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:42.424110 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6862c2f2-68a1-45c5-8c05-65f572ac80b3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:42.424562 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6862c2f2-68a1-45c5-8c05-65f572ac80b3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:42.425431 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6862c2f2-68a1-45c5-8c05-65f572ac80b3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:42.425863 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6862c2f2-68a1-45c5-8c05-65f572ac80b3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:42.572510 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6862c2f2-68a1-45c5-8c05-65f572ac80b3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:42.580843 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6862c2f2-68a1-45c5-8c05-65f572ac80b3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.166703 Apr 05 12:09:42.581413 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1195/2409] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:42 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:42.907789 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8f20f667-02ae-4d34-8928-82bedcb81012 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:42.908434 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8f20f667-02ae-4d34-8928-82bedcb81012 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:42.916023 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8f20f667-02ae-4d34-8928-82bedcb81012 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:42.916581 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8f20f667-02ae-4d34-8928-82bedcb81012 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:42.917457 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8f20f667-02ae-4d34-8928-82bedcb81012 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:42.917957 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8f20f667-02ae-4d34-8928-82bedcb81012 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:43.066405 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8f20f667-02ae-4d34-8928-82bedcb81012 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:43.074332 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8f20f667-02ae-4d34-8928-82bedcb81012 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.171198 Apr 05 12:09:43.074895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1215/2410] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:42 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:43.431448 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6c267102-9c57-4ca2-884d-df441589ddf6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:43.432159 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6c267102-9c57-4ca2-884d-df441589ddf6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:43.433442 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2668dd04-5120-4bc0-85e6-4374eaa776a9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:43.434262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2668dd04-5120-4bc0-85e6-4374eaa776a9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:43.439509 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6c267102-9c57-4ca2-884d-df441589ddf6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:43.440039 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6c267102-9c57-4ca2-884d-df441589ddf6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:43.440954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6c267102-9c57-4ca2-884d-df441589ddf6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:43.441373 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6c267102-9c57-4ca2-884d-df441589ddf6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:43.446829 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2668dd04-5120-4bc0-85e6-4374eaa776a9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:43.447247 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2668dd04-5120-4bc0-85e6-4374eaa776a9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:43.448253 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2668dd04-5120-4bc0-85e6-4374eaa776a9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:43.448681 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2668dd04-5120-4bc0-85e6-4374eaa776a9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:43.577689 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2668dd04-5120-4bc0-85e6-4374eaa776a9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:43.577846 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6c267102-9c57-4ca2-884d-df441589ddf6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:43.585850 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6c267102-9c57-4ca2-884d-df441589ddf6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.158900 Apr 05 12:09:43.586462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2668dd04-5120-4bc0-85e6-4374eaa776a9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:43.586607 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1196/2411] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:43 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:43.587989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2668dd04-5120-4bc0-85e6-4374eaa776a9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:43.589158 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2668dd04-5120-4bc0-85e6-4374eaa776a9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.160092 Apr 05 12:09:43.589703 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1216/2412] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:43 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:43.597785 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-932f34b6-ed1b-4eef-aaa9-647c6b3e5ea0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:43.598393 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-932f34b6-ed1b-4eef-aaa9-647c6b3e5ea0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:43.606314 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-932f34b6-ed1b-4eef-aaa9-647c6b3e5ea0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:43.606939 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-932f34b6-ed1b-4eef-aaa9-647c6b3e5ea0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:43.608132 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-932f34b6-ed1b-4eef-aaa9-647c6b3e5ea0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:43.608747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-932f34b6-ed1b-4eef-aaa9-647c6b3e5ea0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:43.748965 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-932f34b6-ed1b-4eef-aaa9-647c6b3e5ea0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:43.761108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-932f34b6-ed1b-4eef-aaa9-647c6b3e5ea0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.166749 Apr 05 12:09:43.761918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1197/2413] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:43 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:44.095572 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0e032fac-33e0-482d-be49-4abd8499f49f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:44.096606 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0e032fac-33e0-482d-be49-4abd8499f49f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:44.104275 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0e032fac-33e0-482d-be49-4abd8499f49f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:44.104720 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0e032fac-33e0-482d-be49-4abd8499f49f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:44.105466 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0e032fac-33e0-482d-be49-4abd8499f49f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:44.105889 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0e032fac-33e0-482d-be49-4abd8499f49f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:44.255232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0e032fac-33e0-482d-be49-4abd8499f49f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:44.269284 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0e032fac-33e0-482d-be49-4abd8499f49f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.179754 Apr 05 12:09:44.270161 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1217/2414] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:44 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:44.287560 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:09:44.287837 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Tue Apr 5 12:09:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:09:44.610738 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6572aae6-1cba-4e13-8fe5-3b9b33c1c160 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:44.611677 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5c3580c5-eeec-40df-8ac1-1726a371e0cf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:44.612364 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5c3580c5-eeec-40df-8ac1-1726a371e0cf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:44.612564 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6572aae6-1cba-4e13-8fe5-3b9b33c1c160 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:44.622618 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5c3580c5-eeec-40df-8ac1-1726a371e0cf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:44.623373 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5c3580c5-eeec-40df-8ac1-1726a371e0cf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:44.624685 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5c3580c5-eeec-40df-8ac1-1726a371e0cf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:44.625453 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5c3580c5-eeec-40df-8ac1-1726a371e0cf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:44.627812 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6572aae6-1cba-4e13-8fe5-3b9b33c1c160 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:44.628618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6572aae6-1cba-4e13-8fe5-3b9b33c1c160 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:44.630219 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6572aae6-1cba-4e13-8fe5-3b9b33c1c160 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:44.630994 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6572aae6-1cba-4e13-8fe5-3b9b33c1c160 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:44.765252 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5c3580c5-eeec-40df-8ac1-1726a371e0cf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:44.773812 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5c3580c5-eeec-40df-8ac1-1726a371e0cf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:44.775322 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5c3580c5-eeec-40df-8ac1-1726a371e0cf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:44.776496 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5c3580c5-eeec-40df-8ac1-1726a371e0cf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.172001 Apr 05 12:09:44.777097 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1218/2415] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:44 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:44.782855 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6572aae6-1cba-4e13-8fe5-3b9b33c1c160 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:44.785997 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-dd0b105d-3280-49a1-95ef-38fb96a86758 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:44.786689 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-dd0b105d-3280-49a1-95ef-38fb96a86758 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:44.790769 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6572aae6-1cba-4e13-8fe5-3b9b33c1c160 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.189861 Apr 05 12:09:44.791336 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1198/2416] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:44 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:44.793003 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dd0b105d-3280-49a1-95ef-38fb96a86758 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:44.793450 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dd0b105d-3280-49a1-95ef-38fb96a86758 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:44.794240 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dd0b105d-3280-49a1-95ef-38fb96a86758 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:44.794669 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dd0b105d-3280-49a1-95ef-38fb96a86758 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:44.930335 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-dd0b105d-3280-49a1-95ef-38fb96a86758 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:44.938475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-dd0b105d-3280-49a1-95ef-38fb96a86758 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.160262 Apr 05 12:09:44.939054 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1219/2417] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:44 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:45.297880 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-35f34b0f-d0cf-4178-ac68-d8b479777511 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:45.298780 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-35f34b0f-d0cf-4178-ac68-d8b479777511 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:45.306664 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-35f34b0f-d0cf-4178-ac68-d8b479777511 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:45.307110 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-35f34b0f-d0cf-4178-ac68-d8b479777511 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:45.307858 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-35f34b0f-d0cf-4178-ac68-d8b479777511 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:45.308329 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-35f34b0f-d0cf-4178-ac68-d8b479777511 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:45.450005 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-35f34b0f-d0cf-4178-ac68-d8b479777511 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:45.458253 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-35f34b0f-d0cf-4178-ac68-d8b479777511 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.167696 Apr 05 12:09:45.458826 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1199/2418] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:45 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:45.798740 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-92b71431-fc52-4e67-88a7-5ca96ce37d74 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:45.799785 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-92b71431-fc52-4e67-88a7-5ca96ce37d74 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:45.807862 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92b71431-fc52-4e67-88a7-5ca96ce37d74 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:45.808268 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92b71431-fc52-4e67-88a7-5ca96ce37d74 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:45.808707 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-256d4400-f369-4ae4-98dd-20ed8d3e2bc4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:45.809154 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92b71431-fc52-4e67-88a7-5ca96ce37d74 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:45.809273 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-256d4400-f369-4ae4-98dd-20ed8d3e2bc4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:45.809437 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92b71431-fc52-4e67-88a7-5ca96ce37d74 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:45.815921 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-256d4400-f369-4ae4-98dd-20ed8d3e2bc4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:45.816411 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-256d4400-f369-4ae4-98dd-20ed8d3e2bc4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:45.817201 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-256d4400-f369-4ae4-98dd-20ed8d3e2bc4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:45.817630 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-256d4400-f369-4ae4-98dd-20ed8d3e2bc4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:45.940909 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-92b71431-fc52-4e67-88a7-5ca96ce37d74 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:45.949243 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-92b71431-fc52-4e67-88a7-5ca96ce37d74 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:45.950765 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-92b71431-fc52-4e67-88a7-5ca96ce37d74 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:45.951254 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-256d4400-f369-4ae4-98dd-20ed8d3e2bc4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:45.951927 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-92b71431-fc52-4e67-88a7-5ca96ce37d74 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.159698 Apr 05 12:09:45.952550 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1220/2419] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:45 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:45.956950 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a7e62559-eac6-4c8c-9283-1c2c9ad7ecfb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:45.957492 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a7e62559-eac6-4c8c-9283-1c2c9ad7ecfb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:45.959613 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-256d4400-f369-4ae4-98dd-20ed8d3e2bc4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.154836 Apr 05 12:09:45.960271 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1200/2420] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:45 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:45.963481 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7e62559-eac6-4c8c-9283-1c2c9ad7ecfb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:45.963932 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7e62559-eac6-4c8c-9283-1c2c9ad7ecfb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:45.964712 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7e62559-eac6-4c8c-9283-1c2c9ad7ecfb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:45.965142 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7e62559-eac6-4c8c-9283-1c2c9ad7ecfb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:46.111223 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a7e62559-eac6-4c8c-9283-1c2c9ad7ecfb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:46.119638 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a7e62559-eac6-4c8c-9283-1c2c9ad7ecfb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.166104 Apr 05 12:09:46.120251 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1221/2421] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:45 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:46.477479 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-da8cb556-0983-4532-8cc6-0fdc12112321 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:46.478280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-da8cb556-0983-4532-8cc6-0fdc12112321 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:46.486571 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-da8cb556-0983-4532-8cc6-0fdc12112321 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:46.487170 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-da8cb556-0983-4532-8cc6-0fdc12112321 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:46.488273 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-da8cb556-0983-4532-8cc6-0fdc12112321 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:46.488845 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-da8cb556-0983-4532-8cc6-0fdc12112321 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:46.623568 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-da8cb556-0983-4532-8cc6-0fdc12112321 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:46.639771 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-da8cb556-0983-4532-8cc6-0fdc12112321 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.167066 Apr 05 12:09:46.640542 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1201/2422] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:46 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:46.973617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a4f7c6eb-0f05-478b-afd4-1d905263bfa0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:46.974724 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a4f7c6eb-0f05-478b-afd4-1d905263bfa0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:46.978742 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ee40f8c0-b7f0-457b-a217-c06fffd64005 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:46.979391 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ee40f8c0-b7f0-457b-a217-c06fffd64005 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:46.981281 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a4f7c6eb-0f05-478b-afd4-1d905263bfa0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:46.981722 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a4f7c6eb-0f05-478b-afd4-1d905263bfa0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:46.982469 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a4f7c6eb-0f05-478b-afd4-1d905263bfa0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:46.982891 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a4f7c6eb-0f05-478b-afd4-1d905263bfa0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:46.986013 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee40f8c0-b7f0-457b-a217-c06fffd64005 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:46.986462 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee40f8c0-b7f0-457b-a217-c06fffd64005 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:46.987214 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee40f8c0-b7f0-457b-a217-c06fffd64005 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:46.987645 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee40f8c0-b7f0-457b-a217-c06fffd64005 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:47.120754 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a4f7c6eb-0f05-478b-afd4-1d905263bfa0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:47.121067 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ee40f8c0-b7f0-457b-a217-c06fffd64005 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:47.128802 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ee40f8c0-b7f0-457b-a217-c06fffd64005 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.154368 Apr 05 12:09:47.129329 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a4f7c6eb-0f05-478b-afd4-1d905263bfa0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:47.129852 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1202/2423] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:46 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:47.131299 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a4f7c6eb-0f05-478b-afd4-1d905263bfa0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:47.132752 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a4f7c6eb-0f05-478b-afd4-1d905263bfa0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.165349 Apr 05 12:09:47.133311 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1222/2424] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:46 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:47.137802 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d8c08358-4eb7-463b-9c08-8361927a4c4d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:47.138608 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d8c08358-4eb7-463b-9c08-8361927a4c4d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:47.144767 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d8c08358-4eb7-463b-9c08-8361927a4c4d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:47.145212 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d8c08358-4eb7-463b-9c08-8361927a4c4d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:47.145971 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d8c08358-4eb7-463b-9c08-8361927a4c4d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:47.146423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d8c08358-4eb7-463b-9c08-8361927a4c4d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:47.278398 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d8c08358-4eb7-463b-9c08-8361927a4c4d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:47.286199 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d8c08358-4eb7-463b-9c08-8361927a4c4d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.152161 Apr 05 12:09:47.286735 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1203/2425] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:47 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:09:47.662652 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-551c4698-48c3-4b81-af3e-53546b744541 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:47.663277 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-551c4698-48c3-4b81-af3e-53546b744541 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:47.669575 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-551c4698-48c3-4b81-af3e-53546b744541 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:47.670030 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-551c4698-48c3-4b81-af3e-53546b744541 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:47.670782 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-551c4698-48c3-4b81-af3e-53546b744541 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:47.671249 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-551c4698-48c3-4b81-af3e-53546b744541 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:47.805512 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-551c4698-48c3-4b81-af3e-53546b744541 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:47.815121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-551c4698-48c3-4b81-af3e-53546b744541 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.158795 Apr 05 12:09:47.815890 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1223/2426] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:47 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:48.150519 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-078a4906-e388-4b16-9c68-147a221adb6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:48.151139 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-078a4906-e388-4b16-9c68-147a221adb6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:48.152745 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2799a088-d280-4223-81c6-a48e87c96326 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:48.153391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2799a088-d280-4223-81c6-a48e87c96326 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:48.157968 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-078a4906-e388-4b16-9c68-147a221adb6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:48.158419 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-078a4906-e388-4b16-9c68-147a221adb6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:48.159150 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2799a088-d280-4223-81c6-a48e87c96326 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:48.159299 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-078a4906-e388-4b16-9c68-147a221adb6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:48.159597 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2799a088-d280-4223-81c6-a48e87c96326 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:48.159706 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-078a4906-e388-4b16-9c68-147a221adb6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:48.160373 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2799a088-d280-4223-81c6-a48e87c96326 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:48.160799 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2799a088-d280-4223-81c6-a48e87c96326 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:48.298954 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2799a088-d280-4223-81c6-a48e87c96326 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:48.308116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2799a088-d280-4223-81c6-a48e87c96326 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:48.309598 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2799a088-d280-4223-81c6-a48e87c96326 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:48.310760 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2799a088-d280-4223-81c6-a48e87c96326 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.162757 Apr 05 12:09:48.311295 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1224/2427] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:48 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:48.315794 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7d64c17b-77a8-46b1-8c2e-18d7044415b0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:48.316424 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7d64c17b-77a8-46b1-8c2e-18d7044415b0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:48.322833 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7d64c17b-77a8-46b1-8c2e-18d7044415b0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:48.323276 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7d64c17b-77a8-46b1-8c2e-18d7044415b0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:48.324040 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7d64c17b-77a8-46b1-8c2e-18d7044415b0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:48.324495 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7d64c17b-77a8-46b1-8c2e-18d7044415b0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:48.466865 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7d64c17b-77a8-46b1-8c2e-18d7044415b0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:48.474876 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7d64c17b-77a8-46b1-8c2e-18d7044415b0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.162517 Apr 05 12:09:48.475453 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1225/2428] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:48 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:48.529269 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-078a4906-e388-4b16-9c68-147a221adb6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:48.537648 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-078a4906-e388-4b16-9c68-147a221adb6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.392959 Apr 05 12:09:48.538223 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1204/2429] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:48 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:48.836778 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c077a73e-fc58-425c-a045-0ceae4d5364d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:48.837775 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c077a73e-fc58-425c-a045-0ceae4d5364d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:48.847663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c077a73e-fc58-425c-a045-0ceae4d5364d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:48.848479 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c077a73e-fc58-425c-a045-0ceae4d5364d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:48.849740 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c077a73e-fc58-425c-a045-0ceae4d5364d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:48.850447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c077a73e-fc58-425c-a045-0ceae4d5364d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:48.988110 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c077a73e-fc58-425c-a045-0ceae4d5364d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:48.996397 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c077a73e-fc58-425c-a045-0ceae4d5364d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.166136 Apr 05 12:09:48.996963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1226/2430] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:48 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:49.334293 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-10d242d8-0a53-4052-a4c5-3886c5a1f68b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:49.335386 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-10d242d8-0a53-4052-a4c5-3886c5a1f68b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:49.345930 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-10d242d8-0a53-4052-a4c5-3886c5a1f68b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:49.346661 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-10d242d8-0a53-4052-a4c5-3886c5a1f68b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:49.347889 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-10d242d8-0a53-4052-a4c5-3886c5a1f68b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:49.348655 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-10d242d8-0a53-4052-a4c5-3886c5a1f68b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:49.479319 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-10d242d8-0a53-4052-a4c5-3886c5a1f68b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:49.488110 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-10d242d8-0a53-4052-a4c5-3886c5a1f68b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:49.489652 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-10d242d8-0a53-4052-a4c5-3886c5a1f68b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:49.490961 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-10d242d8-0a53-4052-a4c5-3886c5a1f68b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.163482 Apr 05 12:09:49.491447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8eb71f0f-b3de-4cb0-b26a-8a05f86953b7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:49.491935 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1205/2431] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:49 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:49.492129 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8eb71f0f-b3de-4cb0-b26a-8a05f86953b7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:49.499241 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8eb71f0f-b3de-4cb0-b26a-8a05f86953b7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:49.499241 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8eb71f0f-b3de-4cb0-b26a-8a05f86953b7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:49.500022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8eb71f0f-b3de-4cb0-b26a-8a05f86953b7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:49.500481 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8eb71f0f-b3de-4cb0-b26a-8a05f86953b7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:49.555153 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-19e47ed6-e62c-4651-8c00-44389b0676a4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:49.555897 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-19e47ed6-e62c-4651-8c00-44389b0676a4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:49.562045 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-19e47ed6-e62c-4651-8c00-44389b0676a4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:49.562584 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-19e47ed6-e62c-4651-8c00-44389b0676a4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:49.563420 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-19e47ed6-e62c-4651-8c00-44389b0676a4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:49.563931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-19e47ed6-e62c-4651-8c00-44389b0676a4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:49.639032 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8eb71f0f-b3de-4cb0-b26a-8a05f86953b7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:49.646867 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8eb71f0f-b3de-4cb0-b26a-8a05f86953b7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.159267 Apr 05 12:09:49.647426 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1227/2432] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:49 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:09:49.698579 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-19e47ed6-e62c-4651-8c00-44389b0676a4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:49.706618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-19e47ed6-e62c-4651-8c00-44389b0676a4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.155561 Apr 05 12:09:49.707191 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1206/2433] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:49 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:50.018238 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-20cd3764-988a-423f-b0c8-6fbdd32aa2fc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:50.019286 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-20cd3764-988a-423f-b0c8-6fbdd32aa2fc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:50.029632 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-20cd3764-988a-423f-b0c8-6fbdd32aa2fc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:50.030366 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-20cd3764-988a-423f-b0c8-6fbdd32aa2fc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:50.031592 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-20cd3764-988a-423f-b0c8-6fbdd32aa2fc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:50.032350 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-20cd3764-988a-423f-b0c8-6fbdd32aa2fc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:50.190014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-20cd3764-988a-423f-b0c8-6fbdd32aa2fc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:50.198342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-20cd3764-988a-423f-b0c8-6fbdd32aa2fc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.186590 Apr 05 12:09:50.198913 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1228/2434] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:50 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:50.513712 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ca7b2040-84c6-4e72-964b-30f6831e8a50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:50.514747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ca7b2040-84c6-4e72-964b-30f6831e8a50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:50.524216 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ca7b2040-84c6-4e72-964b-30f6831e8a50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:50.524664 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ca7b2040-84c6-4e72-964b-30f6831e8a50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:50.525423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ca7b2040-84c6-4e72-964b-30f6831e8a50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:50.525859 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ca7b2040-84c6-4e72-964b-30f6831e8a50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:50.661194 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ca7b2040-84c6-4e72-964b-30f6831e8a50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:50.665020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-db92ba57-e8bd-48cc-8c72-2494c935bb36 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:50.665666 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-db92ba57-e8bd-48cc-8c72-2494c935bb36 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:50.669929 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ca7b2040-84c6-4e72-964b-30f6831e8a50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:50.671428 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ca7b2040-84c6-4e72-964b-30f6831e8a50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:50.672263 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-db92ba57-e8bd-48cc-8c72-2494c935bb36 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:50.672617 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ca7b2040-84c6-4e72-964b-30f6831e8a50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.165563 Apr 05 12:09:50.672742 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-db92ba57-e8bd-48cc-8c72-2494c935bb36 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:50.673183 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1207/2435] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:50 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:50.673456 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-db92ba57-e8bd-48cc-8c72-2494c935bb36 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:50.673892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-db92ba57-e8bd-48cc-8c72-2494c935bb36 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:50.724110 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6b9fd11a-13ca-4a41-a172-b221e2a8a1a6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:50.724861 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6b9fd11a-13ca-4a41-a172-b221e2a8a1a6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:50.731123 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6b9fd11a-13ca-4a41-a172-b221e2a8a1a6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:50.731568 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6b9fd11a-13ca-4a41-a172-b221e2a8a1a6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:50.732542 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6b9fd11a-13ca-4a41-a172-b221e2a8a1a6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:50.733174 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6b9fd11a-13ca-4a41-a172-b221e2a8a1a6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:50.812458 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-db92ba57-e8bd-48cc-8c72-2494c935bb36 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:50.821347 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-db92ba57-e8bd-48cc-8c72-2494c935bb36 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.160271 Apr 05 12:09:50.822116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1229/2436] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:50 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:50.875187 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6b9fd11a-13ca-4a41-a172-b221e2a8a1a6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:50.883631 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6b9fd11a-13ca-4a41-a172-b221e2a8a1a6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.163426 Apr 05 12:09:50.884201 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1208/2437] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:50 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:51.219102 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-24cb11f8-78c7-481a-aae4-bace807b3fae tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:51.220148 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-24cb11f8-78c7-481a-aae4-bace807b3fae tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:51.230301 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24cb11f8-78c7-481a-aae4-bace807b3fae tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:51.231041 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24cb11f8-78c7-481a-aae4-bace807b3fae tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:51.232326 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24cb11f8-78c7-481a-aae4-bace807b3fae tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:51.233043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24cb11f8-78c7-481a-aae4-bace807b3fae tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:51.381044 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-24cb11f8-78c7-481a-aae4-bace807b3fae tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:51.389707 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-24cb11f8-78c7-481a-aae4-bace807b3fae tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.177107 Apr 05 12:09:51.390286 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1230/2438] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:51 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:51.695085 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8efc23bd-0f7a-4628-a59e-cf7383b74ef3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:51.696113 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8efc23bd-0f7a-4628-a59e-cf7383b74ef3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:51.706712 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8efc23bd-0f7a-4628-a59e-cf7383b74ef3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:51.707498 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8efc23bd-0f7a-4628-a59e-cf7383b74ef3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:51.708792 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8efc23bd-0f7a-4628-a59e-cf7383b74ef3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:51.709504 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8efc23bd-0f7a-4628-a59e-cf7383b74ef3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:51.840349 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b6537be1-dca6-4ba1-bd90-94de29b6626d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:51.841149 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b6537be1-dca6-4ba1-bd90-94de29b6626d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:51.846763 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8efc23bd-0f7a-4628-a59e-cf7383b74ef3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:51.848111 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6537be1-dca6-4ba1-bd90-94de29b6626d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:51.848650 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6537be1-dca6-4ba1-bd90-94de29b6626d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:51.850130 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6537be1-dca6-4ba1-bd90-94de29b6626d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:51.850130 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6537be1-dca6-4ba1-bd90-94de29b6626d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:51.856192 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8efc23bd-0f7a-4628-a59e-cf7383b74ef3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:51.857840 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8efc23bd-0f7a-4628-a59e-cf7383b74ef3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:51.859005 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8efc23bd-0f7a-4628-a59e-cf7383b74ef3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.170674 Apr 05 12:09:51.859575 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1209/2439] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:51 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:51.901198 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8090d586-bc0a-4c50-ac98-1b2434dafb5d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:51.902083 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8090d586-bc0a-4c50-ac98-1b2434dafb5d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:51.908054 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8090d586-bc0a-4c50-ac98-1b2434dafb5d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:51.908623 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8090d586-bc0a-4c50-ac98-1b2434dafb5d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:51.909615 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8090d586-bc0a-4c50-ac98-1b2434dafb5d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:51.910681 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8090d586-bc0a-4c50-ac98-1b2434dafb5d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:51.990040 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b6537be1-dca6-4ba1-bd90-94de29b6626d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:51.998370 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b6537be1-dca6-4ba1-bd90-94de29b6626d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.163374 Apr 05 12:09:51.999062 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1231/2440] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:51 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:52.042236 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8090d586-bc0a-4c50-ac98-1b2434dafb5d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:52.051510 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8090d586-bc0a-4c50-ac98-1b2434dafb5d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.154320 Apr 05 12:09:52.052104 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1210/2441] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:51 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:09:52.411858 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-68d9f894-99bc-4435-b3d0-85b47a9eae41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:52.412805 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-68d9f894-99bc-4435-b3d0-85b47a9eae41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:52.419773 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-68d9f894-99bc-4435-b3d0-85b47a9eae41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:52.420252 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-68d9f894-99bc-4435-b3d0-85b47a9eae41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:52.421013 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-68d9f894-99bc-4435-b3d0-85b47a9eae41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:52.421443 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-68d9f894-99bc-4435-b3d0-85b47a9eae41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:52.558917 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-68d9f894-99bc-4435-b3d0-85b47a9eae41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:52.571130 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-68d9f894-99bc-4435-b3d0-85b47a9eae41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.165507 Apr 05 12:09:52.571864 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1232/2442] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:52 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:52.882301 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-73c388df-088d-43a1-934c-952b562f6455 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:52.883178 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-73c388df-088d-43a1-934c-952b562f6455 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:52.890245 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-73c388df-088d-43a1-934c-952b562f6455 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:52.890724 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-73c388df-088d-43a1-934c-952b562f6455 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:52.891522 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-73c388df-088d-43a1-934c-952b562f6455 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:52.891981 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-73c388df-088d-43a1-934c-952b562f6455 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:53.016443 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c115a7b5-8fa3-406e-b0ed-ac8e17762fa8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:53.017160 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c115a7b5-8fa3-406e-b0ed-ac8e17762fa8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:53.023831 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c115a7b5-8fa3-406e-b0ed-ac8e17762fa8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:53.024348 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c115a7b5-8fa3-406e-b0ed-ac8e17762fa8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:53.025116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c115a7b5-8fa3-406e-b0ed-ac8e17762fa8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:53.025548 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c115a7b5-8fa3-406e-b0ed-ac8e17762fa8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:53.031896 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-73c388df-088d-43a1-934c-952b562f6455 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:53.040567 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-73c388df-088d-43a1-934c-952b562f6455 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:53.042079 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-73c388df-088d-43a1-934c-952b562f6455 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:53.043252 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-73c388df-088d-43a1-934c-952b562f6455 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.168090 Apr 05 12:09:53.043830 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1211/2443] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:52 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:53.072588 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b42e9f3b-5fee-427b-8edf-3612c01fa28a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:53.073195 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b42e9f3b-5fee-427b-8edf-3612c01fa28a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:53.079117 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b42e9f3b-5fee-427b-8edf-3612c01fa28a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:53.079559 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b42e9f3b-5fee-427b-8edf-3612c01fa28a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:53.080351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b42e9f3b-5fee-427b-8edf-3612c01fa28a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:53.080777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b42e9f3b-5fee-427b-8edf-3612c01fa28a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:53.163097 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c115a7b5-8fa3-406e-b0ed-ac8e17762fa8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:53.171326 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c115a7b5-8fa3-406e-b0ed-ac8e17762fa8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.158753 Apr 05 12:09:53.171903 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1233/2444] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:53 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:53.213802 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b42e9f3b-5fee-427b-8edf-3612c01fa28a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:53.222127 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b42e9f3b-5fee-427b-8edf-3612c01fa28a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.153311 Apr 05 12:09:53.222714 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1212/2445] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:53 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:53.598049 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4a8b55bb-bf86-415d-aeb8-9a2658c70b0c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:53.599047 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4a8b55bb-bf86-415d-aeb8-9a2658c70b0c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:53.606943 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a8b55bb-bf86-415d-aeb8-9a2658c70b0c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:53.607443 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a8b55bb-bf86-415d-aeb8-9a2658c70b0c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:53.608317 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a8b55bb-bf86-415d-aeb8-9a2658c70b0c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:53.608796 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a8b55bb-bf86-415d-aeb8-9a2658c70b0c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:53.910827 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4a8b55bb-bf86-415d-aeb8-9a2658c70b0c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:53.918801 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4a8b55bb-bf86-415d-aeb8-9a2658c70b0c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.327240 Apr 05 12:09:53.919378 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1234/2446] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:53 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:54.064325 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-beb2cb0a-981c-4974-b633-85234af8c075 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:54.064953 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-beb2cb0a-981c-4974-b633-85234af8c075 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:54.074182 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-beb2cb0a-981c-4974-b633-85234af8c075 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:54.074792 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-beb2cb0a-981c-4974-b633-85234af8c075 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:54.075911 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-beb2cb0a-981c-4974-b633-85234af8c075 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:54.076530 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-beb2cb0a-981c-4974-b633-85234af8c075 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:54.188505 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f7c9b0d8-8ad6-4ef9-9e82-7796c0da8122 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:54.189153 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f7c9b0d8-8ad6-4ef9-9e82-7796c0da8122 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:54.195757 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f7c9b0d8-8ad6-4ef9-9e82-7796c0da8122 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:54.196211 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f7c9b0d8-8ad6-4ef9-9e82-7796c0da8122 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:54.196976 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f7c9b0d8-8ad6-4ef9-9e82-7796c0da8122 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:54.197438 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f7c9b0d8-8ad6-4ef9-9e82-7796c0da8122 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:54.219212 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-beb2cb0a-981c-4974-b633-85234af8c075 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:54.227638 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-beb2cb0a-981c-4974-b633-85234af8c075 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:54.229180 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-beb2cb0a-981c-4974-b633-85234af8c075 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:54.230336 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-beb2cb0a-981c-4974-b633-85234af8c075 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.172324 Apr 05 12:09:54.230940 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1213/2447] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:54 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:54.239306 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-352ae40b-0b79-4eb9-a2e1-3655b5b51fd2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:54.239903 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-352ae40b-0b79-4eb9-a2e1-3655b5b51fd2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:54.246086 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-352ae40b-0b79-4eb9-a2e1-3655b5b51fd2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:54.246525 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-352ae40b-0b79-4eb9-a2e1-3655b5b51fd2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:54.247269 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-352ae40b-0b79-4eb9-a2e1-3655b5b51fd2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:54.247696 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-352ae40b-0b79-4eb9-a2e1-3655b5b51fd2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:54.327096 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f7c9b0d8-8ad6-4ef9-9e82-7796c0da8122 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:54.335080 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f7c9b0d8-8ad6-4ef9-9e82-7796c0da8122 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.150357 Apr 05 12:09:54.335640 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1235/2448] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:54 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:54.377553 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-352ae40b-0b79-4eb9-a2e1-3655b5b51fd2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:54.385999 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-352ae40b-0b79-4eb9-a2e1-3655b5b51fd2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.150310 Apr 05 12:09:54.386609 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1214/2449] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:54 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:54.940768 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-454df28b-dfce-4e60-99b7-c25b83dac4b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:54.941652 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-454df28b-dfce-4e60-99b7-c25b83dac4b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:54.951795 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-454df28b-dfce-4e60-99b7-c25b83dac4b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:54.952618 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-454df28b-dfce-4e60-99b7-c25b83dac4b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:54.953830 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-454df28b-dfce-4e60-99b7-c25b83dac4b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:54.954537 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-454df28b-dfce-4e60-99b7-c25b83dac4b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:55.099687 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-454df28b-dfce-4e60-99b7-c25b83dac4b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:55.108176 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-454df28b-dfce-4e60-99b7-c25b83dac4b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.174011 Apr 05 12:09:55.108723 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1236/2450] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:54 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:55.253178 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d7554d9b-a65d-4191-8722-8b8b31ed85cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:55.254144 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d7554d9b-a65d-4191-8722-8b8b31ed85cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:55.262533 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d7554d9b-a65d-4191-8722-8b8b31ed85cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:55.262975 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d7554d9b-a65d-4191-8722-8b8b31ed85cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:55.263736 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d7554d9b-a65d-4191-8722-8b8b31ed85cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:55.264193 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d7554d9b-a65d-4191-8722-8b8b31ed85cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:55.351757 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bb91ef83-eea5-41f9-a1b3-951cbf41183d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:55.352421 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bb91ef83-eea5-41f9-a1b3-951cbf41183d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:55.359324 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bb91ef83-eea5-41f9-a1b3-951cbf41183d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:55.359761 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bb91ef83-eea5-41f9-a1b3-951cbf41183d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:55.360602 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bb91ef83-eea5-41f9-a1b3-951cbf41183d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:55.361032 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bb91ef83-eea5-41f9-a1b3-951cbf41183d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:55.415437 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d7554d9b-a65d-4191-8722-8b8b31ed85cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:55.423848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d7554d9b-a65d-4191-8722-8b8b31ed85cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:55.425415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d7554d9b-a65d-4191-8722-8b8b31ed85cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:55.426579 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d7554d9b-a65d-4191-8722-8b8b31ed85cb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.180017 Apr 05 12:09:55.427468 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1215/2451] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:55 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:55.431993 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b4fca238-6827-4325-a944-60c61736870b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:55.432802 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b4fca238-6827-4325-a944-60c61736870b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:55.438726 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b4fca238-6827-4325-a944-60c61736870b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:55.439183 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b4fca238-6827-4325-a944-60c61736870b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:55.439958 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b4fca238-6827-4325-a944-60c61736870b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:55.440425 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b4fca238-6827-4325-a944-60c61736870b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:55.501266 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bb91ef83-eea5-41f9-a1b3-951cbf41183d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:55.509770 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bb91ef83-eea5-41f9-a1b3-951cbf41183d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.162055 Apr 05 12:09:55.510250 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1237/2452] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:55 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:55.571565 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b4fca238-6827-4325-a944-60c61736870b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:55.579545 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b4fca238-6827-4325-a944-60c61736870b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.151133 Apr 05 12:09:55.580109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1216/2453] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:55 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:56.125753 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6dbf96b3-533d-46b5-a46a-6b0d8aa8c5a4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:56.126362 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6dbf96b3-533d-46b5-a46a-6b0d8aa8c5a4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:56.132928 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6dbf96b3-533d-46b5-a46a-6b0d8aa8c5a4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:56.133380 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6dbf96b3-533d-46b5-a46a-6b0d8aa8c5a4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:56.134149 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6dbf96b3-533d-46b5-a46a-6b0d8aa8c5a4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:56.134579 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6dbf96b3-533d-46b5-a46a-6b0d8aa8c5a4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:56.275640 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6dbf96b3-533d-46b5-a46a-6b0d8aa8c5a4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:56.284111 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6dbf96b3-533d-46b5-a46a-6b0d8aa8c5a4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.162249 Apr 05 12:09:56.284727 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1238/2454] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:56 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:56.445988 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1a70cfdf-9b9e-4d2e-89e7-efacad3a27dd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:56.446605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1a70cfdf-9b9e-4d2e-89e7-efacad3a27dd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:56.453832 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1a70cfdf-9b9e-4d2e-89e7-efacad3a27dd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:56.454280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1a70cfdf-9b9e-4d2e-89e7-efacad3a27dd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:56.455087 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1a70cfdf-9b9e-4d2e-89e7-efacad3a27dd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:56.455515 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1a70cfdf-9b9e-4d2e-89e7-efacad3a27dd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:56.527546 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bfc6b916-f99e-4279-83cc-46912bfb50cb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:56.528395 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bfc6b916-f99e-4279-83cc-46912bfb50cb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:56.535389 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bfc6b916-f99e-4279-83cc-46912bfb50cb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:56.535950 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bfc6b916-f99e-4279-83cc-46912bfb50cb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:56.536837 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bfc6b916-f99e-4279-83cc-46912bfb50cb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:56.537389 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bfc6b916-f99e-4279-83cc-46912bfb50cb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:56.592799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1a70cfdf-9b9e-4d2e-89e7-efacad3a27dd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:56.601240 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1a70cfdf-9b9e-4d2e-89e7-efacad3a27dd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:56.602819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1a70cfdf-9b9e-4d2e-89e7-efacad3a27dd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:56.603990 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1a70cfdf-9b9e-4d2e-89e7-efacad3a27dd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.162164 Apr 05 12:09:56.604579 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1217/2455] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:56 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:56.609159 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c629755a-07bf-49db-9eae-616483000ccc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:56.609768 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c629755a-07bf-49db-9eae-616483000ccc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:56.615376 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c629755a-07bf-49db-9eae-616483000ccc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:56.615834 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c629755a-07bf-49db-9eae-616483000ccc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:56.616622 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c629755a-07bf-49db-9eae-616483000ccc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:56.617103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c629755a-07bf-49db-9eae-616483000ccc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:56.672490 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bfc6b916-f99e-4279-83cc-46912bfb50cb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:56.680641 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bfc6b916-f99e-4279-83cc-46912bfb50cb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.157431 Apr 05 12:09:56.681447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1239/2456] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:56 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:56.749945 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c629755a-07bf-49db-9eae-616483000ccc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:56.758747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c629755a-07bf-49db-9eae-616483000ccc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.153195 Apr 05 12:09:56.759326 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1218/2457] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:56 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:57.304498 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-02341da0-dee2-4833-9670-d1c324312453 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:57.305392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-02341da0-dee2-4833-9670-d1c324312453 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:57.315603 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-02341da0-dee2-4833-9670-d1c324312453 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:57.316413 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-02341da0-dee2-4833-9670-d1c324312453 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:57.317667 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-02341da0-dee2-4833-9670-d1c324312453 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:57.318398 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-02341da0-dee2-4833-9670-d1c324312453 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:57.464828 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-02341da0-dee2-4833-9670-d1c324312453 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:57.472943 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-02341da0-dee2-4833-9670-d1c324312453 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.175039 Apr 05 12:09:57.473539 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1240/2458] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:57 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:57.626472 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5803df0f-8456-435f-924c-65e7b4b0f3a8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:57.627377 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5803df0f-8456-435f-924c-65e7b4b0f3a8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:57.636330 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5803df0f-8456-435f-924c-65e7b4b0f3a8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:57.636780 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5803df0f-8456-435f-924c-65e7b4b0f3a8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:57.637576 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5803df0f-8456-435f-924c-65e7b4b0f3a8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:57.638008 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5803df0f-8456-435f-924c-65e7b4b0f3a8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:57.697854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-824f3747-ef18-4680-9873-cddca9a058de tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:57.698578 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-824f3747-ef18-4680-9873-cddca9a058de tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:57.705196 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-824f3747-ef18-4680-9873-cddca9a058de tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:57.705640 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-824f3747-ef18-4680-9873-cddca9a058de tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:57.706426 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-824f3747-ef18-4680-9873-cddca9a058de tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:57.706849 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-824f3747-ef18-4680-9873-cddca9a058de tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:57.776667 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5803df0f-8456-435f-924c-65e7b4b0f3a8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:57.785139 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5803df0f-8456-435f-924c-65e7b4b0f3a8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:57.786695 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5803df0f-8456-435f-924c-65e7b4b0f3a8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:57.787934 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5803df0f-8456-435f-924c-65e7b4b0f3a8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.168088 Apr 05 12:09:57.788503 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1219/2459] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:57 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:57.792813 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-515e187d-22f4-4943-b173-74767ca296a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:57.793413 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-515e187d-22f4-4943-b173-74767ca296a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:57.799636 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-515e187d-22f4-4943-b173-74767ca296a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:57.800122 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-515e187d-22f4-4943-b173-74767ca296a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:57.800921 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-515e187d-22f4-4943-b173-74767ca296a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:57.801361 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-515e187d-22f4-4943-b173-74767ca296a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:57.949725 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-515e187d-22f4-4943-b173-74767ca296a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:57.958335 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-515e187d-22f4-4943-b173-74767ca296a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.168803 Apr 05 12:09:57.958968 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1220/2460] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:57 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:58.083769 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-824f3747-ef18-4680-9873-cddca9a058de tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:58.095579 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-824f3747-ef18-4680-9873-cddca9a058de tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.401385 Apr 05 12:09:58.096416 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1241/2461] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:57 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:58.491879 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1dc20165-c3cb-40e8-bf03-2bacb83a8bdb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:58.492640 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1dc20165-c3cb-40e8-bf03-2bacb83a8bdb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:58.499167 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1dc20165-c3cb-40e8-bf03-2bacb83a8bdb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:58.499620 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1dc20165-c3cb-40e8-bf03-2bacb83a8bdb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:58.500429 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1dc20165-c3cb-40e8-bf03-2bacb83a8bdb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:58.500860 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1dc20165-c3cb-40e8-bf03-2bacb83a8bdb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:58.636098 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1dc20165-c3cb-40e8-bf03-2bacb83a8bdb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:58.644381 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1dc20165-c3cb-40e8-bf03-2bacb83a8bdb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.157528 Apr 05 12:09:58.644934 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1221/2462] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:58 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:58.810857 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-24751f61-05ef-4a63-b7ce-f2fc74a2b088 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:58.811693 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-24751f61-05ef-4a63-b7ce-f2fc74a2b088 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:58.821852 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24751f61-05ef-4a63-b7ce-f2fc74a2b088 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:58.822292 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24751f61-05ef-4a63-b7ce-f2fc74a2b088 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:58.823032 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24751f61-05ef-4a63-b7ce-f2fc74a2b088 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:58.823451 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24751f61-05ef-4a63-b7ce-f2fc74a2b088 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:58.967740 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-24751f61-05ef-4a63-b7ce-f2fc74a2b088 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:58.975572 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2517969f-cecc-4c4b-a360-208405dbab3c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:58.976216 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2517969f-cecc-4c4b-a360-208405dbab3c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:58.976677 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-24751f61-05ef-4a63-b7ce-f2fc74a2b088 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:58.978206 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-24751f61-05ef-4a63-b7ce-f2fc74a2b088 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:58.979384 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-24751f61-05ef-4a63-b7ce-f2fc74a2b088 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.175242 Apr 05 12:09:58.979942 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1242/2463] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:58 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:58.982611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2517969f-cecc-4c4b-a360-208405dbab3c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:58.983123 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2517969f-cecc-4c4b-a360-208405dbab3c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:58.983965 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2517969f-cecc-4c4b-a360-208405dbab3c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:58.984486 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2517969f-cecc-4c4b-a360-208405dbab3c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:59.115318 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-00642871-e69d-4a73-bd51-d88258cf6902 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:59.115908 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-00642871-e69d-4a73-bd51-d88258cf6902 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:59.122849 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-00642871-e69d-4a73-bd51-d88258cf6902 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:59.123322 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-00642871-e69d-4a73-bd51-d88258cf6902 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:59.124232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-00642871-e69d-4a73-bd51-d88258cf6902 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:59.124659 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-00642871-e69d-4a73-bd51-d88258cf6902 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:59.128916 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2517969f-cecc-4c4b-a360-208405dbab3c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:59.137741 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2517969f-cecc-4c4b-a360-208405dbab3c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.166009 Apr 05 12:09:59.138343 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1222/2464] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:58 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:59.259310 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-00642871-e69d-4a73-bd51-d88258cf6902 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:59.267639 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-00642871-e69d-4a73-bd51-d88258cf6902 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.157866 Apr 05 12:09:59.268245 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1243/2465] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:59 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:59.661279 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-38c784d9-d06f-4ffe-9ae5-3cba25e92605 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:09:59.661895 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-38c784d9-d06f-4ffe-9ae5-3cba25e92605 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:09:59.668526 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-38c784d9-d06f-4ffe-9ae5-3cba25e92605 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:59.668975 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-38c784d9-d06f-4ffe-9ae5-3cba25e92605 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:59.669733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-38c784d9-d06f-4ffe-9ae5-3cba25e92605 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:09:59.670163 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-38c784d9-d06f-4ffe-9ae5-3cba25e92605 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:09:59.810905 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-38c784d9-d06f-4ffe-9ae5-3cba25e92605 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:09:59.818811 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-38c784d9-d06f-4ffe-9ae5-3cba25e92605 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.161471 Apr 05 12:09:59.819388 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1223/2466] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:09:59 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:00.002241 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-673fa7d3-e4b6-418c-83c5-9c08b0e2b964 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:00.003285 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-673fa7d3-e4b6-418c-83c5-9c08b0e2b964 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:00.014093 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-673fa7d3-e4b6-418c-83c5-9c08b0e2b964 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:00.014725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-673fa7d3-e4b6-418c-83c5-9c08b0e2b964 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:00.015954 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-673fa7d3-e4b6-418c-83c5-9c08b0e2b964 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:00.016685 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-673fa7d3-e4b6-418c-83c5-9c08b0e2b964 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:00.154990 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f5099037-0cd8-4b00-abee-b9ccac833dfd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:00.155725 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f5099037-0cd8-4b00-abee-b9ccac833dfd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:00.158481 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-673fa7d3-e4b6-418c-83c5-9c08b0e2b964 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:00.161921 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f5099037-0cd8-4b00-abee-b9ccac833dfd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:00.162379 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f5099037-0cd8-4b00-abee-b9ccac833dfd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:00.163290 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f5099037-0cd8-4b00-abee-b9ccac833dfd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:00.163733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f5099037-0cd8-4b00-abee-b9ccac833dfd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:00.168598 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-673fa7d3-e4b6-418c-83c5-9c08b0e2b964 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:00.168796 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-673fa7d3-e4b6-418c-83c5-9c08b0e2b964 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:00.169920 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-673fa7d3-e4b6-418c-83c5-9c08b0e2b964 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.174228 Apr 05 12:10:00.170459 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1244/2467] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:09:59 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:00.285327 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-672e5c90-afca-4b1e-937f-77fdf9b107cf tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:00.285841 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-672e5c90-afca-4b1e-937f-77fdf9b107cf tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:00.291990 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-672e5c90-afca-4b1e-937f-77fdf9b107cf tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:00.292485 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-672e5c90-afca-4b1e-937f-77fdf9b107cf tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:00.293252 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-672e5c90-afca-4b1e-937f-77fdf9b107cf tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:00.293691 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-672e5c90-afca-4b1e-937f-77fdf9b107cf tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:00.301886 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f5099037-0cd8-4b00-abee-b9ccac833dfd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:00.309698 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f5099037-0cd8-4b00-abee-b9ccac833dfd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.158558 Apr 05 12:10:00.310267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1224/2468] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:00 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:00.437757 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-672e5c90-afca-4b1e-937f-77fdf9b107cf tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:00.446194 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-672e5c90-afca-4b1e-937f-77fdf9b107cf tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.164823 Apr 05 12:10:00.446797 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1245/2469] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:00 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:00.840649 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0fedee01-dd10-4a6e-a913-c2bb29fea97c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:00.841589 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0fedee01-dd10-4a6e-a913-c2bb29fea97c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:00.852395 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0fedee01-dd10-4a6e-a913-c2bb29fea97c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:00.853151 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0fedee01-dd10-4a6e-a913-c2bb29fea97c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:00.854401 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0fedee01-dd10-4a6e-a913-c2bb29fea97c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:00.855120 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0fedee01-dd10-4a6e-a913-c2bb29fea97c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:01.006390 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0fedee01-dd10-4a6e-a913-c2bb29fea97c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:01.017744 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0fedee01-dd10-4a6e-a913-c2bb29fea97c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.183396 Apr 05 12:10:01.018511 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1225/2470] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:00 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:01.192703 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b31760f2-128c-4c01-8982-689d9a812d81 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:01.193558 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b31760f2-128c-4c01-8982-689d9a812d81 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:01.201197 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b31760f2-128c-4c01-8982-689d9a812d81 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:01.201639 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b31760f2-128c-4c01-8982-689d9a812d81 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:01.202391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b31760f2-128c-4c01-8982-689d9a812d81 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:01.202815 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b31760f2-128c-4c01-8982-689d9a812d81 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:01.327584 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2a0196f4-99cd-4117-b2fe-128f623a0b12 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:01.328263 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2a0196f4-99cd-4117-b2fe-128f623a0b12 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:01.334808 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2a0196f4-99cd-4117-b2fe-128f623a0b12 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:01.335261 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2a0196f4-99cd-4117-b2fe-128f623a0b12 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:01.336030 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2a0196f4-99cd-4117-b2fe-128f623a0b12 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:01.336499 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2a0196f4-99cd-4117-b2fe-128f623a0b12 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:01.344657 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b31760f2-128c-4c01-8982-689d9a812d81 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:01.353810 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b31760f2-128c-4c01-8982-689d9a812d81 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:01.355288 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b31760f2-128c-4c01-8982-689d9a812d81 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:01.356496 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b31760f2-128c-4c01-8982-689d9a812d81 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.170581 Apr 05 12:10:01.357097 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1246/2471] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:01 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:01.463013 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3cc439f4-739a-4576-852c-aa0487997cd2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:01.463617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3cc439f4-739a-4576-852c-aa0487997cd2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:01.469765 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3cc439f4-739a-4576-852c-aa0487997cd2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:01.470266 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3cc439f4-739a-4576-852c-aa0487997cd2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:01.471029 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3cc439f4-739a-4576-852c-aa0487997cd2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:01.471467 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3cc439f4-739a-4576-852c-aa0487997cd2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:01.473713 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2a0196f4-99cd-4117-b2fe-128f623a0b12 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:01.481533 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2a0196f4-99cd-4117-b2fe-128f623a0b12 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.157873 Apr 05 12:10:01.482108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1226/2472] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:01 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:01.609168 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3cc439f4-739a-4576-852c-aa0487997cd2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:01.617240 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3cc439f4-739a-4576-852c-aa0487997cd2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.158195 Apr 05 12:10:01.617774 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1247/2473] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:01 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:10:02.039204 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0314bc34-9e30-4a4a-8759-d237bbeff82f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:02.040282 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0314bc34-9e30-4a4a-8759-d237bbeff82f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:02.048126 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0314bc34-9e30-4a4a-8759-d237bbeff82f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:02.048663 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0314bc34-9e30-4a4a-8759-d237bbeff82f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:02.049552 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0314bc34-9e30-4a4a-8759-d237bbeff82f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:02.050061 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0314bc34-9e30-4a4a-8759-d237bbeff82f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:02.194471 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0314bc34-9e30-4a4a-8759-d237bbeff82f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:02.202698 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0314bc34-9e30-4a4a-8759-d237bbeff82f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.170224 Apr 05 12:10:02.203271 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1227/2474] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:02 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:02.380395 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0c016d95-4084-4892-9265-0e85be056584 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:02.381301 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0c016d95-4084-4892-9265-0e85be056584 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:02.392295 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0c016d95-4084-4892-9265-0e85be056584 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:02.393041 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0c016d95-4084-4892-9265-0e85be056584 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:02.394313 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0c016d95-4084-4892-9265-0e85be056584 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:02.395025 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0c016d95-4084-4892-9265-0e85be056584 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:02.498846 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-80b72bb9-8604-46ad-a9d8-2ffe6421329f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:02.499906 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-80b72bb9-8604-46ad-a9d8-2ffe6421329f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:02.506223 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-80b72bb9-8604-46ad-a9d8-2ffe6421329f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:02.506709 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-80b72bb9-8604-46ad-a9d8-2ffe6421329f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:02.507442 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-80b72bb9-8604-46ad-a9d8-2ffe6421329f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:02.507875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-80b72bb9-8604-46ad-a9d8-2ffe6421329f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:02.532823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0c016d95-4084-4892-9265-0e85be056584 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:02.541301 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0c016d95-4084-4892-9265-0e85be056584 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:02.542788 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0c016d95-4084-4892-9265-0e85be056584 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:02.543971 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0c016d95-4084-4892-9265-0e85be056584 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.171211 Apr 05 12:10:02.544610 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1248/2475] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:02 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:02.637494 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-80b72bb9-8604-46ad-a9d8-2ffe6421329f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:02.641005 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1108c115-f3ad-4f4c-a842-4495b69f3a4f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:02.641648 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1108c115-f3ad-4f4c-a842-4495b69f3a4f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:02.645661 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-80b72bb9-8604-46ad-a9d8-2ffe6421329f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.150715 Apr 05 12:10:02.646228 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1228/2476] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:02 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:02.648409 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1108c115-f3ad-4f4c-a842-4495b69f3a4f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:02.648856 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1108c115-f3ad-4f4c-a842-4495b69f3a4f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:02.649650 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1108c115-f3ad-4f4c-a842-4495b69f3a4f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:02.650080 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1108c115-f3ad-4f4c-a842-4495b69f3a4f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:02.780326 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1108c115-f3ad-4f4c-a842-4495b69f3a4f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:02.788616 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1108c115-f3ad-4f4c-a842-4495b69f3a4f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.151480 Apr 05 12:10:02.789186 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1249/2477] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:02 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:03.223970 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-65e509f4-56d1-45b5-8b0f-869d98dc5378 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:03.225002 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-65e509f4-56d1-45b5-8b0f-869d98dc5378 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:03.235466 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-65e509f4-56d1-45b5-8b0f-869d98dc5378 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:03.236266 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-65e509f4-56d1-45b5-8b0f-869d98dc5378 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:03.237509 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-65e509f4-56d1-45b5-8b0f-869d98dc5378 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:03.238216 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-65e509f4-56d1-45b5-8b0f-869d98dc5378 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:03.380385 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-65e509f4-56d1-45b5-8b0f-869d98dc5378 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:03.388988 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-65e509f4-56d1-45b5-8b0f-869d98dc5378 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.171417 Apr 05 12:10:03.389575 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1229/2478] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:03 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:03.562997 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-dbac9919-4899-4603-b8bf-74010b38cca8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:03.563571 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-dbac9919-4899-4603-b8bf-74010b38cca8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:03.570088 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dbac9919-4899-4603-b8bf-74010b38cca8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:03.570531 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dbac9919-4899-4603-b8bf-74010b38cca8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:03.571363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dbac9919-4899-4603-b8bf-74010b38cca8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:03.571787 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dbac9919-4899-4603-b8bf-74010b38cca8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:03.663320 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-02770e17-54c2-4710-b12b-6f022c07ef35 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:03.663815 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-02770e17-54c2-4710-b12b-6f022c07ef35 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:03.669802 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02770e17-54c2-4710-b12b-6f022c07ef35 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:03.670250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02770e17-54c2-4710-b12b-6f022c07ef35 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:03.671012 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02770e17-54c2-4710-b12b-6f022c07ef35 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:03.671446 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02770e17-54c2-4710-b12b-6f022c07ef35 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:03.717675 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-dbac9919-4899-4603-b8bf-74010b38cca8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:03.726378 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-dbac9919-4899-4603-b8bf-74010b38cca8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:03.727868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-dbac9919-4899-4603-b8bf-74010b38cca8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:03.729046 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-dbac9919-4899-4603-b8bf-74010b38cca8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.170020 Apr 05 12:10:03.729803 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1250/2479] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:03 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:03.806033 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-02770e17-54c2-4710-b12b-6f022c07ef35 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:03.806232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e4fff3b2-4420-4534-bc3a-f08a1129c3e7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:03.806683 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e4fff3b2-4420-4534-bc3a-f08a1129c3e7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:03.812650 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e4fff3b2-4420-4534-bc3a-f08a1129c3e7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:03.813099 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e4fff3b2-4420-4534-bc3a-f08a1129c3e7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:03.813855 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e4fff3b2-4420-4534-bc3a-f08a1129c3e7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:03.814113 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-02770e17-54c2-4710-b12b-6f022c07ef35 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.154847 Apr 05 12:10:03.814284 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e4fff3b2-4420-4534-bc3a-f08a1129c3e7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:03.814698 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1230/2480] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:03 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:03.947448 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e4fff3b2-4420-4534-bc3a-f08a1129c3e7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:03.955994 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e4fff3b2-4420-4534-bc3a-f08a1129c3e7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.153885 Apr 05 12:10:03.956606 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1251/2481] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:03 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:04.410437 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0e8210ca-3f0c-4a2f-ab3c-2ff6f2e7d66d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:04.411476 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0e8210ca-3f0c-4a2f-ab3c-2ff6f2e7d66d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:04.422130 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0e8210ca-3f0c-4a2f-ab3c-2ff6f2e7d66d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:04.422866 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0e8210ca-3f0c-4a2f-ab3c-2ff6f2e7d66d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:04.424291 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0e8210ca-3f0c-4a2f-ab3c-2ff6f2e7d66d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:04.425018 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0e8210ca-3f0c-4a2f-ab3c-2ff6f2e7d66d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:04.561850 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0e8210ca-3f0c-4a2f-ab3c-2ff6f2e7d66d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:04.570320 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0e8210ca-3f0c-4a2f-ab3c-2ff6f2e7d66d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.166323 Apr 05 12:10:04.570912 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1231/2482] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:04 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:04.751434 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f19a64fd-dd30-4583-86f2-4f9d99147ff0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:04.752507 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f19a64fd-dd30-4583-86f2-4f9d99147ff0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:04.762419 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f19a64fd-dd30-4583-86f2-4f9d99147ff0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:04.762871 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f19a64fd-dd30-4583-86f2-4f9d99147ff0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:04.763630 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f19a64fd-dd30-4583-86f2-4f9d99147ff0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:04.764064 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f19a64fd-dd30-4583-86f2-4f9d99147ff0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:04.830886 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7937fc4a-4818-485d-8311-6d92288d5b04 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:04.831498 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7937fc4a-4818-485d-8311-6d92288d5b04 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:04.837474 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7937fc4a-4818-485d-8311-6d92288d5b04 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:04.837961 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7937fc4a-4818-485d-8311-6d92288d5b04 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:04.838749 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7937fc4a-4818-485d-8311-6d92288d5b04 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:04.839178 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7937fc4a-4818-485d-8311-6d92288d5b04 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:04.898114 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f19a64fd-dd30-4583-86f2-4f9d99147ff0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:04.906391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f19a64fd-dd30-4583-86f2-4f9d99147ff0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:04.907871 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f19a64fd-dd30-4583-86f2-4f9d99147ff0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:04.909052 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f19a64fd-dd30-4583-86f2-4f9d99147ff0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.164657 Apr 05 12:10:04.909792 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1252/2483] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:04 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:04.972947 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-285906db-a483-48c2-8c8c-db0d97c92f9a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:04.973131 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7937fc4a-4818-485d-8311-6d92288d5b04 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:04.973571 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-285906db-a483-48c2-8c8c-db0d97c92f9a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:04.979802 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-285906db-a483-48c2-8c8c-db0d97c92f9a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:04.980278 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-285906db-a483-48c2-8c8c-db0d97c92f9a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:04.981054 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-285906db-a483-48c2-8c8c-db0d97c92f9a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:04.981210 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7937fc4a-4818-485d-8311-6d92288d5b04 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.154164 Apr 05 12:10:04.981430 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-285906db-a483-48c2-8c8c-db0d97c92f9a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:04.981915 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1232/2484] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:04 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:05.116713 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-285906db-a483-48c2-8c8c-db0d97c92f9a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:05.124776 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-285906db-a483-48c2-8c8c-db0d97c92f9a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.155700 Apr 05 12:10:05.125351 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1253/2485] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:04 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:10:05.591280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6180d13b-2977-4c59-b879-20f82db6c488 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:05.592326 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6180d13b-2977-4c59-b879-20f82db6c488 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:05.602895 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6180d13b-2977-4c59-b879-20f82db6c488 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:05.603594 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6180d13b-2977-4c59-b879-20f82db6c488 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:05.604380 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6180d13b-2977-4c59-b879-20f82db6c488 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:05.604816 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6180d13b-2977-4c59-b879-20f82db6c488 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:05.736678 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6180d13b-2977-4c59-b879-20f82db6c488 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:05.745102 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6180d13b-2977-4c59-b879-20f82db6c488 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.160177 Apr 05 12:10:05.745600 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1233/2486] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:05 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:05.931004 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-27f1f54e-7516-4af1-864a-d1fa9e0623d2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:05.931988 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-27f1f54e-7516-4af1-864a-d1fa9e0623d2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:05.939296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-27f1f54e-7516-4af1-864a-d1fa9e0623d2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:05.939790 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-27f1f54e-7516-4af1-864a-d1fa9e0623d2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:05.940664 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-27f1f54e-7516-4af1-864a-d1fa9e0623d2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:05.941145 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-27f1f54e-7516-4af1-864a-d1fa9e0623d2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:05.998803 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-88457333-83a4-4af6-8f3b-45e158e1894b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:05.999320 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-88457333-83a4-4af6-8f3b-45e158e1894b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:06.005776 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-88457333-83a4-4af6-8f3b-45e158e1894b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:06.006228 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-88457333-83a4-4af6-8f3b-45e158e1894b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:06.006980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-88457333-83a4-4af6-8f3b-45e158e1894b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:06.007413 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-88457333-83a4-4af6-8f3b-45e158e1894b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:06.077002 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-27f1f54e-7516-4af1-864a-d1fa9e0623d2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:06.085510 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-27f1f54e-7516-4af1-864a-d1fa9e0623d2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:06.087074 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-27f1f54e-7516-4af1-864a-d1fa9e0623d2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:06.088302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-27f1f54e-7516-4af1-864a-d1fa9e0623d2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.163967 Apr 05 12:10:06.088866 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1254/2487] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:05 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:06.139297 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-88457333-83a4-4af6-8f3b-45e158e1894b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:06.142766 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9d603acd-3ab0-4fb7-b81b-0c28824287a1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:06.143462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9d603acd-3ab0-4fb7-b81b-0c28824287a1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:06.147112 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-88457333-83a4-4af6-8f3b-45e158e1894b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.152314 Apr 05 12:10:06.147678 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1234/2488] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:05 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:06.149915 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9d603acd-3ab0-4fb7-b81b-0c28824287a1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:06.150430 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9d603acd-3ab0-4fb7-b81b-0c28824287a1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:06.151195 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9d603acd-3ab0-4fb7-b81b-0c28824287a1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:06.151631 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9d603acd-3ab0-4fb7-b81b-0c28824287a1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:06.291193 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9d603acd-3ab0-4fb7-b81b-0c28824287a1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:06.299278 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9d603acd-3ab0-4fb7-b81b-0c28824287a1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.160440 Apr 05 12:10:06.299828 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1255/2489] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:06 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:06.766692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-11e333dd-5dc8-4bcd-a960-b118dfc697bb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:06.767698 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-11e333dd-5dc8-4bcd-a960-b118dfc697bb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:06.777262 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-11e333dd-5dc8-4bcd-a960-b118dfc697bb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:06.777714 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-11e333dd-5dc8-4bcd-a960-b118dfc697bb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:06.778481 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-11e333dd-5dc8-4bcd-a960-b118dfc697bb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:06.778916 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-11e333dd-5dc8-4bcd-a960-b118dfc697bb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:06.916699 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-11e333dd-5dc8-4bcd-a960-b118dfc697bb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:06.924736 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-11e333dd-5dc8-4bcd-a960-b118dfc697bb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.164536 Apr 05 12:10:06.925315 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1235/2490] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:06 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:07.108337 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f180f24c-7dc1-4efe-93db-a102edcdf391 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:07.108959 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f180f24c-7dc1-4efe-93db-a102edcdf391 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:07.115774 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f180f24c-7dc1-4efe-93db-a102edcdf391 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:07.116267 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f180f24c-7dc1-4efe-93db-a102edcdf391 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:07.117032 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f180f24c-7dc1-4efe-93db-a102edcdf391 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:07.117468 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f180f24c-7dc1-4efe-93db-a102edcdf391 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:07.163542 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c6d1ccc7-4678-438c-a98c-8b87aa8a462b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:07.164240 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c6d1ccc7-4678-438c-a98c-8b87aa8a462b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:07.170572 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c6d1ccc7-4678-438c-a98c-8b87aa8a462b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:07.171019 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c6d1ccc7-4678-438c-a98c-8b87aa8a462b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:07.171891 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c6d1ccc7-4678-438c-a98c-8b87aa8a462b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:07.172358 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c6d1ccc7-4678-438c-a98c-8b87aa8a462b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:07.252529 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f180f24c-7dc1-4efe-93db-a102edcdf391 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:07.261678 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f180f24c-7dc1-4efe-93db-a102edcdf391 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:07.263230 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f180f24c-7dc1-4efe-93db-a102edcdf391 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:07.264421 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f180f24c-7dc1-4efe-93db-a102edcdf391 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.160093 Apr 05 12:10:07.264984 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1256/2491] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:07 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:07.303164 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c6d1ccc7-4678-438c-a98c-8b87aa8a462b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:07.311494 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c6d1ccc7-4678-438c-a98c-8b87aa8a462b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.151874 Apr 05 12:10:07.312098 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1236/2492] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:07 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:07.316434 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2c072ec9-7a1d-434e-8a4f-0599d35f31c7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:07.317048 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2c072ec9-7a1d-434e-8a4f-0599d35f31c7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:07.323166 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2c072ec9-7a1d-434e-8a4f-0599d35f31c7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:07.323615 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2c072ec9-7a1d-434e-8a4f-0599d35f31c7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:07.324398 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2c072ec9-7a1d-434e-8a4f-0599d35f31c7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:07.324833 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2c072ec9-7a1d-434e-8a4f-0599d35f31c7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:07.463629 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2c072ec9-7a1d-434e-8a4f-0599d35f31c7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:07.472198 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2c072ec9-7a1d-434e-8a4f-0599d35f31c7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.159201 Apr 05 12:10:07.472771 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1257/2493] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:07 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:07.942669 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ff6f8332-509c-4b43-96f4-e756b5e5289e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:07.943326 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ff6f8332-509c-4b43-96f4-e756b5e5289e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:07.950382 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff6f8332-509c-4b43-96f4-e756b5e5289e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:07.950826 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff6f8332-509c-4b43-96f4-e756b5e5289e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:07.951588 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff6f8332-509c-4b43-96f4-e756b5e5289e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:07.952025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff6f8332-509c-4b43-96f4-e756b5e5289e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:08.093613 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ff6f8332-509c-4b43-96f4-e756b5e5289e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:08.102090 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ff6f8332-509c-4b43-96f4-e756b5e5289e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.163762 Apr 05 12:10:08.102684 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1237/2494] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:07 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:08.286587 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-675ceb70-4393-4a35-a514-6ded2098fda0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:08.287543 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-675ceb70-4393-4a35-a514-6ded2098fda0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:08.298063 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-675ceb70-4393-4a35-a514-6ded2098fda0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:08.298708 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-675ceb70-4393-4a35-a514-6ded2098fda0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:08.299939 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-675ceb70-4393-4a35-a514-6ded2098fda0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:08.300703 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-675ceb70-4393-4a35-a514-6ded2098fda0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:08.329134 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c5d5268b-3219-4d1a-93ff-24adfdbf6c37 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:08.329761 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c5d5268b-3219-4d1a-93ff-24adfdbf6c37 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:08.335962 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c5d5268b-3219-4d1a-93ff-24adfdbf6c37 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:08.336462 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c5d5268b-3219-4d1a-93ff-24adfdbf6c37 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:08.337215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c5d5268b-3219-4d1a-93ff-24adfdbf6c37 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:08.337876 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c5d5268b-3219-4d1a-93ff-24adfdbf6c37 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:08.439874 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-675ceb70-4393-4a35-a514-6ded2098fda0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:08.450493 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-675ceb70-4393-4a35-a514-6ded2098fda0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:08.451976 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-675ceb70-4393-4a35-a514-6ded2098fda0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:08.453148 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-675ceb70-4393-4a35-a514-6ded2098fda0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.173099 Apr 05 12:10:08.453735 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1258/2495] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:08 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:08.470651 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c5d5268b-3219-4d1a-93ff-24adfdbf6c37 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:08.478509 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c5d5268b-3219-4d1a-93ff-24adfdbf6c37 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.153269 Apr 05 12:10:08.479096 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1238/2496] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:08 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:08.488557 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-306a96cc-2654-4a54-827a-c36abe5cf0ec tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:08.489323 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-306a96cc-2654-4a54-827a-c36abe5cf0ec tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:08.495329 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-306a96cc-2654-4a54-827a-c36abe5cf0ec tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:08.495764 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-306a96cc-2654-4a54-827a-c36abe5cf0ec tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:08.496537 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-306a96cc-2654-4a54-827a-c36abe5cf0ec tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:08.496963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-306a96cc-2654-4a54-827a-c36abe5cf0ec tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:08.630633 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-306a96cc-2654-4a54-827a-c36abe5cf0ec tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:08.639182 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-306a96cc-2654-4a54-827a-c36abe5cf0ec tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.154389 Apr 05 12:10:08.639751 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1259/2497] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:08 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:09.123621 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3a96d217-2b39-41d8-bc15-dfcb6442b81f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:09.124683 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3a96d217-2b39-41d8-bc15-dfcb6442b81f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:09.135826 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3a96d217-2b39-41d8-bc15-dfcb6442b81f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:09.136637 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3a96d217-2b39-41d8-bc15-dfcb6442b81f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:09.137898 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3a96d217-2b39-41d8-bc15-dfcb6442b81f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:09.138628 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3a96d217-2b39-41d8-bc15-dfcb6442b81f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:09.292820 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3a96d217-2b39-41d8-bc15-dfcb6442b81f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:09.301073 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3a96d217-2b39-41d8-bc15-dfcb6442b81f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.183964 Apr 05 12:10:09.301662 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1239/2498] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:09 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:09.471305 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cc27c00d-5731-4bdf-b955-5b1186ca8680 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:09.471939 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cc27c00d-5731-4bdf-b955-5b1186ca8680 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:09.478812 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cc27c00d-5731-4bdf-b955-5b1186ca8680 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:09.479273 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cc27c00d-5731-4bdf-b955-5b1186ca8680 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:09.480187 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cc27c00d-5731-4bdf-b955-5b1186ca8680 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:09.480672 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cc27c00d-5731-4bdf-b955-5b1186ca8680 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:09.496300 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ebdd2b20-08b5-4ae7-89bd-eadf108946ea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:09.497936 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ebdd2b20-08b5-4ae7-89bd-eadf108946ea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:09.505659 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ebdd2b20-08b5-4ae7-89bd-eadf108946ea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:09.506075 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ebdd2b20-08b5-4ae7-89bd-eadf108946ea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:09.507058 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ebdd2b20-08b5-4ae7-89bd-eadf108946ea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:09.507678 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ebdd2b20-08b5-4ae7-89bd-eadf108946ea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:09.632137 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cc27c00d-5731-4bdf-b955-5b1186ca8680 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:09.641300 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cc27c00d-5731-4bdf-b955-5b1186ca8680 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:09.642901 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cc27c00d-5731-4bdf-b955-5b1186ca8680 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:09.644105 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cc27c00d-5731-4bdf-b955-5b1186ca8680 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.176918 Apr 05 12:10:09.644790 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1260/2499] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:09 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:09.656422 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d6343d12-47b9-4127-b648-1b3090111095 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:09.659563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ebdd2b20-08b5-4ae7-89bd-eadf108946ea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:09.660406 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d6343d12-47b9-4127-b648-1b3090111095 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:09.666191 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d6343d12-47b9-4127-b648-1b3090111095 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:09.666627 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d6343d12-47b9-4127-b648-1b3090111095 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:09.667376 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d6343d12-47b9-4127-b648-1b3090111095 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:09.667478 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ebdd2b20-08b5-4ae7-89bd-eadf108946ea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.175131 Apr 05 12:10:09.667801 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d6343d12-47b9-4127-b648-1b3090111095 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:09.667987 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1240/2500] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:09 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:10:09.798318 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d6343d12-47b9-4127-b648-1b3090111095 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:09.806088 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d6343d12-47b9-4127-b648-1b3090111095 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.153440 Apr 05 12:10:09.806712 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1261/2501] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:09 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:10:10.322618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-97b066ea-6670-4fee-ae7e-245e80a9b378 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:10.323221 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-97b066ea-6670-4fee-ae7e-245e80a9b378 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:10.332480 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-97b066ea-6670-4fee-ae7e-245e80a9b378 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:10.332957 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-97b066ea-6670-4fee-ae7e-245e80a9b378 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:10.333724 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-97b066ea-6670-4fee-ae7e-245e80a9b378 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:10.334159 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-97b066ea-6670-4fee-ae7e-245e80a9b378 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:10.475697 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-97b066ea-6670-4fee-ae7e-245e80a9b378 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:10.487283 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-97b066ea-6670-4fee-ae7e-245e80a9b378 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.170979 Apr 05 12:10:10.487830 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1241/2502] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:10 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:10.663247 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-90f6d10b-98b5-4baa-8332-3046cbe8a3b7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:10.663805 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-90f6d10b-98b5-4baa-8332-3046cbe8a3b7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:10.671767 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90f6d10b-98b5-4baa-8332-3046cbe8a3b7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:10.672604 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90f6d10b-98b5-4baa-8332-3046cbe8a3b7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:10.673744 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90f6d10b-98b5-4baa-8332-3046cbe8a3b7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:10.674425 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90f6d10b-98b5-4baa-8332-3046cbe8a3b7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:10.685416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a2c54ee2-e281-47ce-ba28-0d36943a19ab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:10.686025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a2c54ee2-e281-47ce-ba28-0d36943a19ab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:10.692410 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a2c54ee2-e281-47ce-ba28-0d36943a19ab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:10.692855 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a2c54ee2-e281-47ce-ba28-0d36943a19ab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:10.693611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a2c54ee2-e281-47ce-ba28-0d36943a19ab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:10.694040 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a2c54ee2-e281-47ce-ba28-0d36943a19ab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:10.812062 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-90f6d10b-98b5-4baa-8332-3046cbe8a3b7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:10.820697 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-90f6d10b-98b5-4baa-8332-3046cbe8a3b7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:10.822271 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-90f6d10b-98b5-4baa-8332-3046cbe8a3b7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:10.823434 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-90f6d10b-98b5-4baa-8332-3046cbe8a3b7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.164323 Apr 05 12:10:10.827684 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1262/2503] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:10 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:10.828572 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e3bd99c7-275e-4c2d-b9e2-5e87de6101ff tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:10.829184 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e3bd99c7-275e-4c2d-b9e2-5e87de6101ff tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:10.831168 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a2c54ee2-e281-47ce-ba28-0d36943a19ab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:10.835054 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e3bd99c7-275e-4c2d-b9e2-5e87de6101ff tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:10.835523 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e3bd99c7-275e-4c2d-b9e2-5e87de6101ff tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:10.836300 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e3bd99c7-275e-4c2d-b9e2-5e87de6101ff tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:10.836856 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e3bd99c7-275e-4c2d-b9e2-5e87de6101ff tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:10.838867 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a2c54ee2-e281-47ce-ba28-0d36943a19ab tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.157715 Apr 05 12:10:10.839435 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1242/2504] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:10 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:10.973590 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e3bd99c7-275e-4c2d-b9e2-5e87de6101ff tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:10.981554 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e3bd99c7-275e-4c2d-b9e2-5e87de6101ff tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.156580 Apr 05 12:10:10.982095 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1263/2505] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:10 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:11.508666 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9112f9ca-1bfa-4f3f-821d-2279352fdd13 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:11.509605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9112f9ca-1bfa-4f3f-821d-2279352fdd13 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:11.516315 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9112f9ca-1bfa-4f3f-821d-2279352fdd13 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:11.516759 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9112f9ca-1bfa-4f3f-821d-2279352fdd13 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:11.517540 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9112f9ca-1bfa-4f3f-821d-2279352fdd13 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:11.517965 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9112f9ca-1bfa-4f3f-821d-2279352fdd13 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:11.656300 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9112f9ca-1bfa-4f3f-821d-2279352fdd13 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:11.664774 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9112f9ca-1bfa-4f3f-821d-2279352fdd13 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.162742 Apr 05 12:10:11.665354 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1243/2506] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:11 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:11.845995 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-283f9c75-dfa1-498a-a367-8a415ba22414 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:11.846973 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-283f9c75-dfa1-498a-a367-8a415ba22414 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:11.856320 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-283f9c75-dfa1-498a-a367-8a415ba22414 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:11.856768 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-283f9c75-dfa1-498a-a367-8a415ba22414 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:11.857529 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-283f9c75-dfa1-498a-a367-8a415ba22414 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:11.857810 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-639eff52-a639-4ef5-870c-160b9ee3b8a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:11.857961 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-283f9c75-dfa1-498a-a367-8a415ba22414 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:11.858423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-639eff52-a639-4ef5-870c-160b9ee3b8a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:11.864534 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-639eff52-a639-4ef5-870c-160b9ee3b8a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:11.864980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-639eff52-a639-4ef5-870c-160b9ee3b8a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:11.865728 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-639eff52-a639-4ef5-870c-160b9ee3b8a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:11.866152 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-639eff52-a639-4ef5-870c-160b9ee3b8a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:12.009893 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-639eff52-a639-4ef5-870c-160b9ee3b8a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:12.012322 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-283f9c75-dfa1-498a-a367-8a415ba22414 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:12.017745 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-639eff52-a639-4ef5-870c-160b9ee3b8a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.163861 Apr 05 12:10:12.018329 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1244/2507] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:11 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:12.020642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-283f9c75-dfa1-498a-a367-8a415ba22414 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:12.022124 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-283f9c75-dfa1-498a-a367-8a415ba22414 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:12.022915 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f2b49a67-084c-4c1f-81a5-f5db2500ffe0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:12.023270 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-283f9c75-dfa1-498a-a367-8a415ba22414 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.183988 Apr 05 12:10:12.023506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f2b49a67-084c-4c1f-81a5-f5db2500ffe0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:12.028355 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1264/2508] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:11 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:12.029397 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f2b49a67-084c-4c1f-81a5-f5db2500ffe0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:12.029847 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f2b49a67-084c-4c1f-81a5-f5db2500ffe0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:12.030599 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f2b49a67-084c-4c1f-81a5-f5db2500ffe0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:12.031030 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f2b49a67-084c-4c1f-81a5-f5db2500ffe0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:12.161641 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f2b49a67-084c-4c1f-81a5-f5db2500ffe0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:12.169536 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f2b49a67-084c-4c1f-81a5-f5db2500ffe0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.150266 Apr 05 12:10:12.170109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1245/2509] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:12 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:12.687186 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6c01a7e6-df7f-4d34-ba42-473fb47dbef5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:12.688175 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6c01a7e6-df7f-4d34-ba42-473fb47dbef5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:12.698219 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6c01a7e6-df7f-4d34-ba42-473fb47dbef5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:12.699077 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6c01a7e6-df7f-4d34-ba42-473fb47dbef5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:12.700384 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6c01a7e6-df7f-4d34-ba42-473fb47dbef5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:12.701100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6c01a7e6-df7f-4d34-ba42-473fb47dbef5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:12.851286 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6c01a7e6-df7f-4d34-ba42-473fb47dbef5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:12.864191 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6c01a7e6-df7f-4d34-ba42-473fb47dbef5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.183527 Apr 05 12:10:12.864989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1265/2510] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:12 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:13.039430 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f82f5c97-bc4e-44b2-b45d-7a31011b151d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:13.040489 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f82f5c97-bc4e-44b2-b45d-7a31011b151d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:13.045769 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ee2fc9c2-3e4c-43d0-86f3-8651340f9453 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:13.045769 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ee2fc9c2-3e4c-43d0-86f3-8651340f9453 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:13.047630 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f82f5c97-bc4e-44b2-b45d-7a31011b151d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:13.048101 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f82f5c97-bc4e-44b2-b45d-7a31011b151d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:13.048926 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f82f5c97-bc4e-44b2-b45d-7a31011b151d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:13.049365 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f82f5c97-bc4e-44b2-b45d-7a31011b151d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:13.051469 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ee2fc9c2-3e4c-43d0-86f3-8651340f9453 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:13.052059 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ee2fc9c2-3e4c-43d0-86f3-8651340f9453 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:13.052841 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ee2fc9c2-3e4c-43d0-86f3-8651340f9453 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:13.053277 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ee2fc9c2-3e4c-43d0-86f3-8651340f9453 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:13.183575 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f82f5c97-bc4e-44b2-b45d-7a31011b151d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:13.185826 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ee2fc9c2-3e4c-43d0-86f3-8651340f9453 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:13.191684 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f82f5c97-bc4e-44b2-b45d-7a31011b151d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.158945 Apr 05 12:10:13.192288 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1246/2511] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:13 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:13.194751 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ee2fc9c2-3e4c-43d0-86f3-8651340f9453 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:13.196249 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ee2fc9c2-3e4c-43d0-86f3-8651340f9453 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:13.196621 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bbf72303-71db-4ce0-b820-b7d3bdc526e2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:13.197218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bbf72303-71db-4ce0-b820-b7d3bdc526e2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:13.197385 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ee2fc9c2-3e4c-43d0-86f3-8651340f9453 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.158072 Apr 05 12:10:13.198043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1266/2512] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:13 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:13.202796 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bbf72303-71db-4ce0-b820-b7d3bdc526e2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:13.203313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bbf72303-71db-4ce0-b820-b7d3bdc526e2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:13.204140 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bbf72303-71db-4ce0-b820-b7d3bdc526e2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:13.204571 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bbf72303-71db-4ce0-b820-b7d3bdc526e2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:13.340522 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-bbf72303-71db-4ce0-b820-b7d3bdc526e2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:13.348788 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bbf72303-71db-4ce0-b820-b7d3bdc526e2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.155530 Apr 05 12:10:13.349348 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1247/2513] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:13 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:13.886335 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1901bba9-cb9d-4c0f-ad9d-35855bf39e64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:13.886976 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1901bba9-cb9d-4c0f-ad9d-35855bf39e64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:13.894268 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1901bba9-cb9d-4c0f-ad9d-35855bf39e64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:13.894766 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1901bba9-cb9d-4c0f-ad9d-35855bf39e64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:13.895603 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1901bba9-cb9d-4c0f-ad9d-35855bf39e64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:13.896105 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1901bba9-cb9d-4c0f-ad9d-35855bf39e64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:14.052339 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1901bba9-cb9d-4c0f-ad9d-35855bf39e64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:14.060927 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1901bba9-cb9d-4c0f-ad9d-35855bf39e64 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.180082 Apr 05 12:10:14.061492 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1267/2514] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:13 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:14.213678 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8c48cd9b-4526-4000-8aa1-28663c90bfb5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:14.214251 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8c48cd9b-4526-4000-8aa1-28663c90bfb5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:14.217271 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4fa6c8f0-6063-4d60-87fc-7ff22da65f83 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:14.218008 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4fa6c8f0-6063-4d60-87fc-7ff22da65f83 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:14.221258 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c48cd9b-4526-4000-8aa1-28663c90bfb5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:14.221730 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c48cd9b-4526-4000-8aa1-28663c90bfb5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:14.222538 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c48cd9b-4526-4000-8aa1-28663c90bfb5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:14.222966 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c48cd9b-4526-4000-8aa1-28663c90bfb5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:14.224338 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4fa6c8f0-6063-4d60-87fc-7ff22da65f83 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:14.224783 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4fa6c8f0-6063-4d60-87fc-7ff22da65f83 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:14.225504 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4fa6c8f0-6063-4d60-87fc-7ff22da65f83 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:14.225953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4fa6c8f0-6063-4d60-87fc-7ff22da65f83 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:14.355948 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8c48cd9b-4526-4000-8aa1-28663c90bfb5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:14.357852 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4fa6c8f0-6063-4d60-87fc-7ff22da65f83 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:14.364337 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8c48cd9b-4526-4000-8aa1-28663c90bfb5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.157373 Apr 05 12:10:14.364938 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1248/2515] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:14 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:14.366459 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4fa6c8f0-6063-4d60-87fc-7ff22da65f83 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:14.367938 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4fa6c8f0-6063-4d60-87fc-7ff22da65f83 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:14.369129 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4fa6c8f0-6063-4d60-87fc-7ff22da65f83 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.156235 Apr 05 12:10:14.369379 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-96101d5f-8e3d-4421-9265-8396178ca1af tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:14.369994 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1268/2516] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:14 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:14.370171 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-96101d5f-8e3d-4421-9265-8396178ca1af tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:14.375775 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-96101d5f-8e3d-4421-9265-8396178ca1af tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:14.376242 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-96101d5f-8e3d-4421-9265-8396178ca1af tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:14.376993 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-96101d5f-8e3d-4421-9265-8396178ca1af tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:14.377416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-96101d5f-8e3d-4421-9265-8396178ca1af tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:14.513168 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-96101d5f-8e3d-4421-9265-8396178ca1af tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:14.525218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-96101d5f-8e3d-4421-9265-8396178ca1af tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.159017 Apr 05 12:10:14.526002 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1249/2517] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:14 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:15.078635 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a1303427-961a-4edb-8023-33947b1125ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:15.079286 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a1303427-961a-4edb-8023-33947b1125ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:15.086278 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a1303427-961a-4edb-8023-33947b1125ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:15.086728 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a1303427-961a-4edb-8023-33947b1125ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:15.087484 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a1303427-961a-4edb-8023-33947b1125ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:15.087911 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a1303427-961a-4edb-8023-33947b1125ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:15.224357 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a1303427-961a-4edb-8023-33947b1125ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:15.234077 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a1303427-961a-4edb-8023-33947b1125ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.159426 Apr 05 12:10:15.234648 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1269/2518] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:15 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:15.383473 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-792311e7-9aee-4469-adf3-f2585653755f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:15.384244 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-792311e7-9aee-4469-adf3-f2585653755f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:15.387747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b121bf74-d1c8-4e99-994d-8242d7f95747 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:15.388413 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b121bf74-d1c8-4e99-994d-8242d7f95747 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:15.392106 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-792311e7-9aee-4469-adf3-f2585653755f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:15.392568 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-792311e7-9aee-4469-adf3-f2585653755f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:15.393332 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-792311e7-9aee-4469-adf3-f2585653755f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:15.393829 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-792311e7-9aee-4469-adf3-f2585653755f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:15.394443 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b121bf74-d1c8-4e99-994d-8242d7f95747 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:15.394877 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b121bf74-d1c8-4e99-994d-8242d7f95747 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:15.395646 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b121bf74-d1c8-4e99-994d-8242d7f95747 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:15.396113 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b121bf74-d1c8-4e99-994d-8242d7f95747 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:15.532917 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b121bf74-d1c8-4e99-994d-8242d7f95747 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:15.534143 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-792311e7-9aee-4469-adf3-f2585653755f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:15.541474 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b121bf74-d1c8-4e99-994d-8242d7f95747 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:15.542128 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-792311e7-9aee-4469-adf3-f2585653755f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.162983 Apr 05 12:10:15.542704 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1250/2519] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:15 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:15.542957 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b121bf74-d1c8-4e99-994d-8242d7f95747 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:15.544152 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b121bf74-d1c8-4e99-994d-8242d7f95747 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.160340 Apr 05 12:10:15.545105 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1270/2520] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:15 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:15.549572 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1ffab1a3-5570-4625-88dc-c1f058dcf239 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:15.550179 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1ffab1a3-5570-4625-88dc-c1f058dcf239 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:15.555932 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ffab1a3-5570-4625-88dc-c1f058dcf239 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:15.556414 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ffab1a3-5570-4625-88dc-c1f058dcf239 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:15.557199 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ffab1a3-5570-4625-88dc-c1f058dcf239 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:15.557628 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ffab1a3-5570-4625-88dc-c1f058dcf239 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:15.704719 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1ffab1a3-5570-4625-88dc-c1f058dcf239 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:15.713570 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1ffab1a3-5570-4625-88dc-c1f058dcf239 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.167551 Apr 05 12:10:15.714150 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1251/2521] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:15 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:10:16.251603 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f27a158a-9603-4f84-9c7f-7a63dba53ab4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:16.252295 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f27a158a-9603-4f84-9c7f-7a63dba53ab4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:16.259394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f27a158a-9603-4f84-9c7f-7a63dba53ab4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:16.259850 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f27a158a-9603-4f84-9c7f-7a63dba53ab4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:16.260688 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f27a158a-9603-4f84-9c7f-7a63dba53ab4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:16.261128 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f27a158a-9603-4f84-9c7f-7a63dba53ab4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:16.412770 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f27a158a-9603-4f84-9c7f-7a63dba53ab4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:16.421082 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f27a158a-9603-4f84-9c7f-7a63dba53ab4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.173379 Apr 05 12:10:16.421671 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1271/2522] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:16 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:16.569946 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c5375157-717a-454a-a9f8-642dcd847436 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:16.570840 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e40c5c00-2ab8-4e8b-9e85-8b904bbf3bec tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:16.571023 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c5375157-717a-454a-a9f8-642dcd847436 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:16.571355 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e40c5c00-2ab8-4e8b-9e85-8b904bbf3bec tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:16.581587 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c5375157-717a-454a-a9f8-642dcd847436 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:16.581883 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e40c5c00-2ab8-4e8b-9e85-8b904bbf3bec tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:16.582334 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c5375157-717a-454a-a9f8-642dcd847436 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:16.582607 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e40c5c00-2ab8-4e8b-9e85-8b904bbf3bec tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:16.583591 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c5375157-717a-454a-a9f8-642dcd847436 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:16.583842 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e40c5c00-2ab8-4e8b-9e85-8b904bbf3bec tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:16.584405 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c5375157-717a-454a-a9f8-642dcd847436 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:16.584652 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e40c5c00-2ab8-4e8b-9e85-8b904bbf3bec tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:16.720389 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c5375157-717a-454a-a9f8-642dcd847436 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:16.720625 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e40c5c00-2ab8-4e8b-9e85-8b904bbf3bec tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:16.728865 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e40c5c00-2ab8-4e8b-9e85-8b904bbf3bec tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.164745 Apr 05 12:10:16.729168 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c5375157-717a-454a-a9f8-642dcd847436 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:16.729552 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1272/2523] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:16 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:16.730727 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c5375157-717a-454a-a9f8-642dcd847436 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:16.731829 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c5375157-717a-454a-a9f8-642dcd847436 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.168588 Apr 05 12:10:16.732596 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1252/2524] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:16 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:16.734316 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0a9222ee-af08-4ef0-a988-948b990519c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:16.734952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0a9222ee-af08-4ef0-a988-948b990519c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:16.740993 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0a9222ee-af08-4ef0-a988-948b990519c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:16.741413 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0a9222ee-af08-4ef0-a988-948b990519c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:16.742170 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0a9222ee-af08-4ef0-a988-948b990519c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:16.742662 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0a9222ee-af08-4ef0-a988-948b990519c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:16.881056 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0a9222ee-af08-4ef0-a988-948b990519c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:16.889617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0a9222ee-af08-4ef0-a988-948b990519c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.159163 Apr 05 12:10:16.890194 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1273/2525] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:16 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:17.439619 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5d916f17-3a2b-4f9e-b888-f94cd412f2b4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:17.440348 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5d916f17-3a2b-4f9e-b888-f94cd412f2b4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:17.447937 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d916f17-3a2b-4f9e-b888-f94cd412f2b4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:17.448413 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d916f17-3a2b-4f9e-b888-f94cd412f2b4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:17.449738 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d916f17-3a2b-4f9e-b888-f94cd412f2b4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:17.450667 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d916f17-3a2b-4f9e-b888-f94cd412f2b4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:17.607805 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5d916f17-3a2b-4f9e-b888-f94cd412f2b4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:17.619553 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5d916f17-3a2b-4f9e-b888-f94cd412f2b4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.184371 Apr 05 12:10:17.620389 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1253/2526] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:17 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:17.750037 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2fcdf996-633c-45ce-84a8-529f532768b7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:17.750750 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2fcdf996-633c-45ce-84a8-529f532768b7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:17.752834 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9722ae67-b1ea-4972-83ff-ab17bc4e7841 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:17.753714 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9722ae67-b1ea-4972-83ff-ab17bc4e7841 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:17.759368 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2fcdf996-633c-45ce-84a8-529f532768b7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:17.759829 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2fcdf996-633c-45ce-84a8-529f532768b7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:17.760934 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2fcdf996-633c-45ce-84a8-529f532768b7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:17.761365 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2fcdf996-633c-45ce-84a8-529f532768b7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:17.761490 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9722ae67-b1ea-4972-83ff-ab17bc4e7841 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:17.761956 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9722ae67-b1ea-4972-83ff-ab17bc4e7841 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:17.762749 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9722ae67-b1ea-4972-83ff-ab17bc4e7841 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:17.763188 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9722ae67-b1ea-4972-83ff-ab17bc4e7841 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:17.897450 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9722ae67-b1ea-4972-83ff-ab17bc4e7841 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:17.897642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2fcdf996-633c-45ce-84a8-529f532768b7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:17.905928 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2fcdf996-633c-45ce-84a8-529f532768b7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.162329 Apr 05 12:10:17.906223 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9722ae67-b1ea-4972-83ff-ab17bc4e7841 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:17.906491 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1274/2527] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:17 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:17.907554 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9722ae67-b1ea-4972-83ff-ab17bc4e7841 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:17.908732 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9722ae67-b1ea-4972-83ff-ab17bc4e7841 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.161830 Apr 05 12:10:17.909423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1254/2528] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:17 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:17.921121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-eec56042-a32b-4c1e-b464-8e5fa824c91a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:17.921728 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-eec56042-a32b-4c1e-b464-8e5fa824c91a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:17.928055 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eec56042-a32b-4c1e-b464-8e5fa824c91a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:17.928532 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eec56042-a32b-4c1e-b464-8e5fa824c91a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:17.929304 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eec56042-a32b-4c1e-b464-8e5fa824c91a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:17.929739 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eec56042-a32b-4c1e-b464-8e5fa824c91a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:18.071391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-eec56042-a32b-4c1e-b464-8e5fa824c91a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:18.079490 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-eec56042-a32b-4c1e-b464-8e5fa824c91a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.172045 Apr 05 12:10:18.080060 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1275/2529] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:17 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:18.646764 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-58040a6a-291c-4306-bebb-cd296047f9c3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:18.647775 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-58040a6a-291c-4306-bebb-cd296047f9c3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:18.655628 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-58040a6a-291c-4306-bebb-cd296047f9c3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:18.656110 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-58040a6a-291c-4306-bebb-cd296047f9c3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:18.656853 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-58040a6a-291c-4306-bebb-cd296047f9c3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:18.657285 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-58040a6a-291c-4306-bebb-cd296047f9c3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:18.793656 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-58040a6a-291c-4306-bebb-cd296047f9c3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:18.801537 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-58040a6a-291c-4306-bebb-cd296047f9c3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.161624 Apr 05 12:10:18.802102 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1255/2530] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:18 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:18.928036 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5140d23e-3abc-4eb7-8cbb-101849ff06d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:18.929160 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5140d23e-3abc-4eb7-8cbb-101849ff06d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:18.930901 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2a734128-36c7-4c78-afd8-731021a97b57 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:18.931911 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2a734128-36c7-4c78-afd8-731021a97b57 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:18.937338 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5140d23e-3abc-4eb7-8cbb-101849ff06d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:18.937783 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5140d23e-3abc-4eb7-8cbb-101849ff06d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:18.938532 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5140d23e-3abc-4eb7-8cbb-101849ff06d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:18.938678 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2a734128-36c7-4c78-afd8-731021a97b57 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:18.938955 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5140d23e-3abc-4eb7-8cbb-101849ff06d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:18.939103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2a734128-36c7-4c78-afd8-731021a97b57 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:18.939818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2a734128-36c7-4c78-afd8-731021a97b57 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:18.940299 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2a734128-36c7-4c78-afd8-731021a97b57 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:19.072454 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5140d23e-3abc-4eb7-8cbb-101849ff06d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:19.073621 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2a734128-36c7-4c78-afd8-731021a97b57 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:19.080615 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5140d23e-3abc-4eb7-8cbb-101849ff06d1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.159352 Apr 05 12:10:19.081197 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1276/2531] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:18 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:19.081873 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2a734128-36c7-4c78-afd8-731021a97b57 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:19.083359 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2a734128-36c7-4c78-afd8-731021a97b57 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:19.084533 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2a734128-36c7-4c78-afd8-731021a97b57 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.160236 Apr 05 12:10:19.085078 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1256/2532] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:18 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:19.096623 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a248e30a-a20f-4296-810d-b6cb54d05b39 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:19.097221 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a248e30a-a20f-4296-810d-b6cb54d05b39 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:19.102932 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a248e30a-a20f-4296-810d-b6cb54d05b39 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:19.103370 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a248e30a-a20f-4296-810d-b6cb54d05b39 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:19.104138 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a248e30a-a20f-4296-810d-b6cb54d05b39 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:19.104630 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a248e30a-a20f-4296-810d-b6cb54d05b39 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:19.248106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a248e30a-a20f-4296-810d-b6cb54d05b39 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:19.257084 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a248e30a-a20f-4296-810d-b6cb54d05b39 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.164078 Apr 05 12:10:19.257658 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1277/2533] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:19 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:19.822772 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-62a6e312-9a1c-4865-9886-0b029f03bcb5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:19.823812 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-62a6e312-9a1c-4865-9886-0b029f03bcb5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:19.831886 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-62a6e312-9a1c-4865-9886-0b029f03bcb5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:19.832479 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-62a6e312-9a1c-4865-9886-0b029f03bcb5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:19.833428 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-62a6e312-9a1c-4865-9886-0b029f03bcb5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:19.833968 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-62a6e312-9a1c-4865-9886-0b029f03bcb5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:19.969965 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-62a6e312-9a1c-4865-9886-0b029f03bcb5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:19.978433 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-62a6e312-9a1c-4865-9886-0b029f03bcb5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.162151 Apr 05 12:10:19.979018 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1257/2534] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:19 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:20.101952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f8e40c6f-898a-4338-98de-5e4e8a362e02 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:20.102732 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f8e40c6f-898a-4338-98de-5e4e8a362e02 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:20.105918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b67ecaa1-5589-4cdd-8454-090328046193 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:20.106926 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b67ecaa1-5589-4cdd-8454-090328046193 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:20.113696 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f8e40c6f-898a-4338-98de-5e4e8a362e02 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:20.114485 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f8e40c6f-898a-4338-98de-5e4e8a362e02 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:20.115755 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f8e40c6f-898a-4338-98de-5e4e8a362e02 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:20.116591 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f8e40c6f-898a-4338-98de-5e4e8a362e02 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:20.117187 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b67ecaa1-5589-4cdd-8454-090328046193 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:20.117944 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b67ecaa1-5589-4cdd-8454-090328046193 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:20.119200 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b67ecaa1-5589-4cdd-8454-090328046193 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:20.119927 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b67ecaa1-5589-4cdd-8454-090328046193 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:20.250160 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b67ecaa1-5589-4cdd-8454-090328046193 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:20.250365 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f8e40c6f-898a-4338-98de-5e4e8a362e02 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:20.258669 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f8e40c6f-898a-4338-98de-5e4e8a362e02 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.163335 Apr 05 12:10:20.259051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b67ecaa1-5589-4cdd-8454-090328046193 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:20.259907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1278/2535] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:20 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:20.260590 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b67ecaa1-5589-4cdd-8454-090328046193 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:20.261786 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b67ecaa1-5589-4cdd-8454-090328046193 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.162297 Apr 05 12:10:20.262368 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1258/2536] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:20 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:20.274287 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-66b3ac90-7ecf-495f-b9b7-10a684cb671b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:20.274963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-66b3ac90-7ecf-495f-b9b7-10a684cb671b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:20.283087 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-66b3ac90-7ecf-495f-b9b7-10a684cb671b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:20.283087 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-66b3ac90-7ecf-495f-b9b7-10a684cb671b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:20.283087 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-66b3ac90-7ecf-495f-b9b7-10a684cb671b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:20.283358 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-66b3ac90-7ecf-495f-b9b7-10a684cb671b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:20.417567 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-66b3ac90-7ecf-495f-b9b7-10a684cb671b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:20.425550 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-66b3ac90-7ecf-495f-b9b7-10a684cb671b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.155016 Apr 05 12:10:20.426110 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1279/2537] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:20 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:20.999942 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-dab14fdc-8291-421d-abe2-1f5411571ff8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:21.001051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-dab14fdc-8291-421d-abe2-1f5411571ff8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:21.012165 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dab14fdc-8291-421d-abe2-1f5411571ff8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:21.012817 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dab14fdc-8291-421d-abe2-1f5411571ff8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:21.014064 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dab14fdc-8291-421d-abe2-1f5411571ff8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:21.014785 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dab14fdc-8291-421d-abe2-1f5411571ff8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:21.156860 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-dab14fdc-8291-421d-abe2-1f5411571ff8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:21.168884 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-dab14fdc-8291-421d-abe2-1f5411571ff8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.175136 Apr 05 12:10:21.169646 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1259/2538] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:20 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:21.279829 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-40009655-a17c-4fd5-9445-faca0855bbc3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:21.280730 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-40009655-a17c-4fd5-9445-faca0855bbc3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:21.283984 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bcd2c95c-b53a-420e-8884-ff6869b1c321 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:21.285219 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bcd2c95c-b53a-420e-8884-ff6869b1c321 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:21.291394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-40009655-a17c-4fd5-9445-faca0855bbc3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:21.292303 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-40009655-a17c-4fd5-9445-faca0855bbc3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:21.293058 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-40009655-a17c-4fd5-9445-faca0855bbc3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:21.293485 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-40009655-a17c-4fd5-9445-faca0855bbc3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:21.294208 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bcd2c95c-b53a-420e-8884-ff6869b1c321 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:21.294646 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bcd2c95c-b53a-420e-8884-ff6869b1c321 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:21.295411 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bcd2c95c-b53a-420e-8884-ff6869b1c321 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:21.295844 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bcd2c95c-b53a-420e-8884-ff6869b1c321 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:21.427662 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-bcd2c95c-b53a-420e-8884-ff6869b1c321 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:21.427870 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-40009655-a17c-4fd5-9445-faca0855bbc3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:21.435757 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-40009655-a17c-4fd5-9445-faca0855bbc3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.162421 Apr 05 12:10:21.436425 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-bcd2c95c-b53a-420e-8884-ff6869b1c321 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:21.442786 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-bcd2c95c-b53a-420e-8884-ff6869b1c321 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:21.443004 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1280/2539] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:21 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:21.443132 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bcd2c95c-b53a-420e-8884-ff6869b1c321 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.161796 Apr 05 12:10:21.443224 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b99bb5b2-c143-4f38-877a-4d70cd343639 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:21.443319 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b99bb5b2-c143-4f38-877a-4d70cd343639 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:21.444557 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1260/2540] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:21 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:21.449404 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b99bb5b2-c143-4f38-877a-4d70cd343639 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:21.449850 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b99bb5b2-c143-4f38-877a-4d70cd343639 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:21.450596 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b99bb5b2-c143-4f38-877a-4d70cd343639 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:21.451018 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b99bb5b2-c143-4f38-877a-4d70cd343639 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:21.585464 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b99bb5b2-c143-4f38-877a-4d70cd343639 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:21.594503 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b99bb5b2-c143-4f38-877a-4d70cd343639 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.155443 Apr 05 12:10:21.595064 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1281/2541] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:21 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:22.190183 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a1a82e01-73a7-4402-b512-929b3502ba7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:22.190952 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a1a82e01-73a7-4402-b512-929b3502ba7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:22.200677 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a1a82e01-73a7-4402-b512-929b3502ba7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:22.201119 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a1a82e01-73a7-4402-b512-929b3502ba7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:22.201870 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a1a82e01-73a7-4402-b512-929b3502ba7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:22.202296 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a1a82e01-73a7-4402-b512-929b3502ba7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:22.351484 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a1a82e01-73a7-4402-b512-929b3502ba7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:22.363475 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a1a82e01-73a7-4402-b512-929b3502ba7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.179674 Apr 05 12:10:22.364396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1261/2542] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:22 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:22.455088 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7da3b849-360c-4a42-84b1-3b783b9c3186 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:22.455687 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7da3b849-360c-4a42-84b1-3b783b9c3186 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:22.457254 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-44a25285-207b-49aa-b4a5-30c009c7dd06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:22.457868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-44a25285-207b-49aa-b4a5-30c009c7dd06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:22.462573 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7da3b849-360c-4a42-84b1-3b783b9c3186 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:22.463015 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7da3b849-360c-4a42-84b1-3b783b9c3186 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:22.463785 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7da3b849-360c-4a42-84b1-3b783b9c3186 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:22.464012 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-44a25285-207b-49aa-b4a5-30c009c7dd06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:22.464251 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7da3b849-360c-4a42-84b1-3b783b9c3186 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:22.464487 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-44a25285-207b-49aa-b4a5-30c009c7dd06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:22.465244 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-44a25285-207b-49aa-b4a5-30c009c7dd06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:22.465794 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-44a25285-207b-49aa-b4a5-30c009c7dd06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:22.598140 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-44a25285-207b-49aa-b4a5-30c009c7dd06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:22.606517 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-44a25285-207b-49aa-b4a5-30c009c7dd06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:22.608017 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-44a25285-207b-49aa-b4a5-30c009c7dd06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:22.608466 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7da3b849-360c-4a42-84b1-3b783b9c3186 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:22.609221 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-44a25285-207b-49aa-b4a5-30c009c7dd06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.155855 Apr 05 12:10:22.609868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1262/2543] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:22 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:22.614263 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-69317afb-ade4-4158-981b-29ae0894cb3b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:22.614874 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-69317afb-ade4-4158-981b-29ae0894cb3b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:22.616949 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7da3b849-360c-4a42-84b1-3b783b9c3186 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.166124 Apr 05 12:10:22.617769 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1282/2544] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:22 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:22.620648 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-69317afb-ade4-4158-981b-29ae0894cb3b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:22.621097 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-69317afb-ade4-4158-981b-29ae0894cb3b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:22.621981 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-69317afb-ade4-4158-981b-29ae0894cb3b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:22.622418 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-69317afb-ade4-4158-981b-29ae0894cb3b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:22.757454 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-69317afb-ade4-4158-981b-29ae0894cb3b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:22.766207 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-69317afb-ade4-4158-981b-29ae0894cb3b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.155380 Apr 05 12:10:22.766794 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1263/2545] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:22 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:23.385252 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-abc1e8b7-648b-49ce-8f45-3f102a84bff2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:23.386093 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-abc1e8b7-648b-49ce-8f45-3f102a84bff2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:23.396365 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-abc1e8b7-648b-49ce-8f45-3f102a84bff2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:23.397100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-abc1e8b7-648b-49ce-8f45-3f102a84bff2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:23.398334 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-abc1e8b7-648b-49ce-8f45-3f102a84bff2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:23.399055 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-abc1e8b7-648b-49ce-8f45-3f102a84bff2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:23.535277 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-abc1e8b7-648b-49ce-8f45-3f102a84bff2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:23.543175 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-abc1e8b7-648b-49ce-8f45-3f102a84bff2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.164997 Apr 05 12:10:23.543882 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1283/2546] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:23 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:23.627679 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-39705471-fe41-4c44-abab-392285661708 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:23.630185 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-39705471-fe41-4c44-abab-392285661708 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:23.635433 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e2b8ca14-ea09-425d-96b1-813e647c91da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:23.635813 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-39705471-fe41-4c44-abab-392285661708 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:23.636211 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e2b8ca14-ea09-425d-96b1-813e647c91da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:23.636350 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-39705471-fe41-4c44-abab-392285661708 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:23.645306 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-39705471-fe41-4c44-abab-392285661708 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:23.645306 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-39705471-fe41-4c44-abab-392285661708 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:23.645521 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e2b8ca14-ea09-425d-96b1-813e647c91da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:23.645521 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e2b8ca14-ea09-425d-96b1-813e647c91da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:23.645521 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e2b8ca14-ea09-425d-96b1-813e647c91da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:23.645521 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e2b8ca14-ea09-425d-96b1-813e647c91da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:23.771154 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-39705471-fe41-4c44-abab-392285661708 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:23.780878 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e2b8ca14-ea09-425d-96b1-813e647c91da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:23.785661 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-39705471-fe41-4c44-abab-392285661708 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:23.787603 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-39705471-fe41-4c44-abab-392285661708 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:23.788933 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-39705471-fe41-4c44-abab-392285661708 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.165207 Apr 05 12:10:23.789255 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e2b8ca14-ea09-425d-96b1-813e647c91da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.157543 Apr 05 12:10:23.790141 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1284/2547] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:23 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:23.794897 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b720cffb-23f2-4198-b9f5-0332a77849c5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:23.795489 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b720cffb-23f2-4198-b9f5-0332a77849c5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:23.798388 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1264/2548] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:23 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:23.801778 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b720cffb-23f2-4198-b9f5-0332a77849c5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:23.802221 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b720cffb-23f2-4198-b9f5-0332a77849c5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:23.802974 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b720cffb-23f2-4198-b9f5-0332a77849c5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:23.803404 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b720cffb-23f2-4198-b9f5-0332a77849c5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:23.935924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b720cffb-23f2-4198-b9f5-0332a77849c5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:23.944216 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b720cffb-23f2-4198-b9f5-0332a77849c5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.153068 Apr 05 12:10:23.944839 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1285/2549] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:23 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:24.566691 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0409a696-6b30-4da1-8e6b-22800fdfd41c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:24.567333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0409a696-6b30-4da1-8e6b-22800fdfd41c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:24.573786 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0409a696-6b30-4da1-8e6b-22800fdfd41c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:24.574232 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0409a696-6b30-4da1-8e6b-22800fdfd41c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:24.574982 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0409a696-6b30-4da1-8e6b-22800fdfd41c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:24.575409 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0409a696-6b30-4da1-8e6b-22800fdfd41c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:24.715407 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0409a696-6b30-4da1-8e6b-22800fdfd41c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:24.723380 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0409a696-6b30-4da1-8e6b-22800fdfd41c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.160803 Apr 05 12:10:24.723913 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1265/2550] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:24 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:24.811570 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d1a3e70a-f3cf-4127-aca6-03f5280b530c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:24.812419 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d1a3e70a-f3cf-4127-aca6-03f5280b530c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:24.816851 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-08b21a9c-770b-4a91-b095-19fde9d0af4d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:24.817039 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-08b21a9c-770b-4a91-b095-19fde9d0af4d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:24.822319 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d1a3e70a-f3cf-4127-aca6-03f5280b530c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:24.823120 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d1a3e70a-f3cf-4127-aca6-03f5280b530c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:24.824310 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-08b21a9c-770b-4a91-b095-19fde9d0af4d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:24.824510 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d1a3e70a-f3cf-4127-aca6-03f5280b530c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:24.824839 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-08b21a9c-770b-4a91-b095-19fde9d0af4d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:24.825168 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d1a3e70a-f3cf-4127-aca6-03f5280b530c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:24.825744 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-08b21a9c-770b-4a91-b095-19fde9d0af4d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:24.826236 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-08b21a9c-770b-4a91-b095-19fde9d0af4d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:24.967623 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d1a3e70a-f3cf-4127-aca6-03f5280b530c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:24.968427 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-08b21a9c-770b-4a91-b095-19fde9d0af4d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:24.976180 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d1a3e70a-f3cf-4127-aca6-03f5280b530c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:24.976375 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-08b21a9c-770b-4a91-b095-19fde9d0af4d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.164722 Apr 05 12:10:24.983302 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1266/2551] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:24 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:24.983497 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d1a3e70a-f3cf-4127-aca6-03f5280b530c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:24.983497 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d1a3e70a-f3cf-4127-aca6-03f5280b530c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.173191 Apr 05 12:10:24.983497 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1286/2552] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:24 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:24.983746 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-10943f66-2cb4-49b7-8701-fb2655d11f86 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:24.983746 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-10943f66-2cb4-49b7-8701-fb2655d11f86 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:24.988261 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-10943f66-2cb4-49b7-8701-fb2655d11f86 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:24.988773 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-10943f66-2cb4-49b7-8701-fb2655d11f86 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:24.989597 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-10943f66-2cb4-49b7-8701-fb2655d11f86 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:24.990116 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-10943f66-2cb4-49b7-8701-fb2655d11f86 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:25.124512 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-10943f66-2cb4-49b7-8701-fb2655d11f86 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:25.137352 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-10943f66-2cb4-49b7-8701-fb2655d11f86 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.159107 Apr 05 12:10:25.137937 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1267/2553] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:24 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:25.740672 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2debeb4d-c1d1-4071-927d-c09e21002435 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:25.741278 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2debeb4d-c1d1-4071-927d-c09e21002435 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:25.749017 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2debeb4d-c1d1-4071-927d-c09e21002435 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:25.749017 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2debeb4d-c1d1-4071-927d-c09e21002435 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:25.749017 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2debeb4d-c1d1-4071-927d-c09e21002435 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:25.749433 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2debeb4d-c1d1-4071-927d-c09e21002435 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:25.890132 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2debeb4d-c1d1-4071-927d-c09e21002435 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:25.900745 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2debeb4d-c1d1-4071-927d-c09e21002435 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.163956 Apr 05 12:10:25.901304 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1287/2554] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:25 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:25.997748 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-330a2888-3b06-430f-b4f9-939527d01f2e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:25.998824 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-330a2888-3b06-430f-b4f9-939527d01f2e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:26.000700 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4322c584-39ff-4bd8-8a1c-816a0b2e6a27 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:26.001939 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4322c584-39ff-4bd8-8a1c-816a0b2e6a27 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:26.009382 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-330a2888-3b06-430f-b4f9-939527d01f2e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:26.010136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-330a2888-3b06-430f-b4f9-939527d01f2e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:26.011366 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-330a2888-3b06-430f-b4f9-939527d01f2e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:26.012141 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-330a2888-3b06-430f-b4f9-939527d01f2e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:26.012419 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4322c584-39ff-4bd8-8a1c-816a0b2e6a27 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:26.012840 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4322c584-39ff-4bd8-8a1c-816a0b2e6a27 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:26.013584 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4322c584-39ff-4bd8-8a1c-816a0b2e6a27 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:26.014010 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4322c584-39ff-4bd8-8a1c-816a0b2e6a27 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:26.145807 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4322c584-39ff-4bd8-8a1c-816a0b2e6a27 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:26.146471 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-330a2888-3b06-430f-b4f9-939527d01f2e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:26.154736 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-330a2888-3b06-430f-b4f9-939527d01f2e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.163345 Apr 05 12:10:26.155331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1268/2555] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:25 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:26.157150 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4322c584-39ff-4bd8-8a1c-816a0b2e6a27 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:26.158794 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4322c584-39ff-4bd8-8a1c-816a0b2e6a27 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:26.159835 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0f8bbe32-3bcc-48cb-868e-c474211dbda1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:26.160477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0f8bbe32-3bcc-48cb-868e-c474211dbda1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:26.161778 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4322c584-39ff-4bd8-8a1c-816a0b2e6a27 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.167425 Apr 05 12:10:26.162590 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1288/2556] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:25 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:26.166864 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0f8bbe32-3bcc-48cb-868e-c474211dbda1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:26.167301 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0f8bbe32-3bcc-48cb-868e-c474211dbda1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:26.168066 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0f8bbe32-3bcc-48cb-868e-c474211dbda1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:26.168574 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0f8bbe32-3bcc-48cb-868e-c474211dbda1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:26.313546 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0f8bbe32-3bcc-48cb-868e-c474211dbda1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:26.325821 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0f8bbe32-3bcc-48cb-868e-c474211dbda1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.169253 Apr 05 12:10:26.326693 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1269/2557] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:26 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:26.921907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-011b5bfa-a336-4cf8-b817-488e172f698c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:26.922841 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-011b5bfa-a336-4cf8-b817-488e172f698c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:26.933478 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-011b5bfa-a336-4cf8-b817-488e172f698c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:26.934215 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-011b5bfa-a336-4cf8-b817-488e172f698c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:26.935483 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-011b5bfa-a336-4cf8-b817-488e172f698c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:26.935909 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-011b5bfa-a336-4cf8-b817-488e172f698c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:27.074402 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-011b5bfa-a336-4cf8-b817-488e172f698c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:27.082342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-011b5bfa-a336-4cf8-b817-488e172f698c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.166932 Apr 05 12:10:27.083114 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1289/2558] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:26 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:27.172096 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bfb1e6fe-f5c7-4e56-ae8c-831d96cf9907 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:27.172707 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bfb1e6fe-f5c7-4e56-ae8c-831d96cf9907 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:27.179605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bfb1e6fe-f5c7-4e56-ae8c-831d96cf9907 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:27.179849 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e912227a-f997-4224-bc3f-2c50a5d926e1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:27.180456 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bfb1e6fe-f5c7-4e56-ae8c-831d96cf9907 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:27.180621 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e912227a-f997-4224-bc3f-2c50a5d926e1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:27.181547 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bfb1e6fe-f5c7-4e56-ae8c-831d96cf9907 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:27.182241 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bfb1e6fe-f5c7-4e56-ae8c-831d96cf9907 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:27.186777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e912227a-f997-4224-bc3f-2c50a5d926e1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:27.187124 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e912227a-f997-4224-bc3f-2c50a5d926e1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:27.187886 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e912227a-f997-4224-bc3f-2c50a5d926e1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:27.188342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e912227a-f997-4224-bc3f-2c50a5d926e1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:27.313025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-bfb1e6fe-f5c7-4e56-ae8c-831d96cf9907 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:27.318244 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e912227a-f997-4224-bc3f-2c50a5d926e1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:27.321183 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bfb1e6fe-f5c7-4e56-ae8c-831d96cf9907 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.153285 Apr 05 12:10:27.321734 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1270/2559] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:27 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:27.326816 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e912227a-f997-4224-bc3f-2c50a5d926e1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:27.328334 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e912227a-f997-4224-bc3f-2c50a5d926e1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:27.329479 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e912227a-f997-4224-bc3f-2c50a5d926e1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.153731 Apr 05 12:10:27.330238 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1290/2560] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:27 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:27.342433 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ac72da90-2475-4202-a25d-a45754cec28b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:27.343032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ac72da90-2475-4202-a25d-a45754cec28b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:27.349581 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ac72da90-2475-4202-a25d-a45754cec28b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:27.350027 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ac72da90-2475-4202-a25d-a45754cec28b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:27.350777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ac72da90-2475-4202-a25d-a45754cec28b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:27.351233 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ac72da90-2475-4202-a25d-a45754cec28b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:27.495364 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ac72da90-2475-4202-a25d-a45754cec28b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:27.508136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ac72da90-2475-4202-a25d-a45754cec28b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.169081 Apr 05 12:10:27.509011 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1271/2561] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:27 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:28.103009 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ba8c5860-7906-4b1d-a1e7-3285bf70f598 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:28.103796 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ba8c5860-7906-4b1d-a1e7-3285bf70f598 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:28.111438 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ba8c5860-7906-4b1d-a1e7-3285bf70f598 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:28.111886 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ba8c5860-7906-4b1d-a1e7-3285bf70f598 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:28.112701 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ba8c5860-7906-4b1d-a1e7-3285bf70f598 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:28.113134 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ba8c5860-7906-4b1d-a1e7-3285bf70f598 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:28.261038 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ba8c5860-7906-4b1d-a1e7-3285bf70f598 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:28.269584 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ba8c5860-7906-4b1d-a1e7-3285bf70f598 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.172220 Apr 05 12:10:28.270154 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1291/2562] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:28 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:28.342499 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-03123376-d418-4c25-a5ae-896c27af68e5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:28.343240 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-03123376-d418-4c25-a5ae-896c27af68e5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:28.349608 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2180b50d-b140-40ba-9a84-3a94e2fed5c1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:28.350435 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2180b50d-b140-40ba-9a84-3a94e2fed5c1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:28.351338 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03123376-d418-4c25-a5ae-896c27af68e5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:28.351931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03123376-d418-4c25-a5ae-896c27af68e5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:28.353281 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03123376-d418-4c25-a5ae-896c27af68e5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:28.353778 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03123376-d418-4c25-a5ae-896c27af68e5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:28.358325 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2180b50d-b140-40ba-9a84-3a94e2fed5c1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:28.358931 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2180b50d-b140-40ba-9a84-3a94e2fed5c1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:28.359923 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2180b50d-b140-40ba-9a84-3a94e2fed5c1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:28.360641 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2180b50d-b140-40ba-9a84-3a94e2fed5c1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:28.492862 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-03123376-d418-4c25-a5ae-896c27af68e5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:28.495337 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2180b50d-b140-40ba-9a84-3a94e2fed5c1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:28.501480 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-03123376-d418-4c25-a5ae-896c27af68e5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.165353 Apr 05 12:10:28.502013 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1272/2563] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:28 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:28.504152 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2180b50d-b140-40ba-9a84-3a94e2fed5c1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:28.506004 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2180b50d-b140-40ba-9a84-3a94e2fed5c1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:28.507166 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2180b50d-b140-40ba-9a84-3a94e2fed5c1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.162546 Apr 05 12:10:28.507721 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1292/2564] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:28 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:28.527267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-87ace042-cb4a-472b-bd22-4f6c86d99b92 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:28.527881 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-87ace042-cb4a-472b-bd22-4f6c86d99b92 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:28.534419 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-87ace042-cb4a-472b-bd22-4f6c86d99b92 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:28.534909 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-87ace042-cb4a-472b-bd22-4f6c86d99b92 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:28.535681 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-87ace042-cb4a-472b-bd22-4f6c86d99b92 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:28.536184 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-87ace042-cb4a-472b-bd22-4f6c86d99b92 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:28.677125 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-87ace042-cb4a-472b-bd22-4f6c86d99b92 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:28.688990 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-87ace042-cb4a-472b-bd22-4f6c86d99b92 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.165468 Apr 05 12:10:28.689801 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1273/2565] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:28 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:29.290759 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-23131ab3-ddcb-41d1-9f91-6e3ba701918a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:29.291384 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-23131ab3-ddcb-41d1-9f91-6e3ba701918a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:29.301755 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-23131ab3-ddcb-41d1-9f91-6e3ba701918a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:29.302323 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-23131ab3-ddcb-41d1-9f91-6e3ba701918a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:29.303451 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-23131ab3-ddcb-41d1-9f91-6e3ba701918a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:29.304066 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-23131ab3-ddcb-41d1-9f91-6e3ba701918a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:29.440495 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-23131ab3-ddcb-41d1-9f91-6e3ba701918a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:29.448632 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-23131ab3-ddcb-41d1-9f91-6e3ba701918a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.164137 Apr 05 12:10:29.449321 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1293/2566] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:29 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:29.519088 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2aa71921-f78e-4853-aa38-dd4dc70170bf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:29.519693 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2aa71921-f78e-4853-aa38-dd4dc70170bf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:29.525270 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f635471d-4c3d-419f-8fb6-16b9bd16a008 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:29.525876 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f635471d-4c3d-419f-8fb6-16b9bd16a008 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:29.526415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2aa71921-f78e-4853-aa38-dd4dc70170bf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:29.526860 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2aa71921-f78e-4853-aa38-dd4dc70170bf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:29.527621 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2aa71921-f78e-4853-aa38-dd4dc70170bf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:29.528054 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2aa71921-f78e-4853-aa38-dd4dc70170bf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:29.531914 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f635471d-4c3d-419f-8fb6-16b9bd16a008 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:29.532408 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f635471d-4c3d-419f-8fb6-16b9bd16a008 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:29.533148 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f635471d-4c3d-419f-8fb6-16b9bd16a008 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:29.533580 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f635471d-4c3d-419f-8fb6-16b9bd16a008 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:29.664234 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2aa71921-f78e-4853-aa38-dd4dc70170bf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:29.672580 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f635471d-4c3d-419f-8fb6-16b9bd16a008 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:29.672753 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2aa71921-f78e-4853-aa38-dd4dc70170bf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.157455 Apr 05 12:10:29.673215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1274/2567] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:29 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:29.681273 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f635471d-4c3d-419f-8fb6-16b9bd16a008 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:29.682781 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f635471d-4c3d-419f-8fb6-16b9bd16a008 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:29.685178 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f635471d-4c3d-419f-8fb6-16b9bd16a008 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.163684 Apr 05 12:10:29.685842 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1294/2568] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:29 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:29.709909 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-492189ad-a165-45f4-823d-aad940e07533 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:29.710552 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-492189ad-a165-45f4-823d-aad940e07533 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:29.716837 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-492189ad-a165-45f4-823d-aad940e07533 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:29.717291 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-492189ad-a165-45f4-823d-aad940e07533 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:29.718054 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-492189ad-a165-45f4-823d-aad940e07533 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:29.718491 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-492189ad-a165-45f4-823d-aad940e07533 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:29.858288 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-492189ad-a165-45f4-823d-aad940e07533 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:29.867055 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-492189ad-a165-45f4-823d-aad940e07533 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.161076 Apr 05 12:10:29.867550 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1275/2569] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:29 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:30.467339 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f317ee34-662c-4442-93f3-2b3b5016b1e4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:30.468020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f317ee34-662c-4442-93f3-2b3b5016b1e4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:30.475766 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f317ee34-662c-4442-93f3-2b3b5016b1e4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:30.476344 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f317ee34-662c-4442-93f3-2b3b5016b1e4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:30.477254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f317ee34-662c-4442-93f3-2b3b5016b1e4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:30.477755 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f317ee34-662c-4442-93f3-2b3b5016b1e4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:30.616512 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f317ee34-662c-4442-93f3-2b3b5016b1e4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:30.626631 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f317ee34-662c-4442-93f3-2b3b5016b1e4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.163871 Apr 05 12:10:30.627207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1295/2570] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:30 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:30.694472 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c132415c-894b-457f-bd19-d04011d0abd1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:30.695501 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c132415c-894b-457f-bd19-d04011d0abd1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:30.706006 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c132415c-894b-457f-bd19-d04011d0abd1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:30.706703 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c132415c-894b-457f-bd19-d04011d0abd1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:30.707041 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cfa9600f-d514-4b56-b4c3-ea8568b05bbd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:30.707997 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c132415c-894b-457f-bd19-d04011d0abd1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:30.708281 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cfa9600f-d514-4b56-b4c3-ea8568b05bbd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:30.708748 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c132415c-894b-457f-bd19-d04011d0abd1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:30.717902 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cfa9600f-d514-4b56-b4c3-ea8568b05bbd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:30.718283 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cfa9600f-d514-4b56-b4c3-ea8568b05bbd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:30.719037 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cfa9600f-d514-4b56-b4c3-ea8568b05bbd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:30.719464 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cfa9600f-d514-4b56-b4c3-ea8568b05bbd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:30.843540 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c132415c-894b-457f-bd19-d04011d0abd1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:30.851329 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c132415c-894b-457f-bd19-d04011d0abd1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.163381 Apr 05 12:10:30.852134 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1276/2571] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:30 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:30.854246 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cfa9600f-d514-4b56-b4c3-ea8568b05bbd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:30.862707 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cfa9600f-d514-4b56-b4c3-ea8568b05bbd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:30.864225 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cfa9600f-d514-4b56-b4c3-ea8568b05bbd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:30.865411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cfa9600f-d514-4b56-b4c3-ea8568b05bbd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.165169 Apr 05 12:10:30.865967 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1296/2572] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:30 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:30.884416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-743d21d4-7e43-4587-ae94-1b1f1474489b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:30.885027 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-743d21d4-7e43-4587-ae94-1b1f1474489b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:30.891187 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-743d21d4-7e43-4587-ae94-1b1f1474489b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:30.891630 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-743d21d4-7e43-4587-ae94-1b1f1474489b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:30.892442 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-743d21d4-7e43-4587-ae94-1b1f1474489b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:30.892874 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-743d21d4-7e43-4587-ae94-1b1f1474489b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:31.035084 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-743d21d4-7e43-4587-ae94-1b1f1474489b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:31.043337 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-743d21d4-7e43-4587-ae94-1b1f1474489b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.162760 Apr 05 12:10:31.043920 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1277/2573] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:30 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:10:31.649901 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-646dc87b-618f-4615-864c-35a2f806b1c9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:31.650845 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-646dc87b-618f-4615-864c-35a2f806b1c9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:31.661308 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-646dc87b-618f-4615-864c-35a2f806b1c9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:31.662055 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-646dc87b-618f-4615-864c-35a2f806b1c9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:31.663431 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-646dc87b-618f-4615-864c-35a2f806b1c9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:31.664141 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-646dc87b-618f-4615-864c-35a2f806b1c9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:31.810603 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-646dc87b-618f-4615-864c-35a2f806b1c9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:31.822419 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-646dc87b-618f-4615-864c-35a2f806b1c9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.178805 Apr 05 12:10:31.823155 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1297/2574] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:31 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:31.871647 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0d5bf750-ba95-4718-ae2b-2aec0ed18363 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:31.872648 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0d5bf750-ba95-4718-ae2b-2aec0ed18363 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:31.882263 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0d5bf750-ba95-4718-ae2b-2aec0ed18363 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:31.882984 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0d5bf750-ba95-4718-ae2b-2aec0ed18363 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:31.883927 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0d5bf750-ba95-4718-ae2b-2aec0ed18363 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:31.884502 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0d5bf750-ba95-4718-ae2b-2aec0ed18363 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:31.885976 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-535f15f8-20f9-42f9-8413-09b9a0ddedb3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:31.886797 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-535f15f8-20f9-42f9-8413-09b9a0ddedb3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:31.893755 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-535f15f8-20f9-42f9-8413-09b9a0ddedb3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:31.894216 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-535f15f8-20f9-42f9-8413-09b9a0ddedb3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:31.894999 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-535f15f8-20f9-42f9-8413-09b9a0ddedb3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:31.895423 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-535f15f8-20f9-42f9-8413-09b9a0ddedb3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:32.027584 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0d5bf750-ba95-4718-ae2b-2aec0ed18363 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:32.028651 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-535f15f8-20f9-42f9-8413-09b9a0ddedb3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:32.035655 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0d5bf750-ba95-4718-ae2b-2aec0ed18363 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.170029 Apr 05 12:10:32.036260 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1278/2575] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:31 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:32.037172 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-535f15f8-20f9-42f9-8413-09b9a0ddedb3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:32.038744 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-535f15f8-20f9-42f9-8413-09b9a0ddedb3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:32.039895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-535f15f8-20f9-42f9-8413-09b9a0ddedb3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.158875 Apr 05 12:10:32.040563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1298/2576] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:31 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:10:32.060446 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f3445b60-b520-4bfd-87b2-1f7411e380e5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:32.061083 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f3445b60-b520-4bfd-87b2-1f7411e380e5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:32.066985 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f3445b60-b520-4bfd-87b2-1f7411e380e5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:32.067432 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f3445b60-b520-4bfd-87b2-1f7411e380e5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:32.068240 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f3445b60-b520-4bfd-87b2-1f7411e380e5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:32.068673 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f3445b60-b520-4bfd-87b2-1f7411e380e5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:32.214872 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f3445b60-b520-4bfd-87b2-1f7411e380e5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:32.223321 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f3445b60-b520-4bfd-87b2-1f7411e380e5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.166632 Apr 05 12:10:32.223917 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1279/2577] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:32 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:32.844204 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d18c2790-003d-45fc-be26-d12962582aac tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:32.845045 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d18c2790-003d-45fc-be26-d12962582aac tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:32.855563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d18c2790-003d-45fc-be26-d12962582aac tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:32.856362 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d18c2790-003d-45fc-be26-d12962582aac tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:32.857648 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d18c2790-003d-45fc-be26-d12962582aac tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:32.858354 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d18c2790-003d-45fc-be26-d12962582aac tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:33.007238 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d18c2790-003d-45fc-be26-d12962582aac tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:33.019463 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d18c2790-003d-45fc-be26-d12962582aac tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.181650 Apr 05 12:10:33.020259 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1299/2578] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:32 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:33.054246 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fded1af2-0aad-4d16-a48e-ca3daef3d3a6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:33.055294 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fded1af2-0aad-4d16-a48e-ca3daef3d3a6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:33.059005 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-564cf305-d740-45b8-acc9-96259af6bedf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:33.059610 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-564cf305-d740-45b8-acc9-96259af6bedf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:33.061715 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fded1af2-0aad-4d16-a48e-ca3daef3d3a6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:33.062210 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fded1af2-0aad-4d16-a48e-ca3daef3d3a6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:33.062968 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fded1af2-0aad-4d16-a48e-ca3daef3d3a6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:33.063396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fded1af2-0aad-4d16-a48e-ca3daef3d3a6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:33.065595 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-564cf305-d740-45b8-acc9-96259af6bedf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:33.066040 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-564cf305-d740-45b8-acc9-96259af6bedf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:33.066791 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-564cf305-d740-45b8-acc9-96259af6bedf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:33.067221 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-564cf305-d740-45b8-acc9-96259af6bedf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:33.198611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fded1af2-0aad-4d16-a48e-ca3daef3d3a6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:33.200997 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-564cf305-d740-45b8-acc9-96259af6bedf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:33.206650 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fded1af2-0aad-4d16-a48e-ca3daef3d3a6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.157060 Apr 05 12:10:33.207222 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1280/2579] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:33 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:33.209411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-564cf305-d740-45b8-acc9-96259af6bedf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:33.210932 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-564cf305-d740-45b8-acc9-96259af6bedf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:33.212114 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-564cf305-d740-45b8-acc9-96259af6bedf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.158014 Apr 05 12:10:33.212702 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1300/2580] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:33 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:33.240388 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d8caf52a-0ab4-46db-9d16-b82ee202819b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:33.240991 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d8caf52a-0ab4-46db-9d16-b82ee202819b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:33.248434 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d8caf52a-0ab4-46db-9d16-b82ee202819b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:33.249189 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d8caf52a-0ab4-46db-9d16-b82ee202819b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:33.250481 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d8caf52a-0ab4-46db-9d16-b82ee202819b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:33.251209 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d8caf52a-0ab4-46db-9d16-b82ee202819b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:33.396016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d8caf52a-0ab4-46db-9d16-b82ee202819b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:33.403850 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d8caf52a-0ab4-46db-9d16-b82ee202819b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.167176 Apr 05 12:10:33.404679 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1281/2581] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:33 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:34.044716 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d88904df-2791-4720-9448-156cac812067 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:34.045756 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d88904df-2791-4720-9448-156cac812067 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:34.053406 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d88904df-2791-4720-9448-156cac812067 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:34.053911 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d88904df-2791-4720-9448-156cac812067 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:34.054776 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d88904df-2791-4720-9448-156cac812067 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:34.055234 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d88904df-2791-4720-9448-156cac812067 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:34.204360 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d88904df-2791-4720-9448-156cac812067 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:34.214695 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d88904df-2791-4720-9448-156cac812067 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.176152 Apr 05 12:10:34.215457 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1301/2582] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:34 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:34.223871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0312e4ec-2d00-4786-b0f4-58e705ba4c6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:34.224485 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0312e4ec-2d00-4786-b0f4-58e705ba4c6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:34.229546 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-31c4e831-99e0-4185-a1a3-a2ad3c802313 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:34.230288 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-31c4e831-99e0-4185-a1a3-a2ad3c802313 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:34.230875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0312e4ec-2d00-4786-b0f4-58e705ba4c6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:34.231322 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0312e4ec-2d00-4786-b0f4-58e705ba4c6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:34.232088 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0312e4ec-2d00-4786-b0f4-58e705ba4c6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:34.232521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0312e4ec-2d00-4786-b0f4-58e705ba4c6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:34.236177 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-31c4e831-99e0-4185-a1a3-a2ad3c802313 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:34.236632 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-31c4e831-99e0-4185-a1a3-a2ad3c802313 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:34.237389 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-31c4e831-99e0-4185-a1a3-a2ad3c802313 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:34.237822 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-31c4e831-99e0-4185-a1a3-a2ad3c802313 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:34.361251 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0312e4ec-2d00-4786-b0f4-58e705ba4c6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:34.368857 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-31c4e831-99e0-4185-a1a3-a2ad3c802313 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:34.369056 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0312e4ec-2d00-4786-b0f4-58e705ba4c6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.148974 Apr 05 12:10:34.369743 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1282/2583] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:34 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:34.377584 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-31c4e831-99e0-4185-a1a3-a2ad3c802313 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:34.379089 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-31c4e831-99e0-4185-a1a3-a2ad3c802313 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:34.380612 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-31c4e831-99e0-4185-a1a3-a2ad3c802313 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.154807 Apr 05 12:10:34.381169 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1302/2584] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:34 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:34.419980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3b605ba1-19d5-40a9-8401-d906bcbceaa5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:34.420623 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3b605ba1-19d5-40a9-8401-d906bcbceaa5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:34.426726 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b605ba1-19d5-40a9-8401-d906bcbceaa5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:34.427177 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b605ba1-19d5-40a9-8401-d906bcbceaa5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:34.427928 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b605ba1-19d5-40a9-8401-d906bcbceaa5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:34.428422 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b605ba1-19d5-40a9-8401-d906bcbceaa5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:34.562111 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3b605ba1-19d5-40a9-8401-d906bcbceaa5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:34.570412 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3b605ba1-19d5-40a9-8401-d906bcbceaa5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.154157 Apr 05 12:10:34.570932 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1283/2585] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:34 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:35.234190 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-27085aa7-eb5e-4993-b8ea-dc53158e0dfd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:35.234993 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-27085aa7-eb5e-4993-b8ea-dc53158e0dfd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:35.243626 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-27085aa7-eb5e-4993-b8ea-dc53158e0dfd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:35.244280 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-27085aa7-eb5e-4993-b8ea-dc53158e0dfd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:35.245280 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-27085aa7-eb5e-4993-b8ea-dc53158e0dfd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:35.245854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-27085aa7-eb5e-4993-b8ea-dc53158e0dfd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:35.386506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-43b2d3e8-dd26-448b-b394-25d8696d476c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:35.387246 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-43b2d3e8-dd26-448b-b394-25d8696d476c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:35.389641 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-27085aa7-eb5e-4993-b8ea-dc53158e0dfd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:35.394621 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-43b2d3e8-dd26-448b-b394-25d8696d476c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:35.395066 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-43b2d3e8-dd26-448b-b394-25d8696d476c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:35.395831 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-43b2d3e8-dd26-448b-b394-25d8696d476c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:35.396293 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-43b2d3e8-dd26-448b-b394-25d8696d476c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:35.398050 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-27085aa7-eb5e-4993-b8ea-dc53158e0dfd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.168970 Apr 05 12:10:35.398774 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1303/2586] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:35 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:35.403098 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3bc778e5-20e3-4d92-adbc-882a4ef2fd86 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:35.403827 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3bc778e5-20e3-4d92-adbc-882a4ef2fd86 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:35.409657 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3bc778e5-20e3-4d92-adbc-882a4ef2fd86 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:35.410106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3bc778e5-20e3-4d92-adbc-882a4ef2fd86 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:35.410856 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3bc778e5-20e3-4d92-adbc-882a4ef2fd86 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:35.411285 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3bc778e5-20e3-4d92-adbc-882a4ef2fd86 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:35.533084 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-43b2d3e8-dd26-448b-b394-25d8696d476c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:35.541205 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-43b2d3e8-dd26-448b-b394-25d8696d476c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.158631 Apr 05 12:10:35.541530 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3bc778e5-20e3-4d92-adbc-882a4ef2fd86 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:35.541825 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1284/2587] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:35 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:35.550408 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3bc778e5-20e3-4d92-adbc-882a4ef2fd86 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:35.551958 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3bc778e5-20e3-4d92-adbc-882a4ef2fd86 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:35.553133 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3bc778e5-20e3-4d92-adbc-882a4ef2fd86 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.153589 Apr 05 12:10:35.553675 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1304/2588] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:35 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:35.586762 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9b1b8361-6f9d-446d-a2c0-1e29d2343035 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:35.587283 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9b1b8361-6f9d-446d-a2c0-1e29d2343035 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:35.593330 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9b1b8361-6f9d-446d-a2c0-1e29d2343035 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:35.593783 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9b1b8361-6f9d-446d-a2c0-1e29d2343035 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:35.594539 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9b1b8361-6f9d-446d-a2c0-1e29d2343035 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:35.594976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9b1b8361-6f9d-446d-a2c0-1e29d2343035 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:35.739020 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9b1b8361-6f9d-446d-a2c0-1e29d2343035 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:35.750059 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9b1b8361-6f9d-446d-a2c0-1e29d2343035 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.167178 Apr 05 12:10:35.750663 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1285/2589] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:35 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:36.418584 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d25ae501-fd5e-4df1-97e6-bf1bd2e1472a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:36.419658 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d25ae501-fd5e-4df1-97e6-bf1bd2e1472a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:36.427009 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d25ae501-fd5e-4df1-97e6-bf1bd2e1472a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:36.427454 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d25ae501-fd5e-4df1-97e6-bf1bd2e1472a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:36.428230 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d25ae501-fd5e-4df1-97e6-bf1bd2e1472a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:36.428656 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d25ae501-fd5e-4df1-97e6-bf1bd2e1472a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:36.559143 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ed3243ef-4019-4ead-b96b-416b0ac9563d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:36.559726 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ed3243ef-4019-4ead-b96b-416b0ac9563d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:36.563049 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d25ae501-fd5e-4df1-97e6-bf1bd2e1472a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:36.566451 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ed3243ef-4019-4ead-b96b-416b0ac9563d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:36.566906 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ed3243ef-4019-4ead-b96b-416b0ac9563d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:36.567680 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ed3243ef-4019-4ead-b96b-416b0ac9563d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:36.568134 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ed3243ef-4019-4ead-b96b-416b0ac9563d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:36.571441 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d25ae501-fd5e-4df1-97e6-bf1bd2e1472a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.159260 Apr 05 12:10:36.572011 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1305/2590] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:36 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:36.576713 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a34ae440-1dd9-4e93-9605-83683108e061 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:36.577307 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a34ae440-1dd9-4e93-9605-83683108e061 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:36.583280 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a34ae440-1dd9-4e93-9605-83683108e061 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:36.583725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a34ae440-1dd9-4e93-9605-83683108e061 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:36.584549 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a34ae440-1dd9-4e93-9605-83683108e061 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:36.584975 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a34ae440-1dd9-4e93-9605-83683108e061 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:36.698494 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ed3243ef-4019-4ead-b96b-416b0ac9563d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:36.706628 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ed3243ef-4019-4ead-b96b-416b0ac9563d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.151486 Apr 05 12:10:36.707237 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1286/2591] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:36 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:36.721270 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a34ae440-1dd9-4e93-9605-83683108e061 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:36.729927 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a34ae440-1dd9-4e93-9605-83683108e061 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:36.731400 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a34ae440-1dd9-4e93-9605-83683108e061 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:36.732580 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a34ae440-1dd9-4e93-9605-83683108e061 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.159619 Apr 05 12:10:36.733128 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1306/2592] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:36 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:36.766837 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d981d1b0-724b-489e-8f05-35a4075780f8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:36.767447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d981d1b0-724b-489e-8f05-35a4075780f8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:36.773839 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d981d1b0-724b-489e-8f05-35a4075780f8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:36.774304 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d981d1b0-724b-489e-8f05-35a4075780f8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:36.775052 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d981d1b0-724b-489e-8f05-35a4075780f8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:36.775479 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d981d1b0-724b-489e-8f05-35a4075780f8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:36.912261 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d981d1b0-724b-489e-8f05-35a4075780f8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:36.920162 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d981d1b0-724b-489e-8f05-35a4075780f8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.157161 Apr 05 12:10:36.920911 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1287/2593] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:36 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:37.592614 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a5f956ab-2e5c-426a-ad6d-bb52c991f563 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:37.593533 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a5f956ab-2e5c-426a-ad6d-bb52c991f563 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:37.600258 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5f956ab-2e5c-426a-ad6d-bb52c991f563 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:37.600718 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5f956ab-2e5c-426a-ad6d-bb52c991f563 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:37.601480 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5f956ab-2e5c-426a-ad6d-bb52c991f563 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:37.601918 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5f956ab-2e5c-426a-ad6d-bb52c991f563 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:37.724313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b59f0c24-b524-49da-9512-c4d238222209 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:37.725073 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b59f0c24-b524-49da-9512-c4d238222209 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:37.732319 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b59f0c24-b524-49da-9512-c4d238222209 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:37.732767 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b59f0c24-b524-49da-9512-c4d238222209 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:37.733524 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b59f0c24-b524-49da-9512-c4d238222209 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:37.734042 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b59f0c24-b524-49da-9512-c4d238222209 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:37.748466 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a5f956ab-2e5c-426a-ad6d-bb52c991f563 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:37.756795 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a5f956ab-2e5c-426a-ad6d-bb52c991f563 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.170818 Apr 05 12:10:37.757377 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1307/2594] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:37 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:37.761748 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1a4535ec-a1f6-4b08-85cd-59818e8acf86 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:37.762343 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1a4535ec-a1f6-4b08-85cd-59818e8acf86 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:37.772246 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a4535ec-a1f6-4b08-85cd-59818e8acf86 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:37.772822 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a4535ec-a1f6-4b08-85cd-59818e8acf86 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:37.773588 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a4535ec-a1f6-4b08-85cd-59818e8acf86 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:37.774021 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1a4535ec-a1f6-4b08-85cd-59818e8acf86 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:37.865219 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b59f0c24-b524-49da-9512-c4d238222209 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:37.873590 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b59f0c24-b524-49da-9512-c4d238222209 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.153461 Apr 05 12:10:37.874156 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1288/2595] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:37 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:37.912268 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1a4535ec-a1f6-4b08-85cd-59818e8acf86 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:37.920716 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1a4535ec-a1f6-4b08-85cd-59818e8acf86 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:37.922280 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1a4535ec-a1f6-4b08-85cd-59818e8acf86 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:37.923435 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1a4535ec-a1f6-4b08-85cd-59818e8acf86 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.165193 Apr 05 12:10:37.924003 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1308/2596] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:37 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:37.940431 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4f4bd0fe-2469-42be-ac52-d478726583f5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:37.941413 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4f4bd0fe-2469-42be-ac52-d478726583f5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:37.951077 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4f4bd0fe-2469-42be-ac52-d478726583f5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:37.951628 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4f4bd0fe-2469-42be-ac52-d478726583f5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:37.952947 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4f4bd0fe-2469-42be-ac52-d478726583f5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:37.953380 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4f4bd0fe-2469-42be-ac52-d478726583f5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:38.095297 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4f4bd0fe-2469-42be-ac52-d478726583f5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:38.103611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4f4bd0fe-2469-42be-ac52-d478726583f5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.169586 Apr 05 12:10:38.104218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1289/2597] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:37 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:38.777443 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-83750926-e8e7-45cf-95fa-c763f242b078 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:38.778430 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-83750926-e8e7-45cf-95fa-c763f242b078 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:38.786000 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-83750926-e8e7-45cf-95fa-c763f242b078 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:38.786454 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-83750926-e8e7-45cf-95fa-c763f242b078 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:38.787199 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-83750926-e8e7-45cf-95fa-c763f242b078 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:38.787631 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-83750926-e8e7-45cf-95fa-c763f242b078 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:38.890990 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-95269f9a-a7f3-4b02-9e35-bc4ff15defc2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:38.891552 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-95269f9a-a7f3-4b02-9e35-bc4ff15defc2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:38.898222 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-95269f9a-a7f3-4b02-9e35-bc4ff15defc2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:38.898670 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-95269f9a-a7f3-4b02-9e35-bc4ff15defc2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:38.899410 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-95269f9a-a7f3-4b02-9e35-bc4ff15defc2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:38.899858 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-95269f9a-a7f3-4b02-9e35-bc4ff15defc2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:38.929149 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-83750926-e8e7-45cf-95fa-c763f242b078 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:38.937563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-83750926-e8e7-45cf-95fa-c763f242b078 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.166572 Apr 05 12:10:38.938144 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1309/2598] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:38 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:38.945812 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bd00f51c-3dfc-4c1e-8eca-491bd99b8ffc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:38.946566 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bd00f51c-3dfc-4c1e-8eca-491bd99b8ffc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:38.952961 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bd00f51c-3dfc-4c1e-8eca-491bd99b8ffc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:38.953475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bd00f51c-3dfc-4c1e-8eca-491bd99b8ffc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:38.954294 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bd00f51c-3dfc-4c1e-8eca-491bd99b8ffc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:38.954790 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bd00f51c-3dfc-4c1e-8eca-491bd99b8ffc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:39.035105 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-95269f9a-a7f3-4b02-9e35-bc4ff15defc2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:39.043235 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-95269f9a-a7f3-4b02-9e35-bc4ff15defc2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.156072 Apr 05 12:10:39.043883 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1290/2599] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:38 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:39.084138 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bd00f51c-3dfc-4c1e-8eca-491bd99b8ffc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:39.092651 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bd00f51c-3dfc-4c1e-8eca-491bd99b8ffc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:39.094181 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bd00f51c-3dfc-4c1e-8eca-491bd99b8ffc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:39.095323 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bd00f51c-3dfc-4c1e-8eca-491bd99b8ffc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.153379 Apr 05 12:10:39.095877 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1310/2600] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:38 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:39.124582 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0d8ab3fb-037c-4097-892a-044053238dfd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:39.125380 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0d8ab3fb-037c-4097-892a-044053238dfd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:39.134953 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0d8ab3fb-037c-4097-892a-044053238dfd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:39.135461 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0d8ab3fb-037c-4097-892a-044053238dfd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:39.136566 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0d8ab3fb-037c-4097-892a-044053238dfd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:39.137137 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0d8ab3fb-037c-4097-892a-044053238dfd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:39.281580 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0d8ab3fb-037c-4097-892a-044053238dfd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:39.289808 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0d8ab3fb-037c-4097-892a-044053238dfd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.171494 Apr 05 12:10:39.290319 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1291/2601] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:39 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:39.957924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b4fd082e-dc0d-48e6-88c2-9537fd81dc88 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:39.958609 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b4fd082e-dc0d-48e6-88c2-9537fd81dc88 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:39.965376 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b4fd082e-dc0d-48e6-88c2-9537fd81dc88 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:39.965833 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b4fd082e-dc0d-48e6-88c2-9537fd81dc88 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:39.966596 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b4fd082e-dc0d-48e6-88c2-9537fd81dc88 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:39.967035 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b4fd082e-dc0d-48e6-88c2-9537fd81dc88 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:40.060729 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2208de97-253b-46c2-b24a-121cc57474d5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:40.061136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2208de97-253b-46c2-b24a-121cc57474d5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:40.067969 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2208de97-253b-46c2-b24a-121cc57474d5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:40.068464 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2208de97-253b-46c2-b24a-121cc57474d5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:40.069246 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2208de97-253b-46c2-b24a-121cc57474d5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:40.069673 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2208de97-253b-46c2-b24a-121cc57474d5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:40.111598 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b4fd082e-dc0d-48e6-88c2-9537fd81dc88 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:40.119608 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b4fd082e-dc0d-48e6-88c2-9537fd81dc88 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.167460 Apr 05 12:10:40.120184 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1311/2602] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:39 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:40.124554 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-14e8a7f4-16ab-4741-b5c9-4cbcf031f75a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:40.125172 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-14e8a7f4-16ab-4741-b5c9-4cbcf031f75a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:40.131428 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14e8a7f4-16ab-4741-b5c9-4cbcf031f75a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:40.131867 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14e8a7f4-16ab-4741-b5c9-4cbcf031f75a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:40.132641 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14e8a7f4-16ab-4741-b5c9-4cbcf031f75a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:40.133051 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14e8a7f4-16ab-4741-b5c9-4cbcf031f75a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:40.206788 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2208de97-253b-46c2-b24a-121cc57474d5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:40.214833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2208de97-253b-46c2-b24a-121cc57474d5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.158125 Apr 05 12:10:40.215388 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1292/2603] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:40 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:40.264104 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-14e8a7f4-16ab-4741-b5c9-4cbcf031f75a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:40.272829 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-14e8a7f4-16ab-4741-b5c9-4cbcf031f75a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:40.274310 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-14e8a7f4-16ab-4741-b5c9-4cbcf031f75a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:40.275455 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-14e8a7f4-16ab-4741-b5c9-4cbcf031f75a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.154376 Apr 05 12:10:40.276013 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1312/2604] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:40 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:40.307618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3e2b7d7d-712e-4a1a-9f37-01936be4aabb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:40.308263 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3e2b7d7d-712e-4a1a-9f37-01936be4aabb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:40.314688 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e2b7d7d-712e-4a1a-9f37-01936be4aabb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:40.315133 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e2b7d7d-712e-4a1a-9f37-01936be4aabb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:40.316034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e2b7d7d-712e-4a1a-9f37-01936be4aabb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:40.316504 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e2b7d7d-712e-4a1a-9f37-01936be4aabb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:40.467718 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3e2b7d7d-712e-4a1a-9f37-01936be4aabb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:40.476095 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3e2b7d7d-712e-4a1a-9f37-01936be4aabb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.172372 Apr 05 12:10:40.476693 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1293/2605] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:40 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:41.140838 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ad2cd3a7-615c-44bf-bf01-30afd1f6f6d5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:41.141836 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ad2cd3a7-615c-44bf-bf01-30afd1f6f6d5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:41.152897 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ad2cd3a7-615c-44bf-bf01-30afd1f6f6d5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:41.153647 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ad2cd3a7-615c-44bf-bf01-30afd1f6f6d5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:41.154879 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ad2cd3a7-615c-44bf-bf01-30afd1f6f6d5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:41.155602 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ad2cd3a7-615c-44bf-bf01-30afd1f6f6d5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:41.231579 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e0d92d47-4f5d-49b1-990d-c64222508e84 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:41.232220 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e0d92d47-4f5d-49b1-990d-c64222508e84 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:41.238905 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0d92d47-4f5d-49b1-990d-c64222508e84 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:41.239350 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0d92d47-4f5d-49b1-990d-c64222508e84 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:41.240104 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0d92d47-4f5d-49b1-990d-c64222508e84 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:41.240563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0d92d47-4f5d-49b1-990d-c64222508e84 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:41.297621 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ad2cd3a7-615c-44bf-bf01-30afd1f6f6d5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:41.306155 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ad2cd3a7-615c-44bf-bf01-30afd1f6f6d5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.171805 Apr 05 12:10:41.306839 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1313/2606] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:41 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:41.311463 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3369359e-dec9-48ef-8245-8a14fd5257fd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:41.312105 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3369359e-dec9-48ef-8245-8a14fd5257fd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:41.317868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3369359e-dec9-48ef-8245-8a14fd5257fd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:41.318312 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3369359e-dec9-48ef-8245-8a14fd5257fd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:41.319060 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3369359e-dec9-48ef-8245-8a14fd5257fd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:41.319488 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3369359e-dec9-48ef-8245-8a14fd5257fd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:41.376884 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e0d92d47-4f5d-49b1-990d-c64222508e84 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:41.385457 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e0d92d47-4f5d-49b1-990d-c64222508e84 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.157849 Apr 05 12:10:41.386055 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1294/2607] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:41 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:41.455354 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3369359e-dec9-48ef-8245-8a14fd5257fd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:41.464812 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3369359e-dec9-48ef-8245-8a14fd5257fd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:41.466349 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3369359e-dec9-48ef-8245-8a14fd5257fd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:41.467507 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3369359e-dec9-48ef-8245-8a14fd5257fd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.159671 Apr 05 12:10:41.468089 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1314/2608] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:41 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:41.493691 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-53824f58-8f6a-43a6-9c8e-9699e4bb4d35 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:41.494306 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-53824f58-8f6a-43a6-9c8e-9699e4bb4d35 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:41.500823 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-53824f58-8f6a-43a6-9c8e-9699e4bb4d35 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:41.501268 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-53824f58-8f6a-43a6-9c8e-9699e4bb4d35 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:41.502060 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-53824f58-8f6a-43a6-9c8e-9699e4bb4d35 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:41.502488 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-53824f58-8f6a-43a6-9c8e-9699e4bb4d35 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:41.643301 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-53824f58-8f6a-43a6-9c8e-9699e4bb4d35 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:41.651527 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-53824f58-8f6a-43a6-9c8e-9699e4bb4d35 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.161728 Apr 05 12:10:41.652120 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1295/2609] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:41 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:42.327233 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6159510f-14ec-499a-b8d2-449e85fbeddc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:42.328260 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6159510f-14ec-499a-b8d2-449e85fbeddc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:42.336519 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6159510f-14ec-499a-b8d2-449e85fbeddc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:42.336971 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6159510f-14ec-499a-b8d2-449e85fbeddc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:42.337767 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6159510f-14ec-499a-b8d2-449e85fbeddc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:42.338219 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6159510f-14ec-499a-b8d2-449e85fbeddc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:42.403056 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7aee09c3-73ee-4fbb-aac2-1920c10ce8dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:42.403677 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7aee09c3-73ee-4fbb-aac2-1920c10ce8dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:42.410487 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7aee09c3-73ee-4fbb-aac2-1920c10ce8dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:42.410941 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7aee09c3-73ee-4fbb-aac2-1920c10ce8dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:42.411716 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7aee09c3-73ee-4fbb-aac2-1920c10ce8dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:42.412209 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7aee09c3-73ee-4fbb-aac2-1920c10ce8dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:42.481162 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6159510f-14ec-499a-b8d2-449e85fbeddc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:42.489655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6159510f-14ec-499a-b8d2-449e85fbeddc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.169121 Apr 05 12:10:42.490527 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1315/2610] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:42 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:42.495172 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-72c2ee01-82c5-4da6-976e-6c4dec626cd4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:42.495539 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-72c2ee01-82c5-4da6-976e-6c4dec626cd4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:42.501638 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-72c2ee01-82c5-4da6-976e-6c4dec626cd4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:42.502334 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-72c2ee01-82c5-4da6-976e-6c4dec626cd4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:42.502837 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-72c2ee01-82c5-4da6-976e-6c4dec626cd4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:42.503263 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-72c2ee01-82c5-4da6-976e-6c4dec626cd4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:42.550273 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7aee09c3-73ee-4fbb-aac2-1920c10ce8dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:42.558139 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7aee09c3-73ee-4fbb-aac2-1920c10ce8dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.159118 Apr 05 12:10:42.558711 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1296/2611] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:42 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:42.639233 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-72c2ee01-82c5-4da6-976e-6c4dec626cd4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:42.647948 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-72c2ee01-82c5-4da6-976e-6c4dec626cd4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:42.649470 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-72c2ee01-82c5-4da6-976e-6c4dec626cd4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:42.650616 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-72c2ee01-82c5-4da6-976e-6c4dec626cd4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.159370 Apr 05 12:10:42.651352 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1316/2612] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:42 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:42.668695 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-33b33d01-ae83-49c6-aba1-a359258c369b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:42.669312 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-33b33d01-ae83-49c6-aba1-a359258c369b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:42.676251 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-33b33d01-ae83-49c6-aba1-a359258c369b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:42.676702 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-33b33d01-ae83-49c6-aba1-a359258c369b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:42.677610 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-33b33d01-ae83-49c6-aba1-a359258c369b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:42.678011 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-33b33d01-ae83-49c6-aba1-a359258c369b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:42.817771 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-33b33d01-ae83-49c6-aba1-a359258c369b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:42.825662 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-33b33d01-ae83-49c6-aba1-a359258c369b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.160864 Apr 05 12:10:42.826229 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1297/2613] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:42 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:43.509715 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2e9e7625-f6bc-4386-ae92-57ca5d2cc410 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:43.510524 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2e9e7625-f6bc-4386-ae92-57ca5d2cc410 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:43.519296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2e9e7625-f6bc-4386-ae92-57ca5d2cc410 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:43.519898 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2e9e7625-f6bc-4386-ae92-57ca5d2cc410 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:43.520965 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2e9e7625-f6bc-4386-ae92-57ca5d2cc410 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:43.521694 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2e9e7625-f6bc-4386-ae92-57ca5d2cc410 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:43.575384 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b1dbca23-beb4-4d22-a6d7-b642a1e90db5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:43.576055 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b1dbca23-beb4-4d22-a6d7-b642a1e90db5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:43.582571 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b1dbca23-beb4-4d22-a6d7-b642a1e90db5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:43.583023 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b1dbca23-beb4-4d22-a6d7-b642a1e90db5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:43.583792 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b1dbca23-beb4-4d22-a6d7-b642a1e90db5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:43.584319 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b1dbca23-beb4-4d22-a6d7-b642a1e90db5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:43.654342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2e9e7625-f6bc-4386-ae92-57ca5d2cc410 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:43.662284 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2e9e7625-f6bc-4386-ae92-57ca5d2cc410 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.158403 Apr 05 12:10:43.663258 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1317/2614] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:43 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:43.668676 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d2905ef5-97b8-48e5-a4a9-29111e6855a1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:43.669308 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d2905ef5-97b8-48e5-a4a9-29111e6855a1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:43.677034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d2905ef5-97b8-48e5-a4a9-29111e6855a1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:43.677477 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d2905ef5-97b8-48e5-a4a9-29111e6855a1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:43.678517 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d2905ef5-97b8-48e5-a4a9-29111e6855a1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:43.678701 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d2905ef5-97b8-48e5-a4a9-29111e6855a1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:43.718547 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b1dbca23-beb4-4d22-a6d7-b642a1e90db5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:43.726714 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b1dbca23-beb4-4d22-a6d7-b642a1e90db5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.155158 Apr 05 12:10:43.727296 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1298/2615] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:43 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:10:43.816605 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d2905ef5-97b8-48e5-a4a9-29111e6855a1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:43.824943 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d2905ef5-97b8-48e5-a4a9-29111e6855a1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:43.826443 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d2905ef5-97b8-48e5-a4a9-29111e6855a1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:43.827687 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d2905ef5-97b8-48e5-a4a9-29111e6855a1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.162557 Apr 05 12:10:43.828273 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1318/2616] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:43 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:10:43.842791 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0541c335-5235-4572-9d0c-031da05cd610 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:43.843416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0541c335-5235-4572-9d0c-031da05cd610 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:43.849594 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0541c335-5235-4572-9d0c-031da05cd610 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:43.850043 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0541c335-5235-4572-9d0c-031da05cd610 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:43.850793 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0541c335-5235-4572-9d0c-031da05cd610 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:43.851215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0541c335-5235-4572-9d0c-031da05cd610 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:43.991281 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0541c335-5235-4572-9d0c-031da05cd610 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:44.004143 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0541c335-5235-4572-9d0c-031da05cd610 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.164887 Apr 05 12:10:44.005323 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1299/2617] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:43 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:44.683306 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fc05d332-bb10-40ea-b66b-61151636f6c8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:44.684417 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fc05d332-bb10-40ea-b66b-61151636f6c8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:44.694610 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc05d332-bb10-40ea-b66b-61151636f6c8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:44.695064 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc05d332-bb10-40ea-b66b-61151636f6c8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:44.695816 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc05d332-bb10-40ea-b66b-61151636f6c8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:44.696310 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc05d332-bb10-40ea-b66b-61151636f6c8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:44.746101 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-186a85c0-eebf-47dd-8874-b3aa894079c5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:44.746923 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-186a85c0-eebf-47dd-8874-b3aa894079c5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:44.754083 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-186a85c0-eebf-47dd-8874-b3aa894079c5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:44.754990 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-186a85c0-eebf-47dd-8874-b3aa894079c5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:44.755905 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-186a85c0-eebf-47dd-8874-b3aa894079c5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:44.756416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-186a85c0-eebf-47dd-8874-b3aa894079c5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:44.834428 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fc05d332-bb10-40ea-b66b-61151636f6c8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:44.842470 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fc05d332-bb10-40ea-b66b-61151636f6c8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.165654 Apr 05 12:10:44.843040 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1319/2618] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:44 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:44.847376 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5b66522f-34bc-42c9-90d5-f6ab4812973f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:44.847969 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5b66522f-34bc-42c9-90d5-f6ab4812973f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:44.854045 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5b66522f-34bc-42c9-90d5-f6ab4812973f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:44.854484 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5b66522f-34bc-42c9-90d5-f6ab4812973f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:44.855224 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5b66522f-34bc-42c9-90d5-f6ab4812973f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:44.855646 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5b66522f-34bc-42c9-90d5-f6ab4812973f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:44.887772 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-186a85c0-eebf-47dd-8874-b3aa894079c5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:44.895620 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-186a85c0-eebf-47dd-8874-b3aa894079c5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.154948 Apr 05 12:10:44.896224 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1300/2619] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:44 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:44.994273 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5b66522f-34bc-42c9-90d5-f6ab4812973f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:45.002704 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5b66522f-34bc-42c9-90d5-f6ab4812973f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:45.004158 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5b66522f-34bc-42c9-90d5-f6ab4812973f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:45.005642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5b66522f-34bc-42c9-90d5-f6ab4812973f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.161679 Apr 05 12:10:45.006218 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1320/2620] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:44 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:45.022365 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7979bd9e-1f37-47fb-93b4-f62a3aeedab2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:45.022982 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7979bd9e-1f37-47fb-93b4-f62a3aeedab2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:45.029260 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7979bd9e-1f37-47fb-93b4-f62a3aeedab2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:45.029706 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7979bd9e-1f37-47fb-93b4-f62a3aeedab2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:45.030461 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7979bd9e-1f37-47fb-93b4-f62a3aeedab2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:45.030889 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7979bd9e-1f37-47fb-93b4-f62a3aeedab2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:45.180136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7979bd9e-1f37-47fb-93b4-f62a3aeedab2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:45.188509 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7979bd9e-1f37-47fb-93b4-f62a3aeedab2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.169986 Apr 05 12:10:45.189063 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1301/2621] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:45 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:45.860523 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-afaf3b06-cc20-48ed-9831-1c48351f8aa8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:45.861138 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-afaf3b06-cc20-48ed-9831-1c48351f8aa8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:45.868090 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-afaf3b06-cc20-48ed-9831-1c48351f8aa8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:45.868550 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-afaf3b06-cc20-48ed-9831-1c48351f8aa8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:45.869308 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-afaf3b06-cc20-48ed-9831-1c48351f8aa8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:45.869744 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-afaf3b06-cc20-48ed-9831-1c48351f8aa8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:45.912922 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bd6a31d8-82ed-4a62-899c-128edb1c6d94 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:45.913555 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bd6a31d8-82ed-4a62-899c-128edb1c6d94 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:45.920234 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bd6a31d8-82ed-4a62-899c-128edb1c6d94 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:45.920686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bd6a31d8-82ed-4a62-899c-128edb1c6d94 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:45.921448 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bd6a31d8-82ed-4a62-899c-128edb1c6d94 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:45.921880 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bd6a31d8-82ed-4a62-899c-128edb1c6d94 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:46.001928 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-afaf3b06-cc20-48ed-9831-1c48351f8aa8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:46.010232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-afaf3b06-cc20-48ed-9831-1c48351f8aa8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.153562 Apr 05 12:10:46.010798 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1321/2622] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:45 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:46.023892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5f16589d-b93b-4580-a487-0c83ad225c67 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:46.024555 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5f16589d-b93b-4580-a487-0c83ad225c67 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:46.030389 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5f16589d-b93b-4580-a487-0c83ad225c67 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:46.030858 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5f16589d-b93b-4580-a487-0c83ad225c67 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:46.031599 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5f16589d-b93b-4580-a487-0c83ad225c67 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:46.032034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5f16589d-b93b-4580-a487-0c83ad225c67 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:46.055262 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-bd6a31d8-82ed-4a62-899c-128edb1c6d94 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:46.063138 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bd6a31d8-82ed-4a62-899c-128edb1c6d94 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.154130 Apr 05 12:10:46.063716 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1302/2623] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:45 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:46.162353 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5f16589d-b93b-4580-a487-0c83ad225c67 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:46.171336 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5f16589d-b93b-4580-a487-0c83ad225c67 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:46.172874 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5f16589d-b93b-4580-a487-0c83ad225c67 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:46.174022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5f16589d-b93b-4580-a487-0c83ad225c67 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.153915 Apr 05 12:10:46.174577 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1322/2624] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:46 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:10:46.206363 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8894640c-e3ca-45fd-9bc2-50ce4d2e10df tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:46.206985 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8894640c-e3ca-45fd-9bc2-50ce4d2e10df tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:46.213032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8894640c-e3ca-45fd-9bc2-50ce4d2e10df tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:46.213522 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8894640c-e3ca-45fd-9bc2-50ce4d2e10df tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:46.214280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8894640c-e3ca-45fd-9bc2-50ce4d2e10df tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:46.214717 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8894640c-e3ca-45fd-9bc2-50ce4d2e10df tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:46.351692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8894640c-e3ca-45fd-9bc2-50ce4d2e10df tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:46.363610 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8894640c-e3ca-45fd-9bc2-50ce4d2e10df tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.160894 Apr 05 12:10:46.364485 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1303/2625] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:46 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:47.031208 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-56f25f9a-413a-40c4-9ee4-3d12e69070a7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:47.032237 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-56f25f9a-413a-40c4-9ee4-3d12e69070a7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:47.040767 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-56f25f9a-413a-40c4-9ee4-3d12e69070a7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:47.041216 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-56f25f9a-413a-40c4-9ee4-3d12e69070a7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:47.041971 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-56f25f9a-413a-40c4-9ee4-3d12e69070a7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:47.042403 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-56f25f9a-413a-40c4-9ee4-3d12e69070a7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:47.080919 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-105a3421-9d79-480e-8fed-2a41ce798dc7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:47.081684 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-105a3421-9d79-480e-8fed-2a41ce798dc7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:47.088748 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-105a3421-9d79-480e-8fed-2a41ce798dc7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:47.089285 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-105a3421-9d79-480e-8fed-2a41ce798dc7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:47.090138 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-105a3421-9d79-480e-8fed-2a41ce798dc7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:47.090643 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-105a3421-9d79-480e-8fed-2a41ce798dc7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:47.194023 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-56f25f9a-413a-40c4-9ee4-3d12e69070a7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:47.201981 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-56f25f9a-413a-40c4-9ee4-3d12e69070a7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.177181 Apr 05 12:10:47.202586 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1323/2626] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:47 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:47.207099 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-aee97880-5127-4564-9d69-900872d1f74a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:47.207916 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-aee97880-5127-4564-9d69-900872d1f74a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:47.213849 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aee97880-5127-4564-9d69-900872d1f74a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:47.214501 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aee97880-5127-4564-9d69-900872d1f74a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:47.215254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aee97880-5127-4564-9d69-900872d1f74a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:47.215685 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aee97880-5127-4564-9d69-900872d1f74a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:47.229020 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-105a3421-9d79-480e-8fed-2a41ce798dc7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:47.236899 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-105a3421-9d79-480e-8fed-2a41ce798dc7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.159927 Apr 05 12:10:47.237658 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1304/2627] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:47 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:47.355614 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-aee97880-5127-4564-9d69-900872d1f74a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:47.364560 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-aee97880-5127-4564-9d69-900872d1f74a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:47.366136 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-aee97880-5127-4564-9d69-900872d1f74a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:47.367294 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-aee97880-5127-4564-9d69-900872d1f74a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.163795 Apr 05 12:10:47.367853 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1324/2628] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:47 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:47.388409 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d6ecb72b-fcd4-44b0-bf4f-6917ffed5044 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:47.388945 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d6ecb72b-fcd4-44b0-bf4f-6917ffed5044 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:47.395458 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d6ecb72b-fcd4-44b0-bf4f-6917ffed5044 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:47.395902 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d6ecb72b-fcd4-44b0-bf4f-6917ffed5044 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:47.396791 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d6ecb72b-fcd4-44b0-bf4f-6917ffed5044 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:47.397227 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d6ecb72b-fcd4-44b0-bf4f-6917ffed5044 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:47.545559 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d6ecb72b-fcd4-44b0-bf4f-6917ffed5044 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:47.553987 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d6ecb72b-fcd4-44b0-bf4f-6917ffed5044 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.169664 Apr 05 12:10:47.554559 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1305/2629] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:47 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:48.219226 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-88f1afa6-7527-4536-bee2-38adda4b3b53 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:48.219838 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-88f1afa6-7527-4536-bee2-38adda4b3b53 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:48.226646 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-88f1afa6-7527-4536-bee2-38adda4b3b53 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:48.227095 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-88f1afa6-7527-4536-bee2-38adda4b3b53 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:48.227849 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-88f1afa6-7527-4536-bee2-38adda4b3b53 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:48.228332 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-88f1afa6-7527-4536-bee2-38adda4b3b53 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:48.254743 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ae01408f-e87e-4819-97e2-13717f1f81c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:48.255328 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ae01408f-e87e-4819-97e2-13717f1f81c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:48.262174 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae01408f-e87e-4819-97e2-13717f1f81c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:48.262596 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae01408f-e87e-4819-97e2-13717f1f81c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:48.263362 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae01408f-e87e-4819-97e2-13717f1f81c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:48.263790 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae01408f-e87e-4819-97e2-13717f1f81c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:48.366003 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-88f1afa6-7527-4536-bee2-38adda4b3b53 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:48.373995 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-88f1afa6-7527-4536-bee2-38adda4b3b53 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.158700 Apr 05 12:10:48.374866 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1325/2630] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:48 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:48.385061 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-14162bd1-d1ac-41df-a606-3876293f635d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:48.385658 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-14162bd1-d1ac-41df-a606-3876293f635d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:48.391913 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14162bd1-d1ac-41df-a606-3876293f635d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:48.392207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14162bd1-d1ac-41df-a606-3876293f635d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:48.392962 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14162bd1-d1ac-41df-a606-3876293f635d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:48.393389 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14162bd1-d1ac-41df-a606-3876293f635d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:48.394503 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ae01408f-e87e-4819-97e2-13717f1f81c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:48.402421 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ae01408f-e87e-4819-97e2-13717f1f81c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.151921 Apr 05 12:10:48.402999 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1306/2631] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:48 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:48.533225 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-14162bd1-d1ac-41df-a606-3876293f635d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:48.542369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-14162bd1-d1ac-41df-a606-3876293f635d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:48.543855 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-14162bd1-d1ac-41df-a606-3876293f635d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:48.545070 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-14162bd1-d1ac-41df-a606-3876293f635d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.163826 Apr 05 12:10:48.545587 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1326/2632] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:48 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:48.572200 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ebe23a11-d73f-44a6-a8f5-893f82fdb684 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:48.572836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ebe23a11-d73f-44a6-a8f5-893f82fdb684 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:48.578992 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ebe23a11-d73f-44a6-a8f5-893f82fdb684 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:48.579446 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ebe23a11-d73f-44a6-a8f5-893f82fdb684 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:48.580235 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ebe23a11-d73f-44a6-a8f5-893f82fdb684 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:48.580707 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ebe23a11-d73f-44a6-a8f5-893f82fdb684 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:48.722693 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ebe23a11-d73f-44a6-a8f5-893f82fdb684 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:48.734944 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ebe23a11-d73f-44a6-a8f5-893f82fdb684 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.166410 Apr 05 12:10:48.735632 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1307/2633] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:48 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:49.394945 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-84a92844-63da-4990-b5e7-f11b564e95be tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:49.395892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-84a92844-63da-4990-b5e7-f11b564e95be tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:49.406599 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84a92844-63da-4990-b5e7-f11b564e95be tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:49.407347 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84a92844-63da-4990-b5e7-f11b564e95be tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:49.408639 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84a92844-63da-4990-b5e7-f11b564e95be tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:49.409366 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-84a92844-63da-4990-b5e7-f11b564e95be tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:49.419459 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c1fb1271-5b5e-4ac1-a0a2-58f58d25ae9a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:49.420185 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c1fb1271-5b5e-4ac1-a0a2-58f58d25ae9a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:49.426731 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1fb1271-5b5e-4ac1-a0a2-58f58d25ae9a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:49.427182 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1fb1271-5b5e-4ac1-a0a2-58f58d25ae9a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:49.427949 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1fb1271-5b5e-4ac1-a0a2-58f58d25ae9a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:49.428432 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1fb1271-5b5e-4ac1-a0a2-58f58d25ae9a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:49.545709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-84a92844-63da-4990-b5e7-f11b564e95be tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:49.553988 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-84a92844-63da-4990-b5e7-f11b564e95be tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.165645 Apr 05 12:10:49.566142 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1327/2634] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:49 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:49.566270 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c1fb1271-5b5e-4ac1-a0a2-58f58d25ae9a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:49.566421 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-56605c27-dc1f-4910-a058-ea695ab19531 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:49.566640 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-56605c27-dc1f-4910-a058-ea695ab19531 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:49.571456 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c1fb1271-5b5e-4ac1-a0a2-58f58d25ae9a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.155891 Apr 05 12:10:49.572053 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1308/2635] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:49 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:49.572702 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-56605c27-dc1f-4910-a058-ea695ab19531 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:49.573147 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-56605c27-dc1f-4910-a058-ea695ab19531 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:49.573909 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-56605c27-dc1f-4910-a058-ea695ab19531 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:49.574324 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-56605c27-dc1f-4910-a058-ea695ab19531 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:49.717722 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-56605c27-dc1f-4910-a058-ea695ab19531 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:49.726202 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-56605c27-dc1f-4910-a058-ea695ab19531 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:49.727729 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-56605c27-dc1f-4910-a058-ea695ab19531 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:49.728917 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-56605c27-dc1f-4910-a058-ea695ab19531 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.167555 Apr 05 12:10:49.729434 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1328/2636] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:49 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:49.752733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e58ab68f-10e9-4cd5-9782-8e1d7853015d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:49.753343 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e58ab68f-10e9-4cd5-9782-8e1d7853015d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:49.760030 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e58ab68f-10e9-4cd5-9782-8e1d7853015d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:49.760527 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e58ab68f-10e9-4cd5-9782-8e1d7853015d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:49.761281 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e58ab68f-10e9-4cd5-9782-8e1d7853015d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:49.761709 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e58ab68f-10e9-4cd5-9782-8e1d7853015d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:49.901306 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e58ab68f-10e9-4cd5-9782-8e1d7853015d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:49.909593 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e58ab68f-10e9-4cd5-9782-8e1d7853015d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.160749 Apr 05 12:10:49.910173 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1309/2637] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:49 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:50.579439 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b8fae16b-6097-49d2-8bd3-db188ea3aa14 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:50.580487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b8fae16b-6097-49d2-8bd3-db188ea3aa14 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:50.590836 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b8fae16b-6097-49d2-8bd3-db188ea3aa14 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:50.591581 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b8fae16b-6097-49d2-8bd3-db188ea3aa14 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:50.592888 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b8fae16b-6097-49d2-8bd3-db188ea3aa14 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:50.593611 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b8fae16b-6097-49d2-8bd3-db188ea3aa14 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:50.593859 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c4d5345e-5921-4cec-896c-4d2436881e2a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:50.594716 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c4d5345e-5921-4cec-896c-4d2436881e2a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:50.603459 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c4d5345e-5921-4cec-896c-4d2436881e2a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:50.603899 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c4d5345e-5921-4cec-896c-4d2436881e2a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:50.604784 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c4d5345e-5921-4cec-896c-4d2436881e2a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:50.605245 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c4d5345e-5921-4cec-896c-4d2436881e2a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:50.729415 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b8fae16b-6097-49d2-8bd3-db188ea3aa14 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:50.736845 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c4d5345e-5921-4cec-896c-4d2436881e2a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:50.738040 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b8fae16b-6097-49d2-8bd3-db188ea3aa14 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.165112 Apr 05 12:10:50.738779 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1329/2638] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:50 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:50.745027 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c4d5345e-5921-4cec-896c-4d2436881e2a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.157909 Apr 05 12:10:50.745846 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1310/2639] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:50 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:50.753637 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-66c1f952-7f61-4605-984b-5f12aa4f4602 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:50.754537 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-66c1f952-7f61-4605-984b-5f12aa4f4602 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:50.760585 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-66c1f952-7f61-4605-984b-5f12aa4f4602 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:50.761027 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-66c1f952-7f61-4605-984b-5f12aa4f4602 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:50.761778 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-66c1f952-7f61-4605-984b-5f12aa4f4602 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:50.762233 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-66c1f952-7f61-4605-984b-5f12aa4f4602 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:50.901702 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-66c1f952-7f61-4605-984b-5f12aa4f4602 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:50.910443 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-66c1f952-7f61-4605-984b-5f12aa4f4602 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:50.912013 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-66c1f952-7f61-4605-984b-5f12aa4f4602 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:50.913285 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-66c1f952-7f61-4605-984b-5f12aa4f4602 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.163715 Apr 05 12:10:50.913854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1330/2640] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:50 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:50.926885 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-70871ef5-1b49-401e-a02a-08c64a45e9b9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:50.927499 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-70871ef5-1b49-401e-a02a-08c64a45e9b9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:50.933543 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-70871ef5-1b49-401e-a02a-08c64a45e9b9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:50.933977 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-70871ef5-1b49-401e-a02a-08c64a45e9b9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:50.934778 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-70871ef5-1b49-401e-a02a-08c64a45e9b9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:50.935195 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-70871ef5-1b49-401e-a02a-08c64a45e9b9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:51.087290 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-70871ef5-1b49-401e-a02a-08c64a45e9b9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:51.095070 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-70871ef5-1b49-401e-a02a-08c64a45e9b9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.172133 Apr 05 12:10:51.095716 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1311/2641] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:50 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:51.761775 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a7ba87e2-352c-4c1f-a63b-d5c97946cd74 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:51.762603 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a7ba87e2-352c-4c1f-a63b-d5c97946cd74 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:51.767875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6813e97e-a7df-49d1-af84-080d827e06e4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:51.768664 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6813e97e-a7df-49d1-af84-080d827e06e4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:51.772676 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7ba87e2-352c-4c1f-a63b-d5c97946cd74 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:51.773116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7ba87e2-352c-4c1f-a63b-d5c97946cd74 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:51.773871 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7ba87e2-352c-4c1f-a63b-d5c97946cd74 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:51.774274 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7ba87e2-352c-4c1f-a63b-d5c97946cd74 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:51.775915 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6813e97e-a7df-49d1-af84-080d827e06e4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:51.776413 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6813e97e-a7df-49d1-af84-080d827e06e4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:51.777170 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6813e97e-a7df-49d1-af84-080d827e06e4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:51.777598 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6813e97e-a7df-49d1-af84-080d827e06e4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:51.910897 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a7ba87e2-352c-4c1f-a63b-d5c97946cd74 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:51.912377 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6813e97e-a7df-49d1-af84-080d827e06e4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:51.918936 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a7ba87e2-352c-4c1f-a63b-d5c97946cd74 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.163848 Apr 05 12:10:51.919532 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1331/2642] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:51 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:51.920114 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6813e97e-a7df-49d1-af84-080d827e06e4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.159311 Apr 05 12:10:51.920977 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1312/2643] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:51 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:51.933375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-045fd69d-2609-48fd-9f08-468d4034a89b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:51.933974 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-045fd69d-2609-48fd-9f08-468d4034a89b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:51.939887 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-045fd69d-2609-48fd-9f08-468d4034a89b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:51.940379 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-045fd69d-2609-48fd-9f08-468d4034a89b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:51.941128 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-045fd69d-2609-48fd-9f08-468d4034a89b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:51.941553 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-045fd69d-2609-48fd-9f08-468d4034a89b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:52.077528 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-045fd69d-2609-48fd-9f08-468d4034a89b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:52.091214 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-045fd69d-2609-48fd-9f08-468d4034a89b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:52.093518 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-045fd69d-2609-48fd-9f08-468d4034a89b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:52.095248 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-045fd69d-2609-48fd-9f08-468d4034a89b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.165432 Apr 05 12:10:52.096023 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1332/2644] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:51 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:10:52.112600 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-21da9069-65d3-47d6-84d1-424d6a73f7fe tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:52.113255 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-21da9069-65d3-47d6-84d1-424d6a73f7fe tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:52.119353 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-21da9069-65d3-47d6-84d1-424d6a73f7fe tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:52.119801 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-21da9069-65d3-47d6-84d1-424d6a73f7fe tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:52.120578 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-21da9069-65d3-47d6-84d1-424d6a73f7fe tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:52.121008 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-21da9069-65d3-47d6-84d1-424d6a73f7fe tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:52.252654 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-21da9069-65d3-47d6-84d1-424d6a73f7fe tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:52.261747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-21da9069-65d3-47d6-84d1-424d6a73f7fe tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.153112 Apr 05 12:10:52.262333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1313/2645] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:52 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:52.936938 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-51704d2d-6406-4033-a8f6-fbe577c33ba0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:52.937467 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-144557c5-82d0-4e7a-8b63-9ac2b5ab7ddc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:52.937870 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-51704d2d-6406-4033-a8f6-fbe577c33ba0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:52.938174 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-144557c5-82d0-4e7a-8b63-9ac2b5ab7ddc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:52.944609 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-51704d2d-6406-4033-a8f6-fbe577c33ba0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:52.945051 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-51704d2d-6406-4033-a8f6-fbe577c33ba0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:52.945447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-144557c5-82d0-4e7a-8b63-9ac2b5ab7ddc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:52.945799 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-51704d2d-6406-4033-a8f6-fbe577c33ba0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:52.945960 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-144557c5-82d0-4e7a-8b63-9ac2b5ab7ddc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:52.946225 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-51704d2d-6406-4033-a8f6-fbe577c33ba0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:52.946650 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-144557c5-82d0-4e7a-8b63-9ac2b5ab7ddc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:52.947082 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-144557c5-82d0-4e7a-8b63-9ac2b5ab7ddc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:53.083866 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-144557c5-82d0-4e7a-8b63-9ac2b5ab7ddc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:53.084483 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-51704d2d-6406-4033-a8f6-fbe577c33ba0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:53.091782 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-144557c5-82d0-4e7a-8b63-9ac2b5ab7ddc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.158345 Apr 05 12:10:53.092381 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1314/2646] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:52 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:53.092535 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-51704d2d-6406-4033-a8f6-fbe577c33ba0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.159603 Apr 05 12:10:53.093030 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1333/2647] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:52 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:53.114346 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-68b7ed4e-2840-4279-9aa9-007a5b4c32c4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:53.114968 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-68b7ed4e-2840-4279-9aa9-007a5b4c32c4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:53.120612 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-68b7ed4e-2840-4279-9aa9-007a5b4c32c4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:53.121047 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-68b7ed4e-2840-4279-9aa9-007a5b4c32c4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:53.121796 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-68b7ed4e-2840-4279-9aa9-007a5b4c32c4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:53.122285 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-68b7ed4e-2840-4279-9aa9-007a5b4c32c4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:53.263415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-68b7ed4e-2840-4279-9aa9-007a5b4c32c4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:53.272204 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-68b7ed4e-2840-4279-9aa9-007a5b4c32c4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:53.273771 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-68b7ed4e-2840-4279-9aa9-007a5b4c32c4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:53.274954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-68b7ed4e-2840-4279-9aa9-007a5b4c32c4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.164292 Apr 05 12:10:53.275476 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1315/2648] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:53 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:10:53.278707 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9fb57e91-8468-4f72-aa80-4039b6a029b5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:53.279323 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9fb57e91-8468-4f72-aa80-4039b6a029b5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:53.285938 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fb57e91-8468-4f72-aa80-4039b6a029b5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:53.286605 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fb57e91-8468-4f72-aa80-4039b6a029b5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:53.287802 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fb57e91-8468-4f72-aa80-4039b6a029b5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:53.288536 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fb57e91-8468-4f72-aa80-4039b6a029b5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:53.425578 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9fb57e91-8468-4f72-aa80-4039b6a029b5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:53.433608 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9fb57e91-8468-4f72-aa80-4039b6a029b5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.158640 Apr 05 12:10:53.434178 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1334/2649] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:53 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:53.762900 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:10:53.763243 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Tue Apr 5 12:10:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:10:54.113908 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cb96bd73-8239-4634-abae-58322a787133 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:54.114782 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-837dd502-a5b1-4c41-856f-1a4d5bb11cf9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:54.115388 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cb96bd73-8239-4634-abae-58322a787133 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:54.115487 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-837dd502-a5b1-4c41-856f-1a4d5bb11cf9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:54.121449 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cb96bd73-8239-4634-abae-58322a787133 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:54.121668 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-837dd502-a5b1-4c41-856f-1a4d5bb11cf9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:54.121906 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-837dd502-a5b1-4c41-856f-1a4d5bb11cf9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:54.122051 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cb96bd73-8239-4634-abae-58322a787133 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:54.122642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cb96bd73-8239-4634-abae-58322a787133 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:54.122809 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-837dd502-a5b1-4c41-856f-1a4d5bb11cf9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:54.123072 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-837dd502-a5b1-4c41-856f-1a4d5bb11cf9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:54.123218 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cb96bd73-8239-4634-abae-58322a787133 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:54.258961 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-837dd502-a5b1-4c41-856f-1a4d5bb11cf9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:54.259178 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cb96bd73-8239-4634-abae-58322a787133 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:54.267106 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-837dd502-a5b1-4c41-856f-1a4d5bb11cf9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.160086 Apr 05 12:10:54.267345 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cb96bd73-8239-4634-abae-58322a787133 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.160150 Apr 05 12:10:54.267849 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1316/2650] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:54 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:54.268190 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1335/2651] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:54 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:54.292944 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cbb61b36-4aab-4a47-a633-dd478b47d545 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:54.293551 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cbb61b36-4aab-4a47-a633-dd478b47d545 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:54.299769 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cbb61b36-4aab-4a47-a633-dd478b47d545 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:54.300115 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cbb61b36-4aab-4a47-a633-dd478b47d545 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:54.300880 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cbb61b36-4aab-4a47-a633-dd478b47d545 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:54.301310 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cbb61b36-4aab-4a47-a633-dd478b47d545 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:54.437331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-cbb61b36-4aab-4a47-a633-dd478b47d545 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:54.446386 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-cbb61b36-4aab-4a47-a633-dd478b47d545 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:54.447929 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-cbb61b36-4aab-4a47-a633-dd478b47d545 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:54.449313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cbb61b36-4aab-4a47-a633-dd478b47d545 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.160188 Apr 05 12:10:54.449886 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1317/2652] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:54 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:54.450874 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-640ba3b7-6b80-4f33-9696-eac0e6e6d50a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:54.451489 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-640ba3b7-6b80-4f33-9696-eac0e6e6d50a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:54.457589 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-640ba3b7-6b80-4f33-9696-eac0e6e6d50a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:54.458072 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-640ba3b7-6b80-4f33-9696-eac0e6e6d50a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:54.458823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-640ba3b7-6b80-4f33-9696-eac0e6e6d50a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:54.459254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-640ba3b7-6b80-4f33-9696-eac0e6e6d50a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:54.594827 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-640ba3b7-6b80-4f33-9696-eac0e6e6d50a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:54.603277 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-640ba3b7-6b80-4f33-9696-eac0e6e6d50a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.156299 Apr 05 12:10:54.603892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1336/2653] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:54 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:55.287948 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3e4535a2-b148-41fc-8700-5e7a64f2aeff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:55.288523 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-afa79674-0dbb-4d1a-be62-df7d84341c2a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:55.288889 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3e4535a2-b148-41fc-8700-5e7a64f2aeff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:55.288994 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-afa79674-0dbb-4d1a-be62-df7d84341c2a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:55.295280 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-afa79674-0dbb-4d1a-be62-df7d84341c2a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:55.295546 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e4535a2-b148-41fc-8700-5e7a64f2aeff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:55.295700 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e4535a2-b148-41fc-8700-5e7a64f2aeff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:55.295822 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-afa79674-0dbb-4d1a-be62-df7d84341c2a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:55.296508 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e4535a2-b148-41fc-8700-5e7a64f2aeff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:55.296656 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-afa79674-0dbb-4d1a-be62-df7d84341c2a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:55.296933 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e4535a2-b148-41fc-8700-5e7a64f2aeff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:55.297075 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-afa79674-0dbb-4d1a-be62-df7d84341c2a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:55.436859 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3e4535a2-b148-41fc-8700-5e7a64f2aeff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:55.439502 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-afa79674-0dbb-4d1a-be62-df7d84341c2a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:55.445389 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3e4535a2-b148-41fc-8700-5e7a64f2aeff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.163455 Apr 05 12:10:55.445992 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1318/2654] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:55 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:55.447386 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-afa79674-0dbb-4d1a-be62-df7d84341c2a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.165287 Apr 05 12:10:55.447968 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1337/2655] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:55 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:55.467266 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-db5e64af-9fbc-42c1-a778-73c280b398c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:55.467882 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-db5e64af-9fbc-42c1-a778-73c280b398c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:55.473633 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-db5e64af-9fbc-42c1-a778-73c280b398c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:55.474069 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-db5e64af-9fbc-42c1-a778-73c280b398c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:55.474810 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-db5e64af-9fbc-42c1-a778-73c280b398c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:55.475231 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-db5e64af-9fbc-42c1-a778-73c280b398c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:55.614945 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-db5e64af-9fbc-42c1-a778-73c280b398c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:55.620164 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-768d687f-1688-4d98-8257-d06908be6fbd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:55.620757 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-768d687f-1688-4d98-8257-d06908be6fbd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:55.623748 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-db5e64af-9fbc-42c1-a778-73c280b398c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:55.625277 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-db5e64af-9fbc-42c1-a778-73c280b398c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:55.626423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-db5e64af-9fbc-42c1-a778-73c280b398c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.162969 Apr 05 12:10:55.626999 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1319/2656] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:55 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:55.627144 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-768d687f-1688-4d98-8257-d06908be6fbd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:55.627503 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-768d687f-1688-4d98-8257-d06908be6fbd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:55.628380 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-768d687f-1688-4d98-8257-d06908be6fbd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:55.628813 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-768d687f-1688-4d98-8257-d06908be6fbd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:55.767318 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-768d687f-1688-4d98-8257-d06908be6fbd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:55.775868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-768d687f-1688-4d98-8257-d06908be6fbd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.159930 Apr 05 12:10:55.776500 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1338/2657] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:55 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:10:56.463006 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f091b451-03b5-4375-9988-01c891b24f03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:56.463700 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f091b451-03b5-4375-9988-01c891b24f03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:56.464427 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0711d757-0d5c-498b-a21a-2a171f774a63 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:56.465036 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0711d757-0d5c-498b-a21a-2a171f774a63 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:56.470344 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f091b451-03b5-4375-9988-01c891b24f03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:56.470884 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f091b451-03b5-4375-9988-01c891b24f03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:56.471426 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0711d757-0d5c-498b-a21a-2a171f774a63 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:56.471775 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f091b451-03b5-4375-9988-01c891b24f03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:56.471925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0711d757-0d5c-498b-a21a-2a171f774a63 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:56.472344 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f091b451-03b5-4375-9988-01c891b24f03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:56.472648 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0711d757-0d5c-498b-a21a-2a171f774a63 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:56.473082 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0711d757-0d5c-498b-a21a-2a171f774a63 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:56.604500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f091b451-03b5-4375-9988-01c891b24f03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:56.606451 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0711d757-0d5c-498b-a21a-2a171f774a63 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:56.612373 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f091b451-03b5-4375-9988-01c891b24f03 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.153433 Apr 05 12:10:56.612942 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1320/2658] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:56 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:56.614283 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0711d757-0d5c-498b-a21a-2a171f774a63 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.153790 Apr 05 12:10:56.615036 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1339/2659] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:56 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:56.644792 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2362215b-9055-4e0f-b212-d7aaeb9d3856 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:56.645321 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2362215b-9055-4e0f-b212-d7aaeb9d3856 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:56.651044 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2362215b-9055-4e0f-b212-d7aaeb9d3856 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:56.651485 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2362215b-9055-4e0f-b212-d7aaeb9d3856 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:56.652277 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2362215b-9055-4e0f-b212-d7aaeb9d3856 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:56.652707 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2362215b-9055-4e0f-b212-d7aaeb9d3856 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:56.786673 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2362215b-9055-4e0f-b212-d7aaeb9d3856 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:56.793387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-031ea6f0-2a55-4a0d-b405-5fc220550160 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:56.793992 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-031ea6f0-2a55-4a0d-b405-5fc220550160 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:56.795117 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2362215b-9055-4e0f-b212-d7aaeb9d3856 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:56.796899 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2362215b-9055-4e0f-b212-d7aaeb9d3856 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:56.798056 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2362215b-9055-4e0f-b212-d7aaeb9d3856 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.157009 Apr 05 12:10:56.798595 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1321/2660] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:56 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:10:56.799874 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-031ea6f0-2a55-4a0d-b405-5fc220550160 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:56.800424 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-031ea6f0-2a55-4a0d-b405-5fc220550160 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:56.801215 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-031ea6f0-2a55-4a0d-b405-5fc220550160 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:56.801651 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-031ea6f0-2a55-4a0d-b405-5fc220550160 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:56.940523 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-031ea6f0-2a55-4a0d-b405-5fc220550160 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:56.948680 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-031ea6f0-2a55-4a0d-b405-5fc220550160 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.159160 Apr 05 12:10:56.949265 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1340/2661] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:56 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:57.633274 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0ab66580-7f01-4a60-a013-6fb883f0139e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:57.633953 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0ab66580-7f01-4a60-a013-6fb883f0139e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:57.634841 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fc3bd50b-b8cb-4b85-8d8e-809cf9d47a95 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:57.635569 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fc3bd50b-b8cb-4b85-8d8e-809cf9d47a95 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:57.641564 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0ab66580-7f01-4a60-a013-6fb883f0139e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:57.642092 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0ab66580-7f01-4a60-a013-6fb883f0139e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:57.642984 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0ab66580-7f01-4a60-a013-6fb883f0139e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:57.643478 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc3bd50b-b8cb-4b85-8d8e-809cf9d47a95 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:57.643637 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0ab66580-7f01-4a60-a013-6fb883f0139e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:57.644011 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc3bd50b-b8cb-4b85-8d8e-809cf9d47a95 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:57.644947 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc3bd50b-b8cb-4b85-8d8e-809cf9d47a95 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:57.645462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc3bd50b-b8cb-4b85-8d8e-809cf9d47a95 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:57.779690 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0ab66580-7f01-4a60-a013-6fb883f0139e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:57.780375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fc3bd50b-b8cb-4b85-8d8e-809cf9d47a95 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:57.787640 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0ab66580-7f01-4a60-a013-6fb883f0139e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.160450 Apr 05 12:10:57.788132 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fc3bd50b-b8cb-4b85-8d8e-809cf9d47a95 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.158696 Apr 05 12:10:57.788699 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1341/2662] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:57 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:57.789643 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1322/2663] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:57 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:57.815647 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b3c3f53f-8c59-4d18-a73d-b469f3d2894d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:57.816305 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b3c3f53f-8c59-4d18-a73d-b469f3d2894d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:57.822415 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b3c3f53f-8c59-4d18-a73d-b469f3d2894d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:57.822857 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b3c3f53f-8c59-4d18-a73d-b469f3d2894d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:57.823581 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b3c3f53f-8c59-4d18-a73d-b469f3d2894d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:57.824029 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b3c3f53f-8c59-4d18-a73d-b469f3d2894d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:57.964974 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b3c3f53f-8c59-4d18-a73d-b469f3d2894d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:57.966299 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ab5cc122-5694-4325-a768-7b40216afbf4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:57.966957 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ab5cc122-5694-4325-a768-7b40216afbf4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:57.972894 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab5cc122-5694-4325-a768-7b40216afbf4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:57.973339 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab5cc122-5694-4325-a768-7b40216afbf4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:57.974097 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab5cc122-5694-4325-a768-7b40216afbf4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:57.974227 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b3c3f53f-8c59-4d18-a73d-b469f3d2894d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:57.974521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab5cc122-5694-4325-a768-7b40216afbf4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:57.975627 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b3c3f53f-8c59-4d18-a73d-b469f3d2894d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:57.976811 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b3c3f53f-8c59-4d18-a73d-b469f3d2894d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.164969 Apr 05 12:10:57.977386 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1342/2664] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:57 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:58.113140 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ab5cc122-5694-4325-a768-7b40216afbf4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:58.125316 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ab5cc122-5694-4325-a768-7b40216afbf4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.162685 Apr 05 12:10:58.126041 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1323/2665] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:57 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:58.807291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a7bddf32-fe5c-4234-9e2f-7975bd55f8c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:58.808008 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4bc00927-fbb2-40b8-8941-52aa43e61f84 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:58.808560 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a7bddf32-fe5c-4234-9e2f-7975bd55f8c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:58.808693 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4bc00927-fbb2-40b8-8941-52aa43e61f84 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:58.815620 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7bddf32-fe5c-4234-9e2f-7975bd55f8c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:58.816224 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7bddf32-fe5c-4234-9e2f-7975bd55f8c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:58.816443 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4bc00927-fbb2-40b8-8941-52aa43e61f84 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:58.816786 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4bc00927-fbb2-40b8-8941-52aa43e61f84 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:58.817252 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7bddf32-fe5c-4234-9e2f-7975bd55f8c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:58.817736 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4bc00927-fbb2-40b8-8941-52aa43e61f84 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:58.817920 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7bddf32-fe5c-4234-9e2f-7975bd55f8c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:58.818357 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4bc00927-fbb2-40b8-8941-52aa43e61f84 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:58.952873 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4bc00927-fbb2-40b8-8941-52aa43e61f84 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:58.953137 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a7bddf32-fe5c-4234-9e2f-7975bd55f8c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:58.960978 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4bc00927-fbb2-40b8-8941-52aa43e61f84 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.158344 Apr 05 12:10:58.961176 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a7bddf32-fe5c-4234-9e2f-7975bd55f8c2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.159127 Apr 05 12:10:58.961517 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1324/2666] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:58 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:58.961832 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1343/2667] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:58 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:58.994759 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-aa3fa472-8f3b-46df-9481-310030623f27 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:58.995367 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-aa3fa472-8f3b-46df-9481-310030623f27 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:59.001372 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aa3fa472-8f3b-46df-9481-310030623f27 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:59.001819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aa3fa472-8f3b-46df-9481-310030623f27 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:59.002570 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aa3fa472-8f3b-46df-9481-310030623f27 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:59.003001 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aa3fa472-8f3b-46df-9481-310030623f27 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:59.145056 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-35e6b00a-d0d9-446d-94f3-0a186411a5ad tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:59.145801 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-35e6b00a-d0d9-446d-94f3-0a186411a5ad tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:59.148963 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-aa3fa472-8f3b-46df-9481-310030623f27 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:59.152225 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-35e6b00a-d0d9-446d-94f3-0a186411a5ad tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:59.152660 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-35e6b00a-d0d9-446d-94f3-0a186411a5ad tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:59.153415 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-35e6b00a-d0d9-446d-94f3-0a186411a5ad tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:59.153846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-35e6b00a-d0d9-446d-94f3-0a186411a5ad tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:59.157652 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-aa3fa472-8f3b-46df-9481-310030623f27 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:59.159162 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-aa3fa472-8f3b-46df-9481-310030623f27 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:59.160384 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-aa3fa472-8f3b-46df-9481-310030623f27 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.169371 Apr 05 12:10:59.160969 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1325/2668] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:10:58 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:59.292765 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-35e6b00a-d0d9-446d-94f3-0a186411a5ad tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:10:59.301572 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-35e6b00a-d0d9-446d-94f3-0a186411a5ad tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.160493 Apr 05 12:10:59.302143 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1344/2669] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:59 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:59.978830 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0c81e96c-9a53-4921-bf2d-6b486d5b2dfc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:59.979401 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-14887f17-8dbe-40e7-8b70-45130f407557 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:10:59.979779 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0c81e96c-9a53-4921-bf2d-6b486d5b2dfc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:59.979888 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-14887f17-8dbe-40e7-8b70-45130f407557 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:10:59.988234 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0c81e96c-9a53-4921-bf2d-6b486d5b2dfc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:59.988606 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14887f17-8dbe-40e7-8b70-45130f407557 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:59.988880 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0c81e96c-9a53-4921-bf2d-6b486d5b2dfc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:59.989254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14887f17-8dbe-40e7-8b70-45130f407557 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:59.990124 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0c81e96c-9a53-4921-bf2d-6b486d5b2dfc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:59.990589 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14887f17-8dbe-40e7-8b70-45130f407557 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:10:59.990822 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0c81e96c-9a53-4921-bf2d-6b486d5b2dfc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:10:59.991132 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14887f17-8dbe-40e7-8b70-45130f407557 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:00.131263 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-14887f17-8dbe-40e7-8b70-45130f407557 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:00.139541 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-14887f17-8dbe-40e7-8b70-45130f407557 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.164400 Apr 05 12:11:00.140118 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1345/2670] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:59 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:00.179703 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6b93f42d-a956-4c93-8d95-d308b094fc5e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:00.180449 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6b93f42d-a956-4c93-8d95-d308b094fc5e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:00.187328 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6b93f42d-a956-4c93-8d95-d308b094fc5e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:00.187808 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6b93f42d-a956-4c93-8d95-d308b094fc5e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:00.188644 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6b93f42d-a956-4c93-8d95-d308b094fc5e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:00.189073 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6b93f42d-a956-4c93-8d95-d308b094fc5e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:00.328813 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6b93f42d-a956-4c93-8d95-d308b094fc5e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:00.337041 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6b93f42d-a956-4c93-8d95-d308b094fc5e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:00.338520 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6b93f42d-a956-4c93-8d95-d308b094fc5e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:00.339701 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6b93f42d-a956-4c93-8d95-d308b094fc5e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.164136 Apr 05 12:11:00.340278 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1346/2671] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:00 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:00.344624 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-87e1ba84-1306-431f-b932-957729464a9b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:00.345190 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-87e1ba84-1306-431f-b932-957729464a9b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:00.350751 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-87e1ba84-1306-431f-b932-957729464a9b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:00.351214 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-87e1ba84-1306-431f-b932-957729464a9b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:00.351966 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-87e1ba84-1306-431f-b932-957729464a9b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:00.352422 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-87e1ba84-1306-431f-b932-957729464a9b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:00.363836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0c81e96c-9a53-4921-bf2d-6b486d5b2dfc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:00.371553 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0c81e96c-9a53-4921-bf2d-6b486d5b2dfc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.396634 Apr 05 12:11:00.372777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1326/2672] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:10:59 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:00.486135 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-87e1ba84-1306-431f-b932-957729464a9b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:00.494269 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-87e1ba84-1306-431f-b932-957729464a9b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.153038 Apr 05 12:11:00.494884 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1347/2673] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:00 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:01.161452 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6b75253c-2ddf-4bfa-a08e-7e68b743829d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:01.162495 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6b75253c-2ddf-4bfa-a08e-7e68b743829d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:01.170761 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6b75253c-2ddf-4bfa-a08e-7e68b743829d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:01.171364 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6b75253c-2ddf-4bfa-a08e-7e68b743829d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:01.172367 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6b75253c-2ddf-4bfa-a08e-7e68b743829d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:01.172908 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6b75253c-2ddf-4bfa-a08e-7e68b743829d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:01.315869 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6b75253c-2ddf-4bfa-a08e-7e68b743829d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:01.325447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6b75253c-2ddf-4bfa-a08e-7e68b743829d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.170655 Apr 05 12:11:01.325948 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1327/2674] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:01 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:01.366210 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8c966f52-4165-44cb-a04a-5aa3749ae020 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:01.366875 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8c966f52-4165-44cb-a04a-5aa3749ae020 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:01.376143 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8c966f52-4165-44cb-a04a-5aa3749ae020 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:01.376702 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8c966f52-4165-44cb-a04a-5aa3749ae020 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:01.377936 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8c966f52-4165-44cb-a04a-5aa3749ae020 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:01.378551 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8c966f52-4165-44cb-a04a-5aa3749ae020 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:01.389722 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5017f997-22a2-4842-839a-77fb804bddf5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:01.390362 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5017f997-22a2-4842-839a-77fb804bddf5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:01.396734 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5017f997-22a2-4842-839a-77fb804bddf5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:01.397222 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5017f997-22a2-4842-839a-77fb804bddf5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:01.397985 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5017f997-22a2-4842-839a-77fb804bddf5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:01.398425 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5017f997-22a2-4842-839a-77fb804bddf5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:01.516490 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8c966f52-4165-44cb-a04a-5aa3749ae020 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:01.525149 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8c966f52-4165-44cb-a04a-5aa3749ae020 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:01.526657 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8c966f52-4165-44cb-a04a-5aa3749ae020 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:01.527823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8c966f52-4165-44cb-a04a-5aa3749ae020 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.172733 Apr 05 12:11:01.528421 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1348/2675] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:01 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:01.533218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5017f997-22a2-4842-839a-77fb804bddf5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:01.533396 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ced7bf86-eb06-41b0-be46-b0aa1980fa38 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:01.533955 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ced7bf86-eb06-41b0-be46-b0aa1980fa38 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:01.539783 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ced7bf86-eb06-41b0-be46-b0aa1980fa38 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:01.540264 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ced7bf86-eb06-41b0-be46-b0aa1980fa38 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:01.541034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ced7bf86-eb06-41b0-be46-b0aa1980fa38 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:01.541471 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ced7bf86-eb06-41b0-be46-b0aa1980fa38 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:01.541757 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5017f997-22a2-4842-839a-77fb804bddf5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.155788 Apr 05 12:11:01.542408 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1328/2676] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:01 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:01.691089 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ced7bf86-eb06-41b0-be46-b0aa1980fa38 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:01.699035 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ced7bf86-eb06-41b0-be46-b0aa1980fa38 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.169628 Apr 05 12:11:01.699615 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1349/2677] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:01 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:02.342233 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-759d8e44-1df5-492e-840e-147b182a2f32 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:02.342901 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-759d8e44-1df5-492e-840e-147b182a2f32 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:02.349638 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-759d8e44-1df5-492e-840e-147b182a2f32 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:02.350105 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-759d8e44-1df5-492e-840e-147b182a2f32 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:02.351055 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-759d8e44-1df5-492e-840e-147b182a2f32 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:02.351558 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-759d8e44-1df5-492e-840e-147b182a2f32 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:02.494333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-759d8e44-1df5-492e-840e-147b182a2f32 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:02.502156 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-759d8e44-1df5-492e-840e-147b182a2f32 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.163780 Apr 05 12:11:02.502703 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1329/2678] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:02 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:02.546350 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-38482db9-b5ce-4826-a06d-5a611bfabe16 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:02.546960 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-38482db9-b5ce-4826-a06d-5a611bfabe16 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:02.553374 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-38482db9-b5ce-4826-a06d-5a611bfabe16 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:02.553903 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-38482db9-b5ce-4826-a06d-5a611bfabe16 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:02.554668 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-38482db9-b5ce-4826-a06d-5a611bfabe16 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:02.555103 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-38482db9-b5ce-4826-a06d-5a611bfabe16 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:02.558992 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6571ea74-f2ac-40d9-9ad1-4447fdc32cea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:02.560163 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6571ea74-f2ac-40d9-9ad1-4447fdc32cea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:02.566166 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6571ea74-f2ac-40d9-9ad1-4447fdc32cea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:02.566611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6571ea74-f2ac-40d9-9ad1-4447fdc32cea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:02.567381 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6571ea74-f2ac-40d9-9ad1-4447fdc32cea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:02.567865 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6571ea74-f2ac-40d9-9ad1-4447fdc32cea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:02.713887 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6571ea74-f2ac-40d9-9ad1-4447fdc32cea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:02.722847 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6571ea74-f2ac-40d9-9ad1-4447fdc32cea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.167655 Apr 05 12:11:02.725268 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1330/2679] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:02 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:11:02.738710 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-dec532a0-a43f-42d2-ac42-32608fe31322 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:02.739377 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-dec532a0-a43f-42d2-ac42-32608fe31322 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:02.745918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dec532a0-a43f-42d2-ac42-32608fe31322 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:02.746487 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dec532a0-a43f-42d2-ac42-32608fe31322 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:02.747620 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dec532a0-a43f-42d2-ac42-32608fe31322 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:02.748112 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dec532a0-a43f-42d2-ac42-32608fe31322 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:02.890571 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-dec532a0-a43f-42d2-ac42-32608fe31322 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:02.899674 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-dec532a0-a43f-42d2-ac42-32608fe31322 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.173398 Apr 05 12:11:02.900311 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1331/2680] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:02 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:03.014194 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-38482db9-b5ce-4826-a06d-5a611bfabe16 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:03.023399 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-38482db9-b5ce-4826-a06d-5a611bfabe16 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:03.025035 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-38482db9-b5ce-4826-a06d-5a611bfabe16 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:03.026345 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-38482db9-b5ce-4826-a06d-5a611bfabe16 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.483942 Apr 05 12:11:03.027003 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1350/2681] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:02 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:03.524894 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d1eef7c2-4f64-422a-8256-89f4a7eb0338 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:03.525934 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d1eef7c2-4f64-422a-8256-89f4a7eb0338 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:03.536773 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d1eef7c2-4f64-422a-8256-89f4a7eb0338 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:03.537510 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d1eef7c2-4f64-422a-8256-89f4a7eb0338 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:03.538611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d1eef7c2-4f64-422a-8256-89f4a7eb0338 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:03.539066 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d1eef7c2-4f64-422a-8256-89f4a7eb0338 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:03.674294 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d1eef7c2-4f64-422a-8256-89f4a7eb0338 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:03.682462 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d1eef7c2-4f64-422a-8256-89f4a7eb0338 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.164118 Apr 05 12:11:03.683045 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1332/2682] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:03 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:03.746423 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-095e1177-e428-47b9-8f4f-3677c6d10e52 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:03.747247 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-095e1177-e428-47b9-8f4f-3677c6d10e52 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:03.758096 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-095e1177-e428-47b9-8f4f-3677c6d10e52 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:03.758881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-095e1177-e428-47b9-8f4f-3677c6d10e52 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:03.760116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-095e1177-e428-47b9-8f4f-3677c6d10e52 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:03.760858 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-095e1177-e428-47b9-8f4f-3677c6d10e52 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:03.905299 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-095e1177-e428-47b9-8f4f-3677c6d10e52 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:03.914518 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-095e1177-e428-47b9-8f4f-3677c6d10e52 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.174794 Apr 05 12:11:03.915171 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1351/2683] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:03 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:03.916854 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8106534e-cb05-4fc3-a86e-65624a8f947f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:03.917494 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8106534e-cb05-4fc3-a86e-65624a8f947f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:03.923421 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8106534e-cb05-4fc3-a86e-65624a8f947f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:03.923868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8106534e-cb05-4fc3-a86e-65624a8f947f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:03.924644 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8106534e-cb05-4fc3-a86e-65624a8f947f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:03.925072 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8106534e-cb05-4fc3-a86e-65624a8f947f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:04.045098 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3abb9314-41cc-4c24-be54-aaf6b289550d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:04.045707 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3abb9314-41cc-4c24-be54-aaf6b289550d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:04.052027 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3abb9314-41cc-4c24-be54-aaf6b289550d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:04.052506 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3abb9314-41cc-4c24-be54-aaf6b289550d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:04.053361 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3abb9314-41cc-4c24-be54-aaf6b289550d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:04.053802 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3abb9314-41cc-4c24-be54-aaf6b289550d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:04.063960 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8106534e-cb05-4fc3-a86e-65624a8f947f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:04.071896 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8106534e-cb05-4fc3-a86e-65624a8f947f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.158848 Apr 05 12:11:04.072477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1333/2684] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:03 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:11:04.183086 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3abb9314-41cc-4c24-be54-aaf6b289550d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:04.194508 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3abb9314-41cc-4c24-be54-aaf6b289550d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:04.196007 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3abb9314-41cc-4c24-be54-aaf6b289550d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:04.197181 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3abb9314-41cc-4c24-be54-aaf6b289550d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.156048 Apr 05 12:11:04.197712 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1352/2685] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:04 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:04.703860 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2c23757e-9352-4b24-94ee-86cbb54851e1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:04.704908 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2c23757e-9352-4b24-94ee-86cbb54851e1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:04.713404 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2c23757e-9352-4b24-94ee-86cbb54851e1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:04.713859 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2c23757e-9352-4b24-94ee-86cbb54851e1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:04.714641 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2c23757e-9352-4b24-94ee-86cbb54851e1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:04.715066 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2c23757e-9352-4b24-94ee-86cbb54851e1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:04.849517 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2c23757e-9352-4b24-94ee-86cbb54851e1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:04.857568 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2c23757e-9352-4b24-94ee-86cbb54851e1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.160101 Apr 05 12:11:04.858190 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1334/2686] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:04 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:04.931911 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-44945b63-867e-43b2-91da-fcbbf54bd050 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:04.932521 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-44945b63-867e-43b2-91da-fcbbf54bd050 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:04.939172 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-44945b63-867e-43b2-91da-fcbbf54bd050 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:04.939619 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-44945b63-867e-43b2-91da-fcbbf54bd050 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:04.940412 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-44945b63-867e-43b2-91da-fcbbf54bd050 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:04.940844 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-44945b63-867e-43b2-91da-fcbbf54bd050 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:05.078185 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-44945b63-867e-43b2-91da-fcbbf54bd050 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:05.086857 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-44945b63-867e-43b2-91da-fcbbf54bd050 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.158780 Apr 05 12:11:05.087458 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1353/2687] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:04 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:05.089038 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5e6c5f9b-f999-4957-a18f-9b54a9d69466 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:05.089640 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5e6c5f9b-f999-4957-a18f-9b54a9d69466 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:05.095569 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5e6c5f9b-f999-4957-a18f-9b54a9d69466 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:05.096015 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5e6c5f9b-f999-4957-a18f-9b54a9d69466 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:05.096788 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5e6c5f9b-f999-4957-a18f-9b54a9d69466 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:05.097213 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5e6c5f9b-f999-4957-a18f-9b54a9d69466 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:05.231214 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5e6c5f9b-f999-4957-a18f-9b54a9d69466 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:05.239570 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5e6c5f9b-f999-4957-a18f-9b54a9d69466 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.154341 Apr 05 12:11:05.240156 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1335/2688] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:05 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:11:05.261603 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-15467393-fa91-4933-8721-fe378b37eeb3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:05.262208 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-15467393-fa91-4933-8721-fe378b37eeb3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:05.268158 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-15467393-fa91-4933-8721-fe378b37eeb3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:05.268609 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-15467393-fa91-4933-8721-fe378b37eeb3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:05.269369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-15467393-fa91-4933-8721-fe378b37eeb3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:05.269796 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-15467393-fa91-4933-8721-fe378b37eeb3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:05.399519 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-15467393-fa91-4933-8721-fe378b37eeb3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:05.408747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-15467393-fa91-4933-8721-fe378b37eeb3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:05.410240 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-15467393-fa91-4933-8721-fe378b37eeb3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:05.411397 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-15467393-fa91-4933-8721-fe378b37eeb3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.200369 Apr 05 12:11:05.411959 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1354/2689] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:05 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:05.879943 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bd148429-e117-42f4-b484-0ff6677d2b1c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:05.881176 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bd148429-e117-42f4-b484-0ff6677d2b1c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:05.887869 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bd148429-e117-42f4-b484-0ff6677d2b1c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:05.888995 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bd148429-e117-42f4-b484-0ff6677d2b1c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:05.889768 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bd148429-e117-42f4-b484-0ff6677d2b1c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:05.890204 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bd148429-e117-42f4-b484-0ff6677d2b1c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:06.022807 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-bd148429-e117-42f4-b484-0ff6677d2b1c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:06.031281 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bd148429-e117-42f4-b484-0ff6677d2b1c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.158803 Apr 05 12:11:06.031855 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1336/2690] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:05 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:06.108122 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-dd1c4945-0aeb-4ff1-bbcb-e08ac3494e69 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:06.109126 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-dd1c4945-0aeb-4ff1-bbcb-e08ac3494e69 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:06.118186 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dd1c4945-0aeb-4ff1-bbcb-e08ac3494e69 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:06.118627 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dd1c4945-0aeb-4ff1-bbcb-e08ac3494e69 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:06.119377 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dd1c4945-0aeb-4ff1-bbcb-e08ac3494e69 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:06.119808 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dd1c4945-0aeb-4ff1-bbcb-e08ac3494e69 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:06.257793 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-421daff2-1386-4491-ba50-d5323f451c91 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:06.258397 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-421daff2-1386-4491-ba50-d5323f451c91 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:06.264771 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-421daff2-1386-4491-ba50-d5323f451c91 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:06.265217 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-421daff2-1386-4491-ba50-d5323f451c91 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:06.266002 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-421daff2-1386-4491-ba50-d5323f451c91 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:06.266424 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-421daff2-1386-4491-ba50-d5323f451c91 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:06.276225 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-dd1c4945-0aeb-4ff1-bbcb-e08ac3494e69 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:06.284446 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-dd1c4945-0aeb-4ff1-bbcb-e08ac3494e69 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.182684 Apr 05 12:11:06.285110 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1355/2691] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:06 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:06.401836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-421daff2-1386-4491-ba50-d5323f451c91 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:06.410100 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-421daff2-1386-4491-ba50-d5323f451c91 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.156465 Apr 05 12:11:06.410642 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1337/2692] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:06 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:06.434778 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5c18a813-d50e-49cf-b433-34ea5c165f85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:06.435379 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5c18a813-d50e-49cf-b433-34ea5c165f85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:06.441813 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5c18a813-d50e-49cf-b433-34ea5c165f85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:06.442370 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5c18a813-d50e-49cf-b433-34ea5c165f85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:06.443184 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5c18a813-d50e-49cf-b433-34ea5c165f85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:06.443662 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5c18a813-d50e-49cf-b433-34ea5c165f85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:06.575087 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5c18a813-d50e-49cf-b433-34ea5c165f85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:06.583567 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5c18a813-d50e-49cf-b433-34ea5c165f85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:06.585073 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5c18a813-d50e-49cf-b433-34ea5c165f85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:06.586212 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5c18a813-d50e-49cf-b433-34ea5c165f85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.155307 Apr 05 12:11:06.586770 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1356/2693] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:06 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:07.121766 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-32d33c43-aa7a-46bc-8d05-c111e1622bb0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:07.122370 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-32d33c43-aa7a-46bc-8d05-c111e1622bb0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:07.128403 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-32d33c43-aa7a-46bc-8d05-c111e1622bb0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:07.128855 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-32d33c43-aa7a-46bc-8d05-c111e1622bb0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:07.129919 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-32d33c43-aa7a-46bc-8d05-c111e1622bb0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:07.130423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-32d33c43-aa7a-46bc-8d05-c111e1622bb0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:07.273227 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-32d33c43-aa7a-46bc-8d05-c111e1622bb0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:07.281499 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-32d33c43-aa7a-46bc-8d05-c111e1622bb0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.236535 Apr 05 12:11:07.282087 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1338/2694] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:07 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:07.301970 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3f40b0c2-a2fa-43b4-b293-aabe7323383d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:07.302589 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3f40b0c2-a2fa-43b4-b293-aabe7323383d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:07.309314 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f40b0c2-a2fa-43b4-b293-aabe7323383d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:07.309756 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f40b0c2-a2fa-43b4-b293-aabe7323383d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:07.310515 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f40b0c2-a2fa-43b4-b293-aabe7323383d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:07.310939 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f40b0c2-a2fa-43b4-b293-aabe7323383d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:07.426691 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d993879b-8bea-4259-95e8-92f351818535 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:07.427302 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d993879b-8bea-4259-95e8-92f351818535 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:07.433318 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d993879b-8bea-4259-95e8-92f351818535 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:07.433768 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d993879b-8bea-4259-95e8-92f351818535 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:07.434528 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d993879b-8bea-4259-95e8-92f351818535 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:07.434962 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d993879b-8bea-4259-95e8-92f351818535 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:07.455804 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3f40b0c2-a2fa-43b4-b293-aabe7323383d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:07.463632 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3f40b0c2-a2fa-43b4-b293-aabe7323383d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.165565 Apr 05 12:11:07.464996 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1357/2695] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:07 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:07.565063 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d993879b-8bea-4259-95e8-92f351818535 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:07.573547 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d993879b-8bea-4259-95e8-92f351818535 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.150730 Apr 05 12:11:07.574130 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1339/2696] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:07 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:11:07.604825 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-733bab0c-78ac-4b9d-aeae-5434a219c5f3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:07.605422 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-733bab0c-78ac-4b9d-aeae-5434a219c5f3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:07.611464 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-733bab0c-78ac-4b9d-aeae-5434a219c5f3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:07.611904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-733bab0c-78ac-4b9d-aeae-5434a219c5f3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:07.612673 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-733bab0c-78ac-4b9d-aeae-5434a219c5f3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:07.613110 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-733bab0c-78ac-4b9d-aeae-5434a219c5f3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:07.752233 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-733bab0c-78ac-4b9d-aeae-5434a219c5f3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:07.761205 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-733bab0c-78ac-4b9d-aeae-5434a219c5f3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:07.762680 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-733bab0c-78ac-4b9d-aeae-5434a219c5f3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:07.763853 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-733bab0c-78ac-4b9d-aeae-5434a219c5f3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.162959 Apr 05 12:11:07.764436 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1358/2697] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:07 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:08.304845 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-58f38da2-6f1c-4e1c-9d62-503f5cce4884 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:08.305772 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-58f38da2-6f1c-4e1c-9d62-503f5cce4884 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:08.316643 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-58f38da2-6f1c-4e1c-9d62-503f5cce4884 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:08.317390 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-58f38da2-6f1c-4e1c-9d62-503f5cce4884 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:08.318628 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-58f38da2-6f1c-4e1c-9d62-503f5cce4884 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:08.319384 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-58f38da2-6f1c-4e1c-9d62-503f5cce4884 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:08.465175 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-58f38da2-6f1c-4e1c-9d62-503f5cce4884 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:08.473548 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-58f38da2-6f1c-4e1c-9d62-503f5cce4884 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.175207 Apr 05 12:11:08.474323 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1340/2698] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:08 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:08.481692 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-56c6ae48-7e56-4634-b33d-8acd31c0a4cd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:08.482332 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-56c6ae48-7e56-4634-b33d-8acd31c0a4cd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:08.490065 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-56c6ae48-7e56-4634-b33d-8acd31c0a4cd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:08.490847 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-56c6ae48-7e56-4634-b33d-8acd31c0a4cd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:08.491719 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-56c6ae48-7e56-4634-b33d-8acd31c0a4cd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:08.492199 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-56c6ae48-7e56-4634-b33d-8acd31c0a4cd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:08.591084 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2ed155de-ae69-4b5d-9d78-8363dc753dfd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:08.591774 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2ed155de-ae69-4b5d-9d78-8363dc753dfd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:08.598187 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ed155de-ae69-4b5d-9d78-8363dc753dfd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:08.598634 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ed155de-ae69-4b5d-9d78-8363dc753dfd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:08.599402 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ed155de-ae69-4b5d-9d78-8363dc753dfd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:08.599942 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ed155de-ae69-4b5d-9d78-8363dc753dfd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:08.630356 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-56c6ae48-7e56-4634-b33d-8acd31c0a4cd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:08.638802 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-56c6ae48-7e56-4634-b33d-8acd31c0a4cd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.160965 Apr 05 12:11:08.639631 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1359/2699] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:08 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:08.735659 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2ed155de-ae69-4b5d-9d78-8363dc753dfd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:08.743644 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2ed155de-ae69-4b5d-9d78-8363dc753dfd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.156559 Apr 05 12:11:08.744284 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1341/2700] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:08 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:08.783033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5afcccd0-17ab-4e16-87fe-d6e7d5dbbfeb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:08.783635 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5afcccd0-17ab-4e16-87fe-d6e7d5dbbfeb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:08.790372 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5afcccd0-17ab-4e16-87fe-d6e7d5dbbfeb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:08.790825 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5afcccd0-17ab-4e16-87fe-d6e7d5dbbfeb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:08.791580 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5afcccd0-17ab-4e16-87fe-d6e7d5dbbfeb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:08.792012 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5afcccd0-17ab-4e16-87fe-d6e7d5dbbfeb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:08.930119 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5afcccd0-17ab-4e16-87fe-d6e7d5dbbfeb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:08.938780 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5afcccd0-17ab-4e16-87fe-d6e7d5dbbfeb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:08.940306 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5afcccd0-17ab-4e16-87fe-d6e7d5dbbfeb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:08.941486 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5afcccd0-17ab-4e16-87fe-d6e7d5dbbfeb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.162522 Apr 05 12:11:08.942047 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1360/2701] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:08 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:09.494992 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4180acf2-1813-48ec-bb2c-de209963af8c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:09.496048 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4180acf2-1813-48ec-bb2c-de209963af8c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:09.506752 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4180acf2-1813-48ec-bb2c-de209963af8c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:09.507225 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4180acf2-1813-48ec-bb2c-de209963af8c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:09.507985 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4180acf2-1813-48ec-bb2c-de209963af8c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:09.508451 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4180acf2-1813-48ec-bb2c-de209963af8c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:09.642281 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4180acf2-1813-48ec-bb2c-de209963af8c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:09.650508 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4180acf2-1813-48ec-bb2c-de209963af8c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.161952 Apr 05 12:11:09.651935 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1342/2702] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:09 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:09.655701 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-94ee672e-e6aa-459d-ab1f-6f77a5e24ac1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:09.656469 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-94ee672e-e6aa-459d-ab1f-6f77a5e24ac1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:09.662536 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94ee672e-e6aa-459d-ab1f-6f77a5e24ac1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:09.662979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94ee672e-e6aa-459d-ab1f-6f77a5e24ac1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:09.663725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94ee672e-e6aa-459d-ab1f-6f77a5e24ac1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:09.664175 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94ee672e-e6aa-459d-ab1f-6f77a5e24ac1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:09.761090 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-46da6c6e-0188-4e06-b7e7-72ea5bb2c013 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:09.761696 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-46da6c6e-0188-4e06-b7e7-72ea5bb2c013 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:09.767808 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-46da6c6e-0188-4e06-b7e7-72ea5bb2c013 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:09.768384 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-46da6c6e-0188-4e06-b7e7-72ea5bb2c013 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:09.769068 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-46da6c6e-0188-4e06-b7e7-72ea5bb2c013 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:09.769497 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-46da6c6e-0188-4e06-b7e7-72ea5bb2c013 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:09.800699 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-94ee672e-e6aa-459d-ab1f-6f77a5e24ac1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:09.808840 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-94ee672e-e6aa-459d-ab1f-6f77a5e24ac1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.156864 Apr 05 12:11:09.809409 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1361/2703] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:09 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:09.900825 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-46da6c6e-0188-4e06-b7e7-72ea5bb2c013 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:09.908604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-46da6c6e-0188-4e06-b7e7-72ea5bb2c013 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.151365 Apr 05 12:11:09.909175 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1343/2704] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:09 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:11:09.959938 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d57cf0eb-14b1-4ea2-aaba-4fc303cfbcf9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:09.960567 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d57cf0eb-14b1-4ea2-aaba-4fc303cfbcf9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:09.967103 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d57cf0eb-14b1-4ea2-aaba-4fc303cfbcf9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:09.967547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d57cf0eb-14b1-4ea2-aaba-4fc303cfbcf9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:09.968322 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d57cf0eb-14b1-4ea2-aaba-4fc303cfbcf9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:09.968751 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d57cf0eb-14b1-4ea2-aaba-4fc303cfbcf9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:10.118777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d57cf0eb-14b1-4ea2-aaba-4fc303cfbcf9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:10.127597 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d57cf0eb-14b1-4ea2-aaba-4fc303cfbcf9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:10.129476 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d57cf0eb-14b1-4ea2-aaba-4fc303cfbcf9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:10.130668 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d57cf0eb-14b1-4ea2-aaba-4fc303cfbcf9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.174778 Apr 05 12:11:10.131295 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1362/2705] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:09 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:10.672537 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-02adb13a-dbf9-4eeb-9960-4dbf77146c4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:10.673647 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-02adb13a-dbf9-4eeb-9960-4dbf77146c4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:10.681958 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02adb13a-dbf9-4eeb-9960-4dbf77146c4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:10.682405 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02adb13a-dbf9-4eeb-9960-4dbf77146c4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:10.683171 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02adb13a-dbf9-4eeb-9960-4dbf77146c4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:10.683604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-02adb13a-dbf9-4eeb-9960-4dbf77146c4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:10.823631 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-02adb13a-dbf9-4eeb-9960-4dbf77146c4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:10.826299 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-83be91ce-7af8-46ab-9a81-425242dec5b0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:10.826888 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-83be91ce-7af8-46ab-9a81-425242dec5b0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:10.832172 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-02adb13a-dbf9-4eeb-9960-4dbf77146c4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.165990 Apr 05 12:11:10.833097 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-83be91ce-7af8-46ab-9a81-425242dec5b0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:10.833294 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1344/2706] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:10 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:10.833549 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-83be91ce-7af8-46ab-9a81-425242dec5b0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:10.834405 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-83be91ce-7af8-46ab-9a81-425242dec5b0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:10.834836 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-83be91ce-7af8-46ab-9a81-425242dec5b0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:10.926216 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2c9f0f21-1cc5-4789-8198-4972230833e0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:10.926868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2c9f0f21-1cc5-4789-8198-4972230833e0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:10.932981 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2c9f0f21-1cc5-4789-8198-4972230833e0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:10.933433 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2c9f0f21-1cc5-4789-8198-4972230833e0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:10.934188 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2c9f0f21-1cc5-4789-8198-4972230833e0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:10.934620 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2c9f0f21-1cc5-4789-8198-4972230833e0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:10.971386 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-83be91ce-7af8-46ab-9a81-425242dec5b0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:10.979395 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-83be91ce-7af8-46ab-9a81-425242dec5b0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.156951 Apr 05 12:11:10.979972 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1363/2707] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:10 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:11.068360 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2c9f0f21-1cc5-4789-8198-4972230833e0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:11.076480 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2c9f0f21-1cc5-4789-8198-4972230833e0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.154091 Apr 05 12:11:11.077043 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1345/2708] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:10 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:11.153483 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5068583e-d211-4508-ace1-e0f5a6ed9a06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:11.154482 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5068583e-d211-4508-ace1-e0f5a6ed9a06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:11.163800 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5068583e-d211-4508-ace1-e0f5a6ed9a06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:11.164291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5068583e-d211-4508-ace1-e0f5a6ed9a06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:11.165043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5068583e-d211-4508-ace1-e0f5a6ed9a06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:11.165470 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5068583e-d211-4508-ace1-e0f5a6ed9a06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:11.299635 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5068583e-d211-4508-ace1-e0f5a6ed9a06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:11.309681 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5068583e-d211-4508-ace1-e0f5a6ed9a06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:11.311175 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5068583e-d211-4508-ace1-e0f5a6ed9a06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:11.312386 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5068583e-d211-4508-ace1-e0f5a6ed9a06 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.165479 Apr 05 12:11:11.312945 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1364/2709] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:11 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:11.852307 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c0f56453-4755-48fb-b64d-f4b8f40c519f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:11.853023 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c0f56453-4755-48fb-b64d-f4b8f40c519f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:11.861316 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0f56453-4755-48fb-b64d-f4b8f40c519f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:11.861870 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0f56453-4755-48fb-b64d-f4b8f40c519f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:11.862818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0f56453-4755-48fb-b64d-f4b8f40c519f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:11.863345 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0f56453-4755-48fb-b64d-f4b8f40c519f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:11.998126 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8045c9ab-1bb3-41bd-8c2a-3ab2a5ca54e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:11.998777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8045c9ab-1bb3-41bd-8c2a-3ab2a5ca54e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:12.001548 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c0f56453-4755-48fb-b64d-f4b8f40c519f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:12.005755 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8045c9ab-1bb3-41bd-8c2a-3ab2a5ca54e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:12.006224 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8045c9ab-1bb3-41bd-8c2a-3ab2a5ca54e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:12.006958 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8045c9ab-1bb3-41bd-8c2a-3ab2a5ca54e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:12.007580 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8045c9ab-1bb3-41bd-8c2a-3ab2a5ca54e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:12.012757 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c0f56453-4755-48fb-b64d-f4b8f40c519f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.166299 Apr 05 12:11:12.013321 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1346/2710] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:11 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:12.093803 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0d3d6631-e4ac-4776-8da3-9c549f51a705 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:12.094466 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0d3d6631-e4ac-4776-8da3-9c549f51a705 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:12.100475 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0d3d6631-e4ac-4776-8da3-9c549f51a705 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:12.101035 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0d3d6631-e4ac-4776-8da3-9c549f51a705 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:12.101830 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0d3d6631-e4ac-4776-8da3-9c549f51a705 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:12.102270 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0d3d6631-e4ac-4776-8da3-9c549f51a705 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:12.145869 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8045c9ab-1bb3-41bd-8c2a-3ab2a5ca54e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:12.153878 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8045c9ab-1bb3-41bd-8c2a-3ab2a5ca54e3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.160450 Apr 05 12:11:12.154458 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1365/2711] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:11 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:11:12.238065 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0d3d6631-e4ac-4776-8da3-9c549f51a705 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:12.246659 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0d3d6631-e4ac-4776-8da3-9c549f51a705 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.156780 Apr 05 12:11:12.247209 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1347/2712] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:12 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:11:12.334966 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a7768b28-d894-4964-9747-3714ed203def tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:12.335965 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a7768b28-d894-4964-9747-3714ed203def tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:12.346084 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7768b28-d894-4964-9747-3714ed203def tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:12.346832 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7768b28-d894-4964-9747-3714ed203def tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:12.348108 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7768b28-d894-4964-9747-3714ed203def tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:12.348854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7768b28-d894-4964-9747-3714ed203def tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:12.479422 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a7768b28-d894-4964-9747-3714ed203def tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:12.488167 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a7768b28-d894-4964-9747-3714ed203def tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:12.489676 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a7768b28-d894-4964-9747-3714ed203def tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:12.490835 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a7768b28-d894-4964-9747-3714ed203def tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.162609 Apr 05 12:11:12.491394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1366/2713] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:12 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:13.033947 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-84d5c58b-34fd-44cc-ab1c-89e6ce21ebf0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:13.034962 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-84d5c58b-34fd-44cc-ab1c-89e6ce21ebf0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:13.045685 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-84d5c58b-34fd-44cc-ab1c-89e6ce21ebf0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:13.046429 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-84d5c58b-34fd-44cc-ab1c-89e6ce21ebf0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:13.047664 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-84d5c58b-34fd-44cc-ab1c-89e6ce21ebf0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:13.048444 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-84d5c58b-34fd-44cc-ab1c-89e6ce21ebf0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:13.170990 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4e0c3960-f9a2-439a-8d14-6b85a66080fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:13.171595 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4e0c3960-f9a2-439a-8d14-6b85a66080fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:13.178204 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e0c3960-f9a2-439a-8d14-6b85a66080fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:13.178655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e0c3960-f9a2-439a-8d14-6b85a66080fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:13.179486 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e0c3960-f9a2-439a-8d14-6b85a66080fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:13.179926 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e0c3960-f9a2-439a-8d14-6b85a66080fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:13.187123 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-84d5c58b-34fd-44cc-ab1c-89e6ce21ebf0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:13.195428 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-84d5c58b-34fd-44cc-ab1c-89e6ce21ebf0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.168021 Apr 05 12:11:13.195978 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1348/2714] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:13 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:13.264658 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bf345368-50dd-480f-b5a4-146e4c0c744a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:13.265314 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bf345368-50dd-480f-b5a4-146e4c0c744a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:13.271648 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bf345368-50dd-480f-b5a4-146e4c0c744a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:13.272104 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bf345368-50dd-480f-b5a4-146e4c0c744a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:13.272858 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bf345368-50dd-480f-b5a4-146e4c0c744a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:13.273394 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bf345368-50dd-480f-b5a4-146e4c0c744a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:13.320173 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4e0c3960-f9a2-439a-8d14-6b85a66080fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:13.329803 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4e0c3960-f9a2-439a-8d14-6b85a66080fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.162798 Apr 05 12:11:13.330807 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1367/2715] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:13 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:13.408888 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-bf345368-50dd-480f-b5a4-146e4c0c744a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:13.420995 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bf345368-50dd-480f-b5a4-146e4c0c744a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.160059 Apr 05 12:11:13.421827 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1349/2716] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:13 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:13.511304 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9db55f45-7d2b-4d95-b326-d6f91019e9fe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:13.511906 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9db55f45-7d2b-4d95-b326-d6f91019e9fe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:13.518419 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9db55f45-7d2b-4d95-b326-d6f91019e9fe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:13.518863 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9db55f45-7d2b-4d95-b326-d6f91019e9fe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:13.519605 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9db55f45-7d2b-4d95-b326-d6f91019e9fe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:13.520027 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9db55f45-7d2b-4d95-b326-d6f91019e9fe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:13.662136 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9db55f45-7d2b-4d95-b326-d6f91019e9fe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:13.671273 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9db55f45-7d2b-4d95-b326-d6f91019e9fe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:13.672842 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9db55f45-7d2b-4d95-b326-d6f91019e9fe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:13.674037 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9db55f45-7d2b-4d95-b326-d6f91019e9fe tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.167094 Apr 05 12:11:13.674570 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1368/2717] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:13 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:14.216863 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e0bb1041-d444-4520-9a61-90a91285c897 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:14.217886 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e0bb1041-d444-4520-9a61-90a91285c897 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:14.229193 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0bb1041-d444-4520-9a61-90a91285c897 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:14.229657 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0bb1041-d444-4520-9a61-90a91285c897 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:14.230418 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0bb1041-d444-4520-9a61-90a91285c897 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:14.230845 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0bb1041-d444-4520-9a61-90a91285c897 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:14.346785 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ce0e81e3-ea99-4824-b8fa-dd8e3adeb6dd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:14.347345 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ce0e81e3-ea99-4824-b8fa-dd8e3adeb6dd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:14.354137 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ce0e81e3-ea99-4824-b8fa-dd8e3adeb6dd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:14.354582 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ce0e81e3-ea99-4824-b8fa-dd8e3adeb6dd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:14.355337 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ce0e81e3-ea99-4824-b8fa-dd8e3adeb6dd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:14.355770 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ce0e81e3-ea99-4824-b8fa-dd8e3adeb6dd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:14.379773 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e0bb1041-d444-4520-9a61-90a91285c897 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:14.388093 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e0bb1041-d444-4520-9a61-90a91285c897 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.177695 Apr 05 12:11:14.388848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1350/2718] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:14 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:14.441436 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8c50e397-1fa0-40bc-858b-2e4d6d893857 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:14.442053 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8c50e397-1fa0-40bc-858b-2e4d6d893857 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:14.448415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c50e397-1fa0-40bc-858b-2e4d6d893857 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:14.448862 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c50e397-1fa0-40bc-858b-2e4d6d893857 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:14.449615 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c50e397-1fa0-40bc-858b-2e4d6d893857 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:14.450041 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c50e397-1fa0-40bc-858b-2e4d6d893857 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:14.489008 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ce0e81e3-ea99-4824-b8fa-dd8e3adeb6dd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:14.497344 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ce0e81e3-ea99-4824-b8fa-dd8e3adeb6dd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.154358 Apr 05 12:11:14.498157 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1369/2719] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:14 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:14.583707 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8c50e397-1fa0-40bc-858b-2e4d6d893857 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:14.592765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8c50e397-1fa0-40bc-858b-2e4d6d893857 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.155299 Apr 05 12:11:14.593346 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1351/2720] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:14 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:11:14.696607 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6b678320-3b95-40e8-9f6f-9a575518a84e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:14.697616 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6b678320-3b95-40e8-9f6f-9a575518a84e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:14.707738 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6b678320-3b95-40e8-9f6f-9a575518a84e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:14.708601 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6b678320-3b95-40e8-9f6f-9a575518a84e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:14.709849 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6b678320-3b95-40e8-9f6f-9a575518a84e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:14.710563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6b678320-3b95-40e8-9f6f-9a575518a84e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:14.857010 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6b678320-3b95-40e8-9f6f-9a575518a84e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:14.865321 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6b678320-3b95-40e8-9f6f-9a575518a84e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:14.866815 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6b678320-3b95-40e8-9f6f-9a575518a84e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:14.868125 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6b678320-3b95-40e8-9f6f-9a575518a84e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.178201 Apr 05 12:11:14.868715 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1370/2721] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:14 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:15.409646 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3b4d43bd-aaa3-4164-8ea4-de20fb861f8b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:15.410502 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3b4d43bd-aaa3-4164-8ea4-de20fb861f8b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:15.421313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b4d43bd-aaa3-4164-8ea4-de20fb861f8b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:15.422054 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b4d43bd-aaa3-4164-8ea4-de20fb861f8b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:15.423312 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b4d43bd-aaa3-4164-8ea4-de20fb861f8b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:15.424029 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b4d43bd-aaa3-4164-8ea4-de20fb861f8b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:15.514900 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-33d34182-218a-456a-9abf-d814e71e6f16 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:15.515511 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-33d34182-218a-456a-9abf-d814e71e6f16 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:15.522062 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-33d34182-218a-456a-9abf-d814e71e6f16 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:15.522499 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-33d34182-218a-456a-9abf-d814e71e6f16 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:15.523286 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-33d34182-218a-456a-9abf-d814e71e6f16 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:15.523827 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-33d34182-218a-456a-9abf-d814e71e6f16 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:15.571358 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3b4d43bd-aaa3-4164-8ea4-de20fb861f8b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:15.579465 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3b4d43bd-aaa3-4164-8ea4-de20fb861f8b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.176433 Apr 05 12:11:15.580049 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1352/2722] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:15 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:15.610363 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-662988f2-51b5-4a99-a486-f2630b71e65f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:15.610972 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-662988f2-51b5-4a99-a486-f2630b71e65f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:15.617064 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-662988f2-51b5-4a99-a486-f2630b71e65f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:15.617514 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-662988f2-51b5-4a99-a486-f2630b71e65f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:15.618305 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-662988f2-51b5-4a99-a486-f2630b71e65f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:15.618735 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-662988f2-51b5-4a99-a486-f2630b71e65f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:15.658434 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-33d34182-218a-456a-9abf-d814e71e6f16 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:15.666764 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-33d34182-218a-456a-9abf-d814e71e6f16 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.155731 Apr 05 12:11:15.667279 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1371/2723] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:15 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:11:15.753299 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-662988f2-51b5-4a99-a486-f2630b71e65f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:15.761524 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-662988f2-51b5-4a99-a486-f2630b71e65f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.155077 Apr 05 12:11:15.762093 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1353/2724] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:15 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:15.889609 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-23c32f5d-baf2-4fb2-a359-93103f64200e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:15.890606 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-23c32f5d-baf2-4fb2-a359-93103f64200e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:15.898446 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-23c32f5d-baf2-4fb2-a359-93103f64200e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:15.898894 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-23c32f5d-baf2-4fb2-a359-93103f64200e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:15.899655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-23c32f5d-baf2-4fb2-a359-93103f64200e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:15.900112 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-23c32f5d-baf2-4fb2-a359-93103f64200e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:16.053672 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-23c32f5d-baf2-4fb2-a359-93103f64200e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:16.062621 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-23c32f5d-baf2-4fb2-a359-93103f64200e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:16.064107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-23c32f5d-baf2-4fb2-a359-93103f64200e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:16.065303 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-23c32f5d-baf2-4fb2-a359-93103f64200e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.181745 Apr 05 12:11:16.065839 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1372/2725] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:15 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:16.596909 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d4f5b939-1a1b-434c-b551-39e21fbb74e9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:16.597510 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d4f5b939-1a1b-434c-b551-39e21fbb74e9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:16.604399 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d4f5b939-1a1b-434c-b551-39e21fbb74e9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:16.604836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d4f5b939-1a1b-434c-b551-39e21fbb74e9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:16.605584 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d4f5b939-1a1b-434c-b551-39e21fbb74e9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:16.606013 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d4f5b939-1a1b-434c-b551-39e21fbb74e9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:16.732100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bfeabcc6-51d7-4d9e-8bcc-e10a7cd1ab71 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:16.732738 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bfeabcc6-51d7-4d9e-8bcc-e10a7cd1ab71 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:16.738545 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bfeabcc6-51d7-4d9e-8bcc-e10a7cd1ab71 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:16.738991 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bfeabcc6-51d7-4d9e-8bcc-e10a7cd1ab71 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:16.739800 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bfeabcc6-51d7-4d9e-8bcc-e10a7cd1ab71 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:16.740191 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bfeabcc6-51d7-4d9e-8bcc-e10a7cd1ab71 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:16.748781 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d4f5b939-1a1b-434c-b551-39e21fbb74e9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:16.757123 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d4f5b939-1a1b-434c-b551-39e21fbb74e9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.164257 Apr 05 12:11:16.757674 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1354/2726] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:16 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:16.778519 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1abc54fa-b896-4f3a-aa6d-7d5ccf62b1d4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:16.779125 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1abc54fa-b896-4f3a-aa6d-7d5ccf62b1d4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:16.785159 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1abc54fa-b896-4f3a-aa6d-7d5ccf62b1d4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:16.785610 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1abc54fa-b896-4f3a-aa6d-7d5ccf62b1d4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:16.786360 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1abc54fa-b896-4f3a-aa6d-7d5ccf62b1d4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:16.786794 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1abc54fa-b896-4f3a-aa6d-7d5ccf62b1d4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:16.873373 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bfeabcc6-51d7-4d9e-8bcc-e10a7cd1ab71 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:16.881567 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bfeabcc6-51d7-4d9e-8bcc-e10a7cd1ab71 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.201138 Apr 05 12:11:16.882168 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1373/2727] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:16 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:16.921240 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1abc54fa-b896-4f3a-aa6d-7d5ccf62b1d4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:16.931787 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1abc54fa-b896-4f3a-aa6d-7d5ccf62b1d4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.157036 Apr 05 12:11:16.932396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1355/2728] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:16 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:11:17.086861 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-639e38f2-083b-4437-9e27-272f00a1cea9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:17.087544 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-639e38f2-083b-4437-9e27-272f00a1cea9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:17.094190 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-639e38f2-083b-4437-9e27-272f00a1cea9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:17.094657 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-639e38f2-083b-4437-9e27-272f00a1cea9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:17.095445 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-639e38f2-083b-4437-9e27-272f00a1cea9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:17.095898 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-639e38f2-083b-4437-9e27-272f00a1cea9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:17.233164 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-639e38f2-083b-4437-9e27-272f00a1cea9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:17.245610 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-639e38f2-083b-4437-9e27-272f00a1cea9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:17.247904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-639e38f2-083b-4437-9e27-272f00a1cea9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:17.249691 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-639e38f2-083b-4437-9e27-272f00a1cea9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.169085 Apr 05 12:11:17.250472 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1374/2729] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:17 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:17.774763 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4da2e554-740f-46f1-bbe7-0e14b8066a73 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:17.775350 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4da2e554-740f-46f1-bbe7-0e14b8066a73 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:17.781894 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4da2e554-740f-46f1-bbe7-0e14b8066a73 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:17.782348 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4da2e554-740f-46f1-bbe7-0e14b8066a73 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:17.783110 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4da2e554-740f-46f1-bbe7-0e14b8066a73 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:17.783539 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4da2e554-740f-46f1-bbe7-0e14b8066a73 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:17.903924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-59fff836-2f29-41b4-baff-b27f5c987d37 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:17.904620 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-59fff836-2f29-41b4-baff-b27f5c987d37 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:17.911363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-59fff836-2f29-41b4-baff-b27f5c987d37 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:17.911819 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-59fff836-2f29-41b4-baff-b27f5c987d37 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:17.912618 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-59fff836-2f29-41b4-baff-b27f5c987d37 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:17.913043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-59fff836-2f29-41b4-baff-b27f5c987d37 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:17.920746 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4da2e554-740f-46f1-bbe7-0e14b8066a73 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:17.930279 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4da2e554-740f-46f1-bbe7-0e14b8066a73 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.159569 Apr 05 12:11:17.930887 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1356/2730] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:17 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:17.948910 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-821013ec-41bb-4ea0-bf7b-ea8f6f7df49c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:17.949515 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-821013ec-41bb-4ea0-bf7b-ea8f6f7df49c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:17.956243 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-821013ec-41bb-4ea0-bf7b-ea8f6f7df49c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:17.956686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-821013ec-41bb-4ea0-bf7b-ea8f6f7df49c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:17.957549 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-821013ec-41bb-4ea0-bf7b-ea8f6f7df49c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:17.957977 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-821013ec-41bb-4ea0-bf7b-ea8f6f7df49c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:18.052605 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-59fff836-2f29-41b4-baff-b27f5c987d37 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:18.061262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-59fff836-2f29-41b4-baff-b27f5c987d37 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.166108 Apr 05 12:11:18.062107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1375/2731] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:17 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:18.096664 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-821013ec-41bb-4ea0-bf7b-ea8f6f7df49c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:18.104822 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-821013ec-41bb-4ea0-bf7b-ea8f6f7df49c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.159863 Apr 05 12:11:18.105401 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1357/2732] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:17 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:11:18.279537 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3f7b8aa2-0189-49f3-9067-9b5b72273b4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:18.280662 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3f7b8aa2-0189-49f3-9067-9b5b72273b4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:18.291063 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f7b8aa2-0189-49f3-9067-9b5b72273b4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:18.291677 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f7b8aa2-0189-49f3-9067-9b5b72273b4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:18.292881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f7b8aa2-0189-49f3-9067-9b5b72273b4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:18.293453 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f7b8aa2-0189-49f3-9067-9b5b72273b4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:18.435033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3f7b8aa2-0189-49f3-9067-9b5b72273b4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:18.443639 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3f7b8aa2-0189-49f3-9067-9b5b72273b4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:18.445146 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3f7b8aa2-0189-49f3-9067-9b5b72273b4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:18.446305 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3f7b8aa2-0189-49f3-9067-9b5b72273b4f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.173883 Apr 05 12:11:18.446870 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1376/2733] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:18 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:18.952286 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b154bd8d-22c5-45c0-b151-4fbe5c47f4bf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:18.953302 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b154bd8d-22c5-45c0-b151-4fbe5c47f4bf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:18.963975 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b154bd8d-22c5-45c0-b151-4fbe5c47f4bf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:18.964756 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b154bd8d-22c5-45c0-b151-4fbe5c47f4bf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:18.966059 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b154bd8d-22c5-45c0-b151-4fbe5c47f4bf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:18.966781 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b154bd8d-22c5-45c0-b151-4fbe5c47f4bf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:19.078610 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-de05f2d3-fa5d-4d77-ae4c-dcf37a1043be tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:19.079179 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-de05f2d3-fa5d-4d77-ae4c-dcf37a1043be tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:19.086234 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-de05f2d3-fa5d-4d77-ae4c-dcf37a1043be tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:19.086584 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-de05f2d3-fa5d-4d77-ae4c-dcf37a1043be tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:19.087341 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-de05f2d3-fa5d-4d77-ae4c-dcf37a1043be tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:19.087768 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-de05f2d3-fa5d-4d77-ae4c-dcf37a1043be tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:19.112221 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b154bd8d-22c5-45c0-b151-4fbe5c47f4bf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:19.120355 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b154bd8d-22c5-45c0-b151-4fbe5c47f4bf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.175316 Apr 05 12:11:19.120933 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1358/2734] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:18 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:19.125298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-63aed92a-202d-4866-bd53-67d1471dac88 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:19.125896 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-63aed92a-202d-4866-bd53-67d1471dac88 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:19.132352 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63aed92a-202d-4866-bd53-67d1471dac88 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:19.132800 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63aed92a-202d-4866-bd53-67d1471dac88 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:19.133552 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63aed92a-202d-4866-bd53-67d1471dac88 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:19.133980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63aed92a-202d-4866-bd53-67d1471dac88 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:19.224745 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-de05f2d3-fa5d-4d77-ae4c-dcf37a1043be tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:19.233487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-de05f2d3-fa5d-4d77-ae4c-dcf37a1043be tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.158541 Apr 05 12:11:19.234261 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1377/2735] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:19 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:19.267647 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-63aed92a-202d-4866-bd53-67d1471dac88 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:19.275526 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-63aed92a-202d-4866-bd53-67d1471dac88 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.153662 Apr 05 12:11:19.276100 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1359/2736] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:19 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:19.471347 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-74dd200d-7b07-41d9-8bcd-4ba1859ab5c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:19.472027 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-74dd200d-7b07-41d9-8bcd-4ba1859ab5c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:19.479339 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-74dd200d-7b07-41d9-8bcd-4ba1859ab5c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:19.479791 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-74dd200d-7b07-41d9-8bcd-4ba1859ab5c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:19.480589 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-74dd200d-7b07-41d9-8bcd-4ba1859ab5c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:19.481103 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-74dd200d-7b07-41d9-8bcd-4ba1859ab5c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:19.615292 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-74dd200d-7b07-41d9-8bcd-4ba1859ab5c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:19.627438 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-74dd200d-7b07-41d9-8bcd-4ba1859ab5c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:19.630005 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-74dd200d-7b07-41d9-8bcd-4ba1859ab5c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:19.631734 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-74dd200d-7b07-41d9-8bcd-4ba1859ab5c0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.165357 Apr 05 12:11:19.632548 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1378/2737] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:19 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:20.141824 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-85363b9b-5d93-4a5b-a8bf-4f6ad659a920 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:20.142800 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-85363b9b-5d93-4a5b-a8bf-4f6ad659a920 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:20.152008 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85363b9b-5d93-4a5b-a8bf-4f6ad659a920 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:20.152512 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85363b9b-5d93-4a5b-a8bf-4f6ad659a920 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:20.153272 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85363b9b-5d93-4a5b-a8bf-4f6ad659a920 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:20.153704 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85363b9b-5d93-4a5b-a8bf-4f6ad659a920 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:20.251207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a1cc6882-5e3b-4367-974e-229f56ce822b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:20.251731 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a1cc6882-5e3b-4367-974e-229f56ce822b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:20.258511 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a1cc6882-5e3b-4367-974e-229f56ce822b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:20.258955 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a1cc6882-5e3b-4367-974e-229f56ce822b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:20.259707 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a1cc6882-5e3b-4367-974e-229f56ce822b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:20.260160 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a1cc6882-5e3b-4367-974e-229f56ce822b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:20.285992 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-85363b9b-5d93-4a5b-a8bf-4f6ad659a920 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:20.294281 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-85363b9b-5d93-4a5b-a8bf-4f6ad659a920 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.158951 Apr 05 12:11:20.294859 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1360/2738] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:20 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:20.299214 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0be5e7aa-3f36-420e-8618-10745b733279 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:20.299807 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0be5e7aa-3f36-420e-8618-10745b733279 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:20.305657 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0be5e7aa-3f36-420e-8618-10745b733279 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:20.306123 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0be5e7aa-3f36-420e-8618-10745b733279 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:20.306861 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0be5e7aa-3f36-420e-8618-10745b733279 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:20.307286 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0be5e7aa-3f36-420e-8618-10745b733279 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:20.397366 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a1cc6882-5e3b-4367-974e-229f56ce822b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:20.405321 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a1cc6882-5e3b-4367-974e-229f56ce822b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.158002 Apr 05 12:11:20.405908 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1379/2739] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:20 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:20.439188 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0be5e7aa-3f36-420e-8618-10745b733279 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:20.447352 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0be5e7aa-3f36-420e-8618-10745b733279 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.151563 Apr 05 12:11:20.447934 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1361/2740] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:20 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:20.654988 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-560f37bb-e097-450b-b194-a79743cc84a4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:20.655870 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-560f37bb-e097-450b-b194-a79743cc84a4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:20.666409 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-560f37bb-e097-450b-b194-a79743cc84a4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:20.667145 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-560f37bb-e097-450b-b194-a79743cc84a4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:20.668452 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-560f37bb-e097-450b-b194-a79743cc84a4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:20.669161 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-560f37bb-e097-450b-b194-a79743cc84a4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:20.815018 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-560f37bb-e097-450b-b194-a79743cc84a4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:20.823363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-560f37bb-e097-450b-b194-a79743cc84a4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:20.824876 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-560f37bb-e097-450b-b194-a79743cc84a4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:20.826036 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-560f37bb-e097-450b-b194-a79743cc84a4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.177863 Apr 05 12:11:20.826569 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1380/2741] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:20 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:21.316258 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-41097c78-f6d7-4641-a88b-9f86ed7406ff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:21.317303 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-41097c78-f6d7-4641-a88b-9f86ed7406ff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:21.328130 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-41097c78-f6d7-4641-a88b-9f86ed7406ff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:21.328891 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-41097c78-f6d7-4641-a88b-9f86ed7406ff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:21.330167 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-41097c78-f6d7-4641-a88b-9f86ed7406ff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:21.330896 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-41097c78-f6d7-4641-a88b-9f86ed7406ff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:21.422973 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f17729c5-cc8e-4a0e-944a-b2432457acb2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:21.423674 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f17729c5-cc8e-4a0e-944a-b2432457acb2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:21.430585 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f17729c5-cc8e-4a0e-944a-b2432457acb2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:21.431101 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f17729c5-cc8e-4a0e-944a-b2432457acb2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:21.431923 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f17729c5-cc8e-4a0e-944a-b2432457acb2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:21.432441 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f17729c5-cc8e-4a0e-944a-b2432457acb2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:21.473927 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-41097c78-f6d7-4641-a88b-9f86ed7406ff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:21.481992 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-41097c78-f6d7-4641-a88b-9f86ed7406ff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.172358 Apr 05 12:11:21.482702 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1362/2742] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:21 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:21.491386 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d61ff8b7-ade5-41a6-974e-361c9fbce0c7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:21.492342 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d61ff8b7-ade5-41a6-974e-361c9fbce0c7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:21.498349 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d61ff8b7-ade5-41a6-974e-361c9fbce0c7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:21.498798 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d61ff8b7-ade5-41a6-974e-361c9fbce0c7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:21.499554 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d61ff8b7-ade5-41a6-974e-361c9fbce0c7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:21.499979 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d61ff8b7-ade5-41a6-974e-361c9fbce0c7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:21.565659 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f17729c5-cc8e-4a0e-944a-b2432457acb2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:21.573620 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f17729c5-cc8e-4a0e-944a-b2432457acb2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.154743 Apr 05 12:11:21.574201 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1381/2743] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:21 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:21.631414 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d61ff8b7-ade5-41a6-974e-361c9fbce0c7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:21.643733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d61ff8b7-ade5-41a6-974e-361c9fbce0c7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.159699 Apr 05 12:11:21.644583 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1363/2744] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:21 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:21.851830 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ee071673-db7f-4b83-8207-c7bdb3e3d2de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:21.852613 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ee071673-db7f-4b83-8207-c7bdb3e3d2de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:21.859547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ee071673-db7f-4b83-8207-c7bdb3e3d2de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:21.860008 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ee071673-db7f-4b83-8207-c7bdb3e3d2de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:21.860924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ee071673-db7f-4b83-8207-c7bdb3e3d2de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:21.861584 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ee071673-db7f-4b83-8207-c7bdb3e3d2de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:22.008856 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ee071673-db7f-4b83-8207-c7bdb3e3d2de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:22.017541 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ee071673-db7f-4b83-8207-c7bdb3e3d2de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:22.019044 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ee071673-db7f-4b83-8207-c7bdb3e3d2de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:22.020241 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ee071673-db7f-4b83-8207-c7bdb3e3d2de tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.179585 Apr 05 12:11:22.020811 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1382/2745] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:21 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:22.503673 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c3da0e28-e812-436a-bb37-a4f09aa35a29 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:22.505070 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c3da0e28-e812-436a-bb37-a4f09aa35a29 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:22.513047 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3da0e28-e812-436a-bb37-a4f09aa35a29 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:22.513503 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3da0e28-e812-436a-bb37-a4f09aa35a29 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:22.514258 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3da0e28-e812-436a-bb37-a4f09aa35a29 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:22.514691 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3da0e28-e812-436a-bb37-a4f09aa35a29 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:22.591418 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-95d96222-ae03-482b-8a16-60e64d90854f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:22.592027 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-95d96222-ae03-482b-8a16-60e64d90854f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:22.598582 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95d96222-ae03-482b-8a16-60e64d90854f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:22.599199 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95d96222-ae03-482b-8a16-60e64d90854f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:22.599771 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95d96222-ae03-482b-8a16-60e64d90854f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:22.600595 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95d96222-ae03-482b-8a16-60e64d90854f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:22.654221 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c3da0e28-e812-436a-bb37-a4f09aa35a29 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:22.662525 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c3da0e28-e812-436a-bb37-a4f09aa35a29 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.165393 Apr 05 12:11:22.663100 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1364/2746] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:22 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:22.667583 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-44467d6d-f111-450a-8f06-6558a443413d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:22.668432 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-44467d6d-f111-450a-8f06-6558a443413d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:22.674016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-44467d6d-f111-450a-8f06-6558a443413d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:22.674453 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-44467d6d-f111-450a-8f06-6558a443413d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:22.675201 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-44467d6d-f111-450a-8f06-6558a443413d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:22.675614 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-44467d6d-f111-450a-8f06-6558a443413d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:22.736192 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-95d96222-ae03-482b-8a16-60e64d90854f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:22.744042 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-95d96222-ae03-482b-8a16-60e64d90854f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.156687 Apr 05 12:11:22.744691 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1383/2747] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:22 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:22.806628 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-44467d6d-f111-450a-8f06-6558a443413d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:22.814899 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-44467d6d-f111-450a-8f06-6558a443413d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.150882 Apr 05 12:11:22.815473 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1365/2748] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:22 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:23.043439 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-33c426ab-9f78-4a11-81b6-f65766c83cdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:23.044365 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-33c426ab-9f78-4a11-81b6-f65766c83cdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:23.054478 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-33c426ab-9f78-4a11-81b6-f65766c83cdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:23.055219 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-33c426ab-9f78-4a11-81b6-f65766c83cdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:23.056534 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-33c426ab-9f78-4a11-81b6-f65766c83cdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:23.057328 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-33c426ab-9f78-4a11-81b6-f65766c83cdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:23.204837 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-33c426ab-9f78-4a11-81b6-f65766c83cdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:23.213590 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-33c426ab-9f78-4a11-81b6-f65766c83cdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:23.215117 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-33c426ab-9f78-4a11-81b6-f65766c83cdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:23.216320 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-33c426ab-9f78-4a11-81b6-f65766c83cdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.180138 Apr 05 12:11:23.216881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1384/2749] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:23 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:23.684378 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-51c8dde7-f946-481d-89c1-aac19610ab37 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:23.685097 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-51c8dde7-f946-481d-89c1-aac19610ab37 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:23.693257 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-51c8dde7-f946-481d-89c1-aac19610ab37 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:23.693810 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-51c8dde7-f946-481d-89c1-aac19610ab37 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:23.694742 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-51c8dde7-f946-481d-89c1-aac19610ab37 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:23.695273 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-51c8dde7-f946-481d-89c1-aac19610ab37 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:23.761285 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6a66fe87-d387-47e5-ad8d-d73b79010e50 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:23.761910 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6a66fe87-d387-47e5-ad8d-d73b79010e50 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:23.768736 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6a66fe87-d387-47e5-ad8d-d73b79010e50 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:23.769186 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6a66fe87-d387-47e5-ad8d-d73b79010e50 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:23.769948 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6a66fe87-d387-47e5-ad8d-d73b79010e50 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:23.770373 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6a66fe87-d387-47e5-ad8d-d73b79010e50 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:23.841845 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-51c8dde7-f946-481d-89c1-aac19610ab37 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:23.849908 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-51c8dde7-f946-481d-89c1-aac19610ab37 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.172550 Apr 05 12:11:23.850483 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1366/2750] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:23 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:23.854922 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ee682b3a-1c02-41c3-9219-b9d94e0e5795 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:23.855542 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ee682b3a-1c02-41c3-9219-b9d94e0e5795 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:23.861416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee682b3a-1c02-41c3-9219-b9d94e0e5795 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:23.861864 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee682b3a-1c02-41c3-9219-b9d94e0e5795 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:23.862628 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee682b3a-1c02-41c3-9219-b9d94e0e5795 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:23.863059 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee682b3a-1c02-41c3-9219-b9d94e0e5795 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:23.905907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6a66fe87-d387-47e5-ad8d-d73b79010e50 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:23.913941 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6a66fe87-d387-47e5-ad8d-d73b79010e50 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.156559 Apr 05 12:11:23.921264 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1385/2751] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:23 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:24.002070 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ee682b3a-1c02-41c3-9219-b9d94e0e5795 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:24.010920 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ee682b3a-1c02-41c3-9219-b9d94e0e5795 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.159505 Apr 05 12:11:24.011623 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1367/2752] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:23 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:24.239253 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-50e29e45-33ae-48a9-9611-1361057de8f5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:24.240277 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-50e29e45-33ae-48a9-9611-1361057de8f5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:24.248793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-50e29e45-33ae-48a9-9611-1361057de8f5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:24.249234 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-50e29e45-33ae-48a9-9611-1361057de8f5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:24.249978 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-50e29e45-33ae-48a9-9611-1361057de8f5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:24.250400 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-50e29e45-33ae-48a9-9611-1361057de8f5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:24.385870 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-50e29e45-33ae-48a9-9611-1361057de8f5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:24.394450 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-50e29e45-33ae-48a9-9611-1361057de8f5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:24.395952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-50e29e45-33ae-48a9-9611-1361057de8f5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:24.397129 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-50e29e45-33ae-48a9-9611-1361057de8f5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.164376 Apr 05 12:11:24.397691 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1386/2753] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:24 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:24.871337 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a0bede98-c5a5-4c15-8c8f-feb2cf3545eb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:24.872401 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a0bede98-c5a5-4c15-8c8f-feb2cf3545eb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:24.882796 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a0bede98-c5a5-4c15-8c8f-feb2cf3545eb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:24.883545 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a0bede98-c5a5-4c15-8c8f-feb2cf3545eb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:24.884844 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a0bede98-c5a5-4c15-8c8f-feb2cf3545eb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:24.885574 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a0bede98-c5a5-4c15-8c8f-feb2cf3545eb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:24.930805 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7828a436-061f-46a8-9266-27542a98b82e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:24.931410 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7828a436-061f-46a8-9266-27542a98b82e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:24.937766 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7828a436-061f-46a8-9266-27542a98b82e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:24.938246 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7828a436-061f-46a8-9266-27542a98b82e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:24.939089 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7828a436-061f-46a8-9266-27542a98b82e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:24.939515 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7828a436-061f-46a8-9266-27542a98b82e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:25.022027 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a0bede98-c5a5-4c15-8c8f-feb2cf3545eb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:25.030563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a0bede98-c5a5-4c15-8c8f-feb2cf3545eb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.165676 Apr 05 12:11:25.031138 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1368/2754] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:24 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:25.035875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-587388d8-b344-4ead-a9d0-be2e691553b4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:25.036498 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-587388d8-b344-4ead-a9d0-be2e691553b4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:25.042399 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-587388d8-b344-4ead-a9d0-be2e691553b4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:25.042891 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-587388d8-b344-4ead-a9d0-be2e691553b4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:25.043958 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-587388d8-b344-4ead-a9d0-be2e691553b4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:25.044108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-587388d8-b344-4ead-a9d0-be2e691553b4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:25.092410 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7828a436-061f-46a8-9266-27542a98b82e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:25.100933 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7828a436-061f-46a8-9266-27542a98b82e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.173896 Apr 05 12:11:25.101566 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1387/2755] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:24 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:25.180219 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-587388d8-b344-4ead-a9d0-be2e691553b4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:25.188986 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-587388d8-b344-4ead-a9d0-be2e691553b4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.156909 Apr 05 12:11:25.189588 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1369/2756] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:25 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:25.418890 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cf13d24e-29a4-4f3c-8be9-b9c9e48e23e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:25.419406 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cf13d24e-29a4-4f3c-8be9-b9c9e48e23e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:25.426302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cf13d24e-29a4-4f3c-8be9-b9c9e48e23e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:25.426785 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cf13d24e-29a4-4f3c-8be9-b9c9e48e23e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:25.427570 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cf13d24e-29a4-4f3c-8be9-b9c9e48e23e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:25.428014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cf13d24e-29a4-4f3c-8be9-b9c9e48e23e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:25.563586 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cf13d24e-29a4-4f3c-8be9-b9c9e48e23e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:25.572609 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cf13d24e-29a4-4f3c-8be9-b9c9e48e23e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:25.574117 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cf13d24e-29a4-4f3c-8be9-b9c9e48e23e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:25.575397 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cf13d24e-29a4-4f3c-8be9-b9c9e48e23e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.162873 Apr 05 12:11:25.575963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1388/2757] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:25 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:26.050590 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d1bd7f04-e2e1-4697-aca5-ab6138228049 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:26.051532 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d1bd7f04-e2e1-4697-aca5-ab6138228049 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:26.060763 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d1bd7f04-e2e1-4697-aca5-ab6138228049 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:26.061204 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d1bd7f04-e2e1-4697-aca5-ab6138228049 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:26.061968 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d1bd7f04-e2e1-4697-aca5-ab6138228049 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:26.062393 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d1bd7f04-e2e1-4697-aca5-ab6138228049 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:26.118258 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-661dd015-f825-4b6d-87bf-8766c2f3752e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:26.119031 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-661dd015-f825-4b6d-87bf-8766c2f3752e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:26.126595 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-661dd015-f825-4b6d-87bf-8766c2f3752e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:26.126595 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-661dd015-f825-4b6d-87bf-8766c2f3752e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:26.126882 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-661dd015-f825-4b6d-87bf-8766c2f3752e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:26.127216 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-661dd015-f825-4b6d-87bf-8766c2f3752e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:26.193457 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d1bd7f04-e2e1-4697-aca5-ab6138228049 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:26.203135 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d1bd7f04-e2e1-4697-aca5-ab6138228049 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.158967 Apr 05 12:11:26.203713 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1370/2758] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:26 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:26.208213 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-48af6da8-e88c-4761-be8d-c5b5618d21db tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:26.208843 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-48af6da8-e88c-4761-be8d-c5b5618d21db tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:26.214710 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-48af6da8-e88c-4761-be8d-c5b5618d21db tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:26.215161 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-48af6da8-e88c-4761-be8d-c5b5618d21db tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:26.215907 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-48af6da8-e88c-4761-be8d-c5b5618d21db tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:26.216418 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-48af6da8-e88c-4761-be8d-c5b5618d21db tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:26.264232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-661dd015-f825-4b6d-87bf-8766c2f3752e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:26.272515 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-661dd015-f825-4b6d-87bf-8766c2f3752e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.158180 Apr 05 12:11:26.273216 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1389/2759] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:26 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:26.349078 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-48af6da8-e88c-4761-be8d-c5b5618d21db tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:26.357389 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-48af6da8-e88c-4761-be8d-c5b5618d21db tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.152660 Apr 05 12:11:26.357954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1371/2760] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:26 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:26.598411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-593ec278-85a2-4793-95ed-f7fd7fdac72f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:26.599296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-593ec278-85a2-4793-95ed-f7fd7fdac72f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:26.609456 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-593ec278-85a2-4793-95ed-f7fd7fdac72f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:26.610194 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-593ec278-85a2-4793-95ed-f7fd7fdac72f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:26.611442 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-593ec278-85a2-4793-95ed-f7fd7fdac72f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:26.612142 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-593ec278-85a2-4793-95ed-f7fd7fdac72f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:26.751086 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-593ec278-85a2-4793-95ed-f7fd7fdac72f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:26.759828 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-593ec278-85a2-4793-95ed-f7fd7fdac72f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:26.761339 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-593ec278-85a2-4793-95ed-f7fd7fdac72f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:26.762481 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-593ec278-85a2-4793-95ed-f7fd7fdac72f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.170771 Apr 05 12:11:26.763037 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1390/2761] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:26 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:27.220846 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fd91d37d-e9a8-4f3b-93f2-5a5b0ad6a1f7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:27.221805 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fd91d37d-e9a8-4f3b-93f2-5a5b0ad6a1f7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:27.229019 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd91d37d-e9a8-4f3b-93f2-5a5b0ad6a1f7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:27.232376 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd91d37d-e9a8-4f3b-93f2-5a5b0ad6a1f7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:27.233234 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd91d37d-e9a8-4f3b-93f2-5a5b0ad6a1f7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:27.233730 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd91d37d-e9a8-4f3b-93f2-5a5b0ad6a1f7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:27.290527 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e7eb70fa-3059-41f3-84f9-f21cd5394d50 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:27.291278 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e7eb70fa-3059-41f3-84f9-f21cd5394d50 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:27.298243 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e7eb70fa-3059-41f3-84f9-f21cd5394d50 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:27.298695 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e7eb70fa-3059-41f3-84f9-f21cd5394d50 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:27.299453 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e7eb70fa-3059-41f3-84f9-f21cd5394d50 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:27.299910 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e7eb70fa-3059-41f3-84f9-f21cd5394d50 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:27.373718 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fd91d37d-e9a8-4f3b-93f2-5a5b0ad6a1f7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:27.382336 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fd91d37d-e9a8-4f3b-93f2-5a5b0ad6a1f7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.165281 Apr 05 12:11:27.383307 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1372/2762] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:27 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:27.388119 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5b6da148-383d-40f0-b587-afbdf3e8494b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:27.388724 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5b6da148-383d-40f0-b587-afbdf3e8494b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:27.400112 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5b6da148-383d-40f0-b587-afbdf3e8494b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:27.400602 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5b6da148-383d-40f0-b587-afbdf3e8494b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:27.401360 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5b6da148-383d-40f0-b587-afbdf3e8494b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:27.401784 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5b6da148-383d-40f0-b587-afbdf3e8494b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:27.444248 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e7eb70fa-3059-41f3-84f9-f21cd5394d50 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:27.452779 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e7eb70fa-3059-41f3-84f9-f21cd5394d50 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.165856 Apr 05 12:11:27.453747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1391/2763] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:27 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:27.543446 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5b6da148-383d-40f0-b587-afbdf3e8494b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:27.551413 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5b6da148-383d-40f0-b587-afbdf3e8494b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.167145 Apr 05 12:11:27.551982 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1373/2764] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:27 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:27.781272 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d16791cd-925e-461c-99ea-9019d6b5794f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:27.781846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d16791cd-925e-461c-99ea-9019d6b5794f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:27.788239 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d16791cd-925e-461c-99ea-9019d6b5794f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:27.788688 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d16791cd-925e-461c-99ea-9019d6b5794f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:27.789433 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d16791cd-925e-461c-99ea-9019d6b5794f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:27.789861 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d16791cd-925e-461c-99ea-9019d6b5794f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:27.925742 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d16791cd-925e-461c-99ea-9019d6b5794f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:27.934449 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d16791cd-925e-461c-99ea-9019d6b5794f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:27.935933 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d16791cd-925e-461c-99ea-9019d6b5794f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:27.937133 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d16791cd-925e-461c-99ea-9019d6b5794f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.159859 Apr 05 12:11:27.937718 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1392/2765] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:27 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:28.403722 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a27d0edc-a969-4e81-b27e-e139ba2468c7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:28.404772 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a27d0edc-a969-4e81-b27e-e139ba2468c7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:28.415686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a27d0edc-a969-4e81-b27e-e139ba2468c7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:28.416394 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a27d0edc-a969-4e81-b27e-e139ba2468c7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:28.417646 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a27d0edc-a969-4e81-b27e-e139ba2468c7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:28.418596 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a27d0edc-a969-4e81-b27e-e139ba2468c7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:28.469502 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f8fe5d56-768f-4b28-8cc3-03e6e81f87fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:28.470075 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f8fe5d56-768f-4b28-8cc3-03e6e81f87fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:28.476622 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f8fe5d56-768f-4b28-8cc3-03e6e81f87fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:28.477061 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f8fe5d56-768f-4b28-8cc3-03e6e81f87fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:28.477816 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f8fe5d56-768f-4b28-8cc3-03e6e81f87fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:28.478243 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f8fe5d56-768f-4b28-8cc3-03e6e81f87fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:28.556793 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a27d0edc-a969-4e81-b27e-e139ba2468c7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:28.564963 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a27d0edc-a969-4e81-b27e-e139ba2468c7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.167695 Apr 05 12:11:28.565545 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1374/2766] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:28 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:28.570163 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c39ac6be-9c9a-4d26-b3bc-6d04d0cf6956 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:28.570893 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c39ac6be-9c9a-4d26-b3bc-6d04d0cf6956 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:28.577155 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c39ac6be-9c9a-4d26-b3bc-6d04d0cf6956 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:28.577606 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c39ac6be-9c9a-4d26-b3bc-6d04d0cf6956 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:28.578371 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c39ac6be-9c9a-4d26-b3bc-6d04d0cf6956 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:28.578841 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c39ac6be-9c9a-4d26-b3bc-6d04d0cf6956 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:28.614097 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f8fe5d56-768f-4b28-8cc3-03e6e81f87fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:28.622311 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f8fe5d56-768f-4b28-8cc3-03e6e81f87fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.156637 Apr 05 12:11:28.622898 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1393/2767] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:28 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:11:28.712797 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c39ac6be-9c9a-4d26-b3bc-6d04d0cf6956 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:28.721467 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c39ac6be-9c9a-4d26-b3bc-6d04d0cf6956 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.154961 Apr 05 12:11:28.722043 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1375/2768] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:28 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:28.959319 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-17a2b29b-f5f6-4e38-ab3e-d3f5edf07cd3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:28.960229 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-17a2b29b-f5f6-4e38-ab3e-d3f5edf07cd3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:28.968559 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-17a2b29b-f5f6-4e38-ab3e-d3f5edf07cd3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:28.969013 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-17a2b29b-f5f6-4e38-ab3e-d3f5edf07cd3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:28.969775 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-17a2b29b-f5f6-4e38-ab3e-d3f5edf07cd3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:28.970215 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-17a2b29b-f5f6-4e38-ab3e-d3f5edf07cd3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:29.118844 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-17a2b29b-f5f6-4e38-ab3e-d3f5edf07cd3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:29.127944 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-17a2b29b-f5f6-4e38-ab3e-d3f5edf07cd3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:29.130847 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-17a2b29b-f5f6-4e38-ab3e-d3f5edf07cd3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:29.132800 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-17a2b29b-f5f6-4e38-ab3e-d3f5edf07cd3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.180010 Apr 05 12:11:29.133666 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1394/2769] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:28 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:29.585772 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-394a2280-d210-4e62-a577-7cd6a2d567b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:29.586767 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-394a2280-d210-4e62-a577-7cd6a2d567b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:29.594560 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-394a2280-d210-4e62-a577-7cd6a2d567b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:29.595040 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-394a2280-d210-4e62-a577-7cd6a2d567b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:29.595803 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-394a2280-d210-4e62-a577-7cd6a2d567b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:29.596291 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-394a2280-d210-4e62-a577-7cd6a2d567b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:29.641645 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d9efb084-ec73-465b-8415-991ba1e63b7c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:29.642573 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d9efb084-ec73-465b-8415-991ba1e63b7c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:29.649234 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d9efb084-ec73-465b-8415-991ba1e63b7c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:29.649436 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d9efb084-ec73-465b-8415-991ba1e63b7c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:29.650475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d9efb084-ec73-465b-8415-991ba1e63b7c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:29.650912 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d9efb084-ec73-465b-8415-991ba1e63b7c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:29.736149 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-394a2280-d210-4e62-a577-7cd6a2d567b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:29.744291 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-394a2280-d210-4e62-a577-7cd6a2d567b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.165301 Apr 05 12:11:29.744867 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1376/2770] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:29 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:29.749545 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-751e1555-8bb1-4aa2-9912-43621f98296a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:29.750367 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-751e1555-8bb1-4aa2-9912-43621f98296a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:29.756660 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-751e1555-8bb1-4aa2-9912-43621f98296a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:29.757459 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-751e1555-8bb1-4aa2-9912-43621f98296a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:29.758596 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-751e1555-8bb1-4aa2-9912-43621f98296a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:29.759201 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-751e1555-8bb1-4aa2-9912-43621f98296a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:29.797788 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d9efb084-ec73-465b-8415-991ba1e63b7c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:29.805983 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d9efb084-ec73-465b-8415-991ba1e63b7c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.169270 Apr 05 12:11:29.806702 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1395/2771] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:29 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:29.891318 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-751e1555-8bb1-4aa2-9912-43621f98296a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:29.899942 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-751e1555-8bb1-4aa2-9912-43621f98296a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.154115 Apr 05 12:11:29.900550 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1377/2772] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:29 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:30.159581 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b5ffc7b1-9f99-437c-b1b7-871c900cc6d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:30.160526 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b5ffc7b1-9f99-437c-b1b7-871c900cc6d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:30.169841 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b5ffc7b1-9f99-437c-b1b7-871c900cc6d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:30.170297 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b5ffc7b1-9f99-437c-b1b7-871c900cc6d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:30.171057 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b5ffc7b1-9f99-437c-b1b7-871c900cc6d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:30.171494 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b5ffc7b1-9f99-437c-b1b7-871c900cc6d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:30.316924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b5ffc7b1-9f99-437c-b1b7-871c900cc6d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:30.325447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b5ffc7b1-9f99-437c-b1b7-871c900cc6d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:30.326928 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b5ffc7b1-9f99-437c-b1b7-871c900cc6d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:30.328084 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b5ffc7b1-9f99-437c-b1b7-871c900cc6d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.177711 Apr 05 12:11:30.328684 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1396/2773] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:30 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:30.765804 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-13945324-5e5b-44b9-aafe-08594f059ae7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:30.766637 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-13945324-5e5b-44b9-aafe-08594f059ae7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:30.777395 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13945324-5e5b-44b9-aafe-08594f059ae7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:30.778146 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13945324-5e5b-44b9-aafe-08594f059ae7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:30.779402 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13945324-5e5b-44b9-aafe-08594f059ae7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:30.780137 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13945324-5e5b-44b9-aafe-08594f059ae7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:30.822871 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-791fb779-840b-47ed-b635-de6545d7ed55 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:30.823544 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-791fb779-840b-47ed-b635-de6545d7ed55 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:30.830332 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-791fb779-840b-47ed-b635-de6545d7ed55 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:30.830785 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-791fb779-840b-47ed-b635-de6545d7ed55 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:30.831550 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-791fb779-840b-47ed-b635-de6545d7ed55 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:30.831980 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-791fb779-840b-47ed-b635-de6545d7ed55 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:30.921175 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-13945324-5e5b-44b9-aafe-08594f059ae7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:30.929155 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-13945324-5e5b-44b9-aafe-08594f059ae7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.170144 Apr 05 12:11:30.929761 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1378/2774] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:30 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:30.934435 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-138b3ed8-e55f-4dc9-842b-036d6ea57ec0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:30.935290 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-138b3ed8-e55f-4dc9-842b-036d6ea57ec0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:30.941078 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-138b3ed8-e55f-4dc9-842b-036d6ea57ec0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:30.941529 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-138b3ed8-e55f-4dc9-842b-036d6ea57ec0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:30.942293 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-138b3ed8-e55f-4dc9-842b-036d6ea57ec0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:30.942726 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-138b3ed8-e55f-4dc9-842b-036d6ea57ec0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:30.966596 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-791fb779-840b-47ed-b635-de6545d7ed55 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:30.974708 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-791fb779-840b-47ed-b635-de6545d7ed55 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.155697 Apr 05 12:11:30.975289 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1397/2775] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:30 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:31.079001 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-138b3ed8-e55f-4dc9-842b-036d6ea57ec0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:31.087542 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-138b3ed8-e55f-4dc9-842b-036d6ea57ec0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.156638 Apr 05 12:11:31.088122 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1379/2776] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:30 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:31.349973 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b64ec522-2d18-41f8-a0a4-4375c420d0df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:31.350985 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b64ec522-2d18-41f8-a0a4-4375c420d0df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:31.358968 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b64ec522-2d18-41f8-a0a4-4375c420d0df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:31.359429 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b64ec522-2d18-41f8-a0a4-4375c420d0df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:31.360232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b64ec522-2d18-41f8-a0a4-4375c420d0df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:31.360703 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b64ec522-2d18-41f8-a0a4-4375c420d0df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:31.493171 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b64ec522-2d18-41f8-a0a4-4375c420d0df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:31.501618 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b64ec522-2d18-41f8-a0a4-4375c420d0df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:31.503154 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b64ec522-2d18-41f8-a0a4-4375c420d0df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:31.504649 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b64ec522-2d18-41f8-a0a4-4375c420d0df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.160968 Apr 05 12:11:31.505217 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1398/2777] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:31 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:31.950831 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2ce35674-b78b-434f-906d-7cd2b79595e2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:31.951824 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2ce35674-b78b-434f-906d-7cd2b79595e2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:31.962334 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ce35674-b78b-434f-906d-7cd2b79595e2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:31.963078 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ce35674-b78b-434f-906d-7cd2b79595e2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:31.964363 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ce35674-b78b-434f-906d-7cd2b79595e2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:31.965074 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ce35674-b78b-434f-906d-7cd2b79595e2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:31.991999 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ea406083-026d-433e-887b-12fef83a6d89 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:31.992617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ea406083-026d-433e-887b-12fef83a6d89 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:31.999591 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea406083-026d-433e-887b-12fef83a6d89 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:32.000037 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea406083-026d-433e-887b-12fef83a6d89 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:32.000833 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea406083-026d-433e-887b-12fef83a6d89 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:32.001285 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea406083-026d-433e-887b-12fef83a6d89 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:32.103106 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2ce35674-b78b-434f-906d-7cd2b79595e2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:32.111483 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2ce35674-b78b-434f-906d-7cd2b79595e2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.167212 Apr 05 12:11:32.112058 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1380/2778] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:31 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:32.116519 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bcb6eac5-a6d5-41b6-8252-f7c97105e122 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:32.117118 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bcb6eac5-a6d5-41b6-8252-f7c97105e122 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:32.122814 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bcb6eac5-a6d5-41b6-8252-f7c97105e122 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:32.123262 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bcb6eac5-a6d5-41b6-8252-f7c97105e122 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:32.124024 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bcb6eac5-a6d5-41b6-8252-f7c97105e122 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:32.124478 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bcb6eac5-a6d5-41b6-8252-f7c97105e122 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:32.141253 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ea406083-026d-433e-887b-12fef83a6d89 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:32.149189 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ea406083-026d-433e-887b-12fef83a6d89 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.161093 Apr 05 12:11:32.149770 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1399/2779] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:31 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:32.269736 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-bcb6eac5-a6d5-41b6-8252-f7c97105e122 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:32.280340 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bcb6eac5-a6d5-41b6-8252-f7c97105e122 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.166928 Apr 05 12:11:32.281108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1381/2780] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:32 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:32.527597 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-251ff4ba-c786-4b24-96a9-90f9ce623fa6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:32.528476 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-251ff4ba-c786-4b24-96a9-90f9ce623fa6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:32.535042 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-251ff4ba-c786-4b24-96a9-90f9ce623fa6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:32.535486 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-251ff4ba-c786-4b24-96a9-90f9ce623fa6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:32.536274 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-251ff4ba-c786-4b24-96a9-90f9ce623fa6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:32.536732 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-251ff4ba-c786-4b24-96a9-90f9ce623fa6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:32.684655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-251ff4ba-c786-4b24-96a9-90f9ce623fa6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:32.693536 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-251ff4ba-c786-4b24-96a9-90f9ce623fa6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:32.695028 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-251ff4ba-c786-4b24-96a9-90f9ce623fa6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:32.696219 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-251ff4ba-c786-4b24-96a9-90f9ce623fa6 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.173423 Apr 05 12:11:32.696787 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1400/2781] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:32 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:33.133268 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ff27a14a-a7b8-4d73-a033-94244c98d172 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:33.134322 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ff27a14a-a7b8-4d73-a033-94244c98d172 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:33.142593 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff27a14a-a7b8-4d73-a033-94244c98d172 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:33.143059 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff27a14a-a7b8-4d73-a033-94244c98d172 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:33.143889 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff27a14a-a7b8-4d73-a033-94244c98d172 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:33.144387 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff27a14a-a7b8-4d73-a033-94244c98d172 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:33.166945 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-55c7c1fa-8758-47ae-854e-258e536096f9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:33.167530 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-55c7c1fa-8758-47ae-854e-258e536096f9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:33.174444 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-55c7c1fa-8758-47ae-854e-258e536096f9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:33.174899 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-55c7c1fa-8758-47ae-854e-258e536096f9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:33.175653 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-55c7c1fa-8758-47ae-854e-258e536096f9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:33.176101 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-55c7c1fa-8758-47ae-854e-258e536096f9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:33.280676 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ff27a14a-a7b8-4d73-a033-94244c98d172 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:33.288504 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ff27a14a-a7b8-4d73-a033-94244c98d172 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.162191 Apr 05 12:11:33.298093 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1382/2782] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:33 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:33.298093 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e76bc7cd-c3da-44d0-8cba-4719b3cf822f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:33.298397 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e76bc7cd-c3da-44d0-8cba-4719b3cf822f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:33.304406 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e76bc7cd-c3da-44d0-8cba-4719b3cf822f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:33.304858 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e76bc7cd-c3da-44d0-8cba-4719b3cf822f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:33.305613 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e76bc7cd-c3da-44d0-8cba-4719b3cf822f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:33.306038 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e76bc7cd-c3da-44d0-8cba-4719b3cf822f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:33.312607 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-55c7c1fa-8758-47ae-854e-258e536096f9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:33.320574 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-55c7c1fa-8758-47ae-854e-258e536096f9 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.157713 Apr 05 12:11:33.321156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1401/2783] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:33 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:33.443051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e76bc7cd-c3da-44d0-8cba-4719b3cf822f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:33.451378 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e76bc7cd-c3da-44d0-8cba-4719b3cf822f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.157355 Apr 05 12:11:33.451954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1383/2784] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:33 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:33.718312 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b9b0b78a-fa94-42d2-8536-f20ea86edf50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:33.719371 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b9b0b78a-fa94-42d2-8536-f20ea86edf50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:33.729637 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9b0b78a-fa94-42d2-8536-f20ea86edf50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:33.730391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9b0b78a-fa94-42d2-8536-f20ea86edf50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:33.731573 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9b0b78a-fa94-42d2-8536-f20ea86edf50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:33.732005 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9b0b78a-fa94-42d2-8536-f20ea86edf50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:33.868563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b9b0b78a-fa94-42d2-8536-f20ea86edf50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:33.877767 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b9b0b78a-fa94-42d2-8536-f20ea86edf50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:33.879673 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b9b0b78a-fa94-42d2-8536-f20ea86edf50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:33.880878 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b9b0b78a-fa94-42d2-8536-f20ea86edf50 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.169211 Apr 05 12:11:33.881447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1402/2785] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:33 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:34.309876 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-44cdddd9-1ee6-4649-b4b5-47b5756b6f25 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:34.310840 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-44cdddd9-1ee6-4649-b4b5-47b5756b6f25 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:34.321402 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-44cdddd9-1ee6-4649-b4b5-47b5756b6f25 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:34.322132 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-44cdddd9-1ee6-4649-b4b5-47b5756b6f25 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:34.323377 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-44cdddd9-1ee6-4649-b4b5-47b5756b6f25 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:34.324150 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-44cdddd9-1ee6-4649-b4b5-47b5756b6f25 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:34.337985 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d1a21c48-65ef-4e42-a4bb-9776cd0cf360 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:34.338693 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d1a21c48-65ef-4e42-a4bb-9776cd0cf360 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:34.345595 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d1a21c48-65ef-4e42-a4bb-9776cd0cf360 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:34.346040 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d1a21c48-65ef-4e42-a4bb-9776cd0cf360 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:34.346799 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d1a21c48-65ef-4e42-a4bb-9776cd0cf360 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:34.347233 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d1a21c48-65ef-4e42-a4bb-9776cd0cf360 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:34.459560 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-44cdddd9-1ee6-4649-b4b5-47b5756b6f25 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:34.467967 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-44cdddd9-1ee6-4649-b4b5-47b5756b6f25 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.164575 Apr 05 12:11:34.468599 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1384/2786] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:34 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:34.473204 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c52e3c63-28d3-4178-920c-120c9d58e930 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:34.473809 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c52e3c63-28d3-4178-920c-120c9d58e930 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:34.479583 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c52e3c63-28d3-4178-920c-120c9d58e930 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:34.480102 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c52e3c63-28d3-4178-920c-120c9d58e930 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:34.480935 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c52e3c63-28d3-4178-920c-120c9d58e930 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:34.481472 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c52e3c63-28d3-4178-920c-120c9d58e930 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:34.485451 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d1a21c48-65ef-4e42-a4bb-9776cd0cf360 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:34.493591 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d1a21c48-65ef-4e42-a4bb-9776cd0cf360 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.159405 Apr 05 12:11:34.494196 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1403/2787] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:34 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:34.780518 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c52e3c63-28d3-4178-920c-120c9d58e930 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:34.788397 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c52e3c63-28d3-4178-920c-120c9d58e930 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.318814 Apr 05 12:11:34.788980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1385/2788] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:34 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:34.904156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3140b229-de2d-4ac0-9ba7-e1dc5a3f6c58 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:34.904786 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3140b229-de2d-4ac0-9ba7-e1dc5a3f6c58 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:34.911319 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3140b229-de2d-4ac0-9ba7-e1dc5a3f6c58 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:34.911770 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3140b229-de2d-4ac0-9ba7-e1dc5a3f6c58 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:34.912572 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3140b229-de2d-4ac0-9ba7-e1dc5a3f6c58 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:34.913006 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3140b229-de2d-4ac0-9ba7-e1dc5a3f6c58 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:35.054747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3140b229-de2d-4ac0-9ba7-e1dc5a3f6c58 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:35.063827 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3140b229-de2d-4ac0-9ba7-e1dc5a3f6c58 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:35.065400 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3140b229-de2d-4ac0-9ba7-e1dc5a3f6c58 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:35.066571 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3140b229-de2d-4ac0-9ba7-e1dc5a3f6c58 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.168192 Apr 05 12:11:35.067133 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1404/2789] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:34 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:35.486649 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fe27f609-1650-4a92-aa86-1b1e082e75b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:35.487315 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fe27f609-1650-4a92-aa86-1b1e082e75b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:35.495228 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe27f609-1650-4a92-aa86-1b1e082e75b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:35.495756 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe27f609-1650-4a92-aa86-1b1e082e75b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:35.496701 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe27f609-1650-4a92-aa86-1b1e082e75b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:35.497240 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe27f609-1650-4a92-aa86-1b1e082e75b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:35.511113 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-80114fc4-da22-4533-b9ac-059b1a0aac2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:35.511870 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-80114fc4-da22-4533-b9ac-059b1a0aac2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:35.518595 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-80114fc4-da22-4533-b9ac-059b1a0aac2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:35.519073 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-80114fc4-da22-4533-b9ac-059b1a0aac2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:35.519825 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-80114fc4-da22-4533-b9ac-059b1a0aac2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:35.520287 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-80114fc4-da22-4533-b9ac-059b1a0aac2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:35.638309 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fe27f609-1650-4a92-aa86-1b1e082e75b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:35.646194 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fe27f609-1650-4a92-aa86-1b1e082e75b9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.164119 Apr 05 12:11:35.646766 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1386/2790] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:35 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:35.654607 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-80114fc4-da22-4533-b9ac-059b1a0aac2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:35.662450 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-80114fc4-da22-4533-b9ac-059b1a0aac2c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.155288 Apr 05 12:11:35.663007 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1405/2791] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:35 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:35.809942 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d88d8fe4-197e-48e9-98f3-bf16916a6839 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:35.810814 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d88d8fe4-197e-48e9-98f3-bf16916a6839 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:35.821108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d88d8fe4-197e-48e9-98f3-bf16916a6839 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:35.821842 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d88d8fe4-197e-48e9-98f3-bf16916a6839 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:35.823074 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d88d8fe4-197e-48e9-98f3-bf16916a6839 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:35.823779 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d88d8fe4-197e-48e9-98f3-bf16916a6839 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:35.960999 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d88d8fe4-197e-48e9-98f3-bf16916a6839 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:35.973866 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d88d8fe4-197e-48e9-98f3-bf16916a6839 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.170371 Apr 05 12:11:35.974673 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1387/2792] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:35 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:36.092306 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4c253f1d-41db-4b67-b5c4-b6c2b3627891 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:36.093199 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4c253f1d-41db-4b67-b5c4-b6c2b3627891 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:36.103728 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4c253f1d-41db-4b67-b5c4-b6c2b3627891 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:36.104539 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4c253f1d-41db-4b67-b5c4-b6c2b3627891 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:36.105786 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4c253f1d-41db-4b67-b5c4-b6c2b3627891 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:36.106509 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4c253f1d-41db-4b67-b5c4-b6c2b3627891 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:36.262866 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4c253f1d-41db-4b67-b5c4-b6c2b3627891 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:36.271375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4c253f1d-41db-4b67-b5c4-b6c2b3627891 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:36.272907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4c253f1d-41db-4b67-b5c4-b6c2b3627891 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:36.274051 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4c253f1d-41db-4b67-b5c4-b6c2b3627891 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.188493 Apr 05 12:11:36.274623 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1406/2793] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:36 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:36.663540 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6b9a47ea-c9c2-4172-a95b-4b443784b1e7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:36.664171 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6b9a47ea-c9c2-4172-a95b-4b443784b1e7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:36.670551 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6b9a47ea-c9c2-4172-a95b-4b443784b1e7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:36.671008 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6b9a47ea-c9c2-4172-a95b-4b443784b1e7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:36.671899 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6b9a47ea-c9c2-4172-a95b-4b443784b1e7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:36.672352 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6b9a47ea-c9c2-4172-a95b-4b443784b1e7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:36.679635 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-044d1c27-74b7-4e7d-8dab-d3030d8ee6da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:36.680290 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-044d1c27-74b7-4e7d-8dab-d3030d8ee6da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:36.686936 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-044d1c27-74b7-4e7d-8dab-d3030d8ee6da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:36.687356 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-044d1c27-74b7-4e7d-8dab-d3030d8ee6da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:36.688193 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-044d1c27-74b7-4e7d-8dab-d3030d8ee6da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:36.688630 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-044d1c27-74b7-4e7d-8dab-d3030d8ee6da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:36.808121 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6b9a47ea-c9c2-4172-a95b-4b443784b1e7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:36.816573 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6b9a47ea-c9c2-4172-a95b-4b443784b1e7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.156908 Apr 05 12:11:36.817143 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1388/2794] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:36 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:36.822541 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-044d1c27-74b7-4e7d-8dab-d3030d8ee6da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:36.830700 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-044d1c27-74b7-4e7d-8dab-d3030d8ee6da tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.154993 Apr 05 12:11:36.831300 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1407/2795] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:36 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:36.998616 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2b6fbbf1-0fbc-43d4-b456-898b7c1bf2cb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:36.999932 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2b6fbbf1-0fbc-43d4-b456-898b7c1bf2cb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:37.007864 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2b6fbbf1-0fbc-43d4-b456-898b7c1bf2cb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:37.008367 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2b6fbbf1-0fbc-43d4-b456-898b7c1bf2cb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:37.009245 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2b6fbbf1-0fbc-43d4-b456-898b7c1bf2cb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:37.009771 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2b6fbbf1-0fbc-43d4-b456-898b7c1bf2cb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:37.149081 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2b6fbbf1-0fbc-43d4-b456-898b7c1bf2cb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:37.157482 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2b6fbbf1-0fbc-43d4-b456-898b7c1bf2cb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.165416 Apr 05 12:11:37.158053 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1389/2796] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:36 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:37.291877 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e222a2e5-174a-4021-a248-f2164c1c8d7c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:37.292433 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e222a2e5-174a-4021-a248-f2164c1c8d7c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:37.298861 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e222a2e5-174a-4021-a248-f2164c1c8d7c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:37.299309 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e222a2e5-174a-4021-a248-f2164c1c8d7c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:37.300056 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e222a2e5-174a-4021-a248-f2164c1c8d7c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:37.300511 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e222a2e5-174a-4021-a248-f2164c1c8d7c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:37.449024 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e222a2e5-174a-4021-a248-f2164c1c8d7c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:37.458929 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e222a2e5-174a-4021-a248-f2164c1c8d7c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:37.460468 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e222a2e5-174a-4021-a248-f2164c1c8d7c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:37.461614 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e222a2e5-174a-4021-a248-f2164c1c8d7c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.173792 Apr 05 12:11:37.462157 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1408/2797] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:37 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:37.836871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4f6a25ac-8caa-4baa-b081-46f8350861e5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:37.837841 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4f6a25ac-8caa-4baa-b081-46f8350861e5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:37.846731 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4f6a25ac-8caa-4baa-b081-46f8350861e5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:37.847191 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4f6a25ac-8caa-4baa-b081-46f8350861e5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:37.847941 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4f6a25ac-8caa-4baa-b081-46f8350861e5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:37.848397 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4f6a25ac-8caa-4baa-b081-46f8350861e5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:37.848966 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c414ce35-fe9e-4303-97e7-d5ed199d794b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:37.849584 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c414ce35-fe9e-4303-97e7-d5ed199d794b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:37.856155 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c414ce35-fe9e-4303-97e7-d5ed199d794b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:37.856609 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c414ce35-fe9e-4303-97e7-d5ed199d794b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:37.857391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c414ce35-fe9e-4303-97e7-d5ed199d794b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:37.857809 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c414ce35-fe9e-4303-97e7-d5ed199d794b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:37.981103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4f6a25ac-8caa-4baa-b081-46f8350861e5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:37.989154 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4f6a25ac-8caa-4baa-b081-46f8350861e5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.158772 Apr 05 12:11:37.989736 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1390/2798] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:37 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:37.993202 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c414ce35-fe9e-4303-97e7-d5ed199d794b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:38.001249 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c414ce35-fe9e-4303-97e7-d5ed199d794b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.156266 Apr 05 12:11:38.001811 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1409/2799] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:37 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:38.178701 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a8db945f-fe56-4b21-aee3-f2edab937126 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:38.179712 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a8db945f-fe56-4b21-aee3-f2edab937126 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:38.189906 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a8db945f-fe56-4b21-aee3-f2edab937126 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:38.190660 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a8db945f-fe56-4b21-aee3-f2edab937126 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:38.192035 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a8db945f-fe56-4b21-aee3-f2edab937126 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:38.192721 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a8db945f-fe56-4b21-aee3-f2edab937126 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:38.335836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a8db945f-fe56-4b21-aee3-f2edab937126 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:38.344381 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a8db945f-fe56-4b21-aee3-f2edab937126 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.172563 Apr 05 12:11:38.344960 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1391/2800] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:38 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:38.482138 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-67e1928f-0eb0-4e50-8242-85989f4ec7bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:38.483063 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-67e1928f-0eb0-4e50-8242-85989f4ec7bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:38.491460 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-67e1928f-0eb0-4e50-8242-85989f4ec7bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:38.492053 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-67e1928f-0eb0-4e50-8242-85989f4ec7bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:38.493080 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-67e1928f-0eb0-4e50-8242-85989f4ec7bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:38.493645 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-67e1928f-0eb0-4e50-8242-85989f4ec7bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:38.625309 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-67e1928f-0eb0-4e50-8242-85989f4ec7bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:38.634418 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-67e1928f-0eb0-4e50-8242-85989f4ec7bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:38.635954 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-67e1928f-0eb0-4e50-8242-85989f4ec7bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:38.637140 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-67e1928f-0eb0-4e50-8242-85989f4ec7bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.160193 Apr 05 12:11:38.637697 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1410/2801] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:38 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:39.008390 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-817e3a28-867f-4399-8253-f4a89583a63f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:39.008985 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-817e3a28-867f-4399-8253-f4a89583a63f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:39.016113 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-817e3a28-867f-4399-8253-f4a89583a63f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:39.016587 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-817e3a28-867f-4399-8253-f4a89583a63f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:39.017351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-817e3a28-867f-4399-8253-f4a89583a63f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:39.017786 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-817e3a28-867f-4399-8253-f4a89583a63f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:39.019017 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b0e4cefa-3d2a-4a6a-9f4a-ab126bc9072c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:39.019619 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b0e4cefa-3d2a-4a6a-9f4a-ab126bc9072c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:39.025837 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b0e4cefa-3d2a-4a6a-9f4a-ab126bc9072c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:39.026282 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b0e4cefa-3d2a-4a6a-9f4a-ab126bc9072c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:39.027024 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b0e4cefa-3d2a-4a6a-9f4a-ab126bc9072c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:39.027451 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b0e4cefa-3d2a-4a6a-9f4a-ab126bc9072c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:39.150811 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-817e3a28-867f-4399-8253-f4a89583a63f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:39.159119 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-817e3a28-867f-4399-8253-f4a89583a63f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.155152 Apr 05 12:11:39.159706 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1392/2802] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:39 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:39.161558 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b0e4cefa-3d2a-4a6a-9f4a-ab126bc9072c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:39.169484 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b0e4cefa-3d2a-4a6a-9f4a-ab126bc9072c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.154566 Apr 05 12:11:39.170036 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1411/2803] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:39 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:39.366404 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f10a1fcc-4c24-4b60-b271-ea69ab875487 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:39.367330 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f10a1fcc-4c24-4b60-b271-ea69ab875487 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:39.376435 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f10a1fcc-4c24-4b60-b271-ea69ab875487 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:39.376890 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f10a1fcc-4c24-4b60-b271-ea69ab875487 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:39.377659 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f10a1fcc-4c24-4b60-b271-ea69ab875487 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:39.378094 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f10a1fcc-4c24-4b60-b271-ea69ab875487 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:39.520142 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f10a1fcc-4c24-4b60-b271-ea69ab875487 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:39.532746 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f10a1fcc-4c24-4b60-b271-ea69ab875487 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.172762 Apr 05 12:11:39.533603 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1393/2804] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:39 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:39.659008 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1897d9b9-f082-45b1-b9e7-74dc41227c39 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:39.659851 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1897d9b9-f082-45b1-b9e7-74dc41227c39 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:39.669411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1897d9b9-f082-45b1-b9e7-74dc41227c39 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:39.670133 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1897d9b9-f082-45b1-b9e7-74dc41227c39 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:39.671406 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1897d9b9-f082-45b1-b9e7-74dc41227c39 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:39.672006 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1897d9b9-f082-45b1-b9e7-74dc41227c39 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:39.809533 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1897d9b9-f082-45b1-b9e7-74dc41227c39 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:39.818286 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1897d9b9-f082-45b1-b9e7-74dc41227c39 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:39.819764 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1897d9b9-f082-45b1-b9e7-74dc41227c39 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:39.820945 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1897d9b9-f082-45b1-b9e7-74dc41227c39 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.168626 Apr 05 12:11:39.821519 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1412/2805] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:39 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:40.180003 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c07ff667-f061-4648-bf32-913a7f1cbfc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:40.181068 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c07ff667-f061-4648-bf32-913a7f1cbfc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:40.189491 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-43582c5f-94cb-431e-9726-5f2a9a52f08a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:40.190084 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-43582c5f-94cb-431e-9726-5f2a9a52f08a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:40.190223 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c07ff667-f061-4648-bf32-913a7f1cbfc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:40.190680 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c07ff667-f061-4648-bf32-913a7f1cbfc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:40.191455 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c07ff667-f061-4648-bf32-913a7f1cbfc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:40.191890 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c07ff667-f061-4648-bf32-913a7f1cbfc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:40.196620 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-43582c5f-94cb-431e-9726-5f2a9a52f08a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:40.197073 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-43582c5f-94cb-431e-9726-5f2a9a52f08a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:40.197836 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-43582c5f-94cb-431e-9726-5f2a9a52f08a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:40.198275 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-43582c5f-94cb-431e-9726-5f2a9a52f08a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:40.331060 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c07ff667-f061-4648-bf32-913a7f1cbfc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:40.337042 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-43582c5f-94cb-431e-9726-5f2a9a52f08a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:40.339177 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c07ff667-f061-4648-bf32-913a7f1cbfc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.165644 Apr 05 12:11:40.339792 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1394/2806] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:40 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:40.345332 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-43582c5f-94cb-431e-9726-5f2a9a52f08a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.161104 Apr 05 12:11:40.345908 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1413/2807] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:40 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:40.558822 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4d0bd1e3-4d03-42d7-b1a2-f7282312fe87 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:40.559838 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4d0bd1e3-4d03-42d7-b1a2-f7282312fe87 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:40.570241 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4d0bd1e3-4d03-42d7-b1a2-f7282312fe87 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:40.571043 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4d0bd1e3-4d03-42d7-b1a2-f7282312fe87 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:40.572375 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4d0bd1e3-4d03-42d7-b1a2-f7282312fe87 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:40.573168 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4d0bd1e3-4d03-42d7-b1a2-f7282312fe87 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:40.720642 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4d0bd1e3-4d03-42d7-b1a2-f7282312fe87 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:40.728972 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4d0bd1e3-4d03-42d7-b1a2-f7282312fe87 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.176692 Apr 05 12:11:40.729542 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1395/2808] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:40 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:40.843412 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ed4421e7-626a-4f4d-aaa5-90b7c5f1f43c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:40.844132 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ed4421e7-626a-4f4d-aaa5-90b7c5f1f43c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:40.851195 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ed4421e7-626a-4f4d-aaa5-90b7c5f1f43c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:40.851695 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ed4421e7-626a-4f4d-aaa5-90b7c5f1f43c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:40.852586 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ed4421e7-626a-4f4d-aaa5-90b7c5f1f43c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:40.853068 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ed4421e7-626a-4f4d-aaa5-90b7c5f1f43c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:41.006089 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ed4421e7-626a-4f4d-aaa5-90b7c5f1f43c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:41.017745 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ed4421e7-626a-4f4d-aaa5-90b7c5f1f43c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:41.019240 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ed4421e7-626a-4f4d-aaa5-90b7c5f1f43c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:41.020422 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ed4421e7-626a-4f4d-aaa5-90b7c5f1f43c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.183736 Apr 05 12:11:41.020996 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1414/2809] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:40 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:41.360508 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e6184f30-08be-48b3-8d14-8e533e5d9a01 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:41.361121 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e6184f30-08be-48b3-8d14-8e533e5d9a01 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:41.364599 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3508109b-f9be-47a9-9420-ffd20a283fc3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:41.365542 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3508109b-f9be-47a9-9420-ffd20a283fc3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:41.369305 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6184f30-08be-48b3-8d14-8e533e5d9a01 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:41.369871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6184f30-08be-48b3-8d14-8e533e5d9a01 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:41.370809 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6184f30-08be-48b3-8d14-8e533e5d9a01 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:41.371333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6184f30-08be-48b3-8d14-8e533e5d9a01 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:41.373547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3508109b-f9be-47a9-9420-ffd20a283fc3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:41.374104 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3508109b-f9be-47a9-9420-ffd20a283fc3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:41.375097 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3508109b-f9be-47a9-9420-ffd20a283fc3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:41.375525 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3508109b-f9be-47a9-9420-ffd20a283fc3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:41.506296 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e6184f30-08be-48b3-8d14-8e533e5d9a01 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:41.510942 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3508109b-f9be-47a9-9420-ffd20a283fc3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:41.514261 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e6184f30-08be-48b3-8d14-8e533e5d9a01 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.159929 Apr 05 12:11:41.514831 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1396/2810] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:41 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:41.518755 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3508109b-f9be-47a9-9420-ffd20a283fc3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.158924 Apr 05 12:11:41.519318 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1415/2811] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:41 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:41.750387 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-239111b9-39dc-4957-87c6-eabf85d41647 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:41.751199 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-239111b9-39dc-4957-87c6-eabf85d41647 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:41.759940 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-239111b9-39dc-4957-87c6-eabf85d41647 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:41.760587 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-239111b9-39dc-4957-87c6-eabf85d41647 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:41.761607 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-239111b9-39dc-4957-87c6-eabf85d41647 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:41.762181 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-239111b9-39dc-4957-87c6-eabf85d41647 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:41.902598 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-239111b9-39dc-4957-87c6-eabf85d41647 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:41.913474 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-239111b9-39dc-4957-87c6-eabf85d41647 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.169635 Apr 05 12:11:41.914171 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1397/2812] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:41 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:42.042923 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-975e3763-2b5e-4932-9f09-832dace34618 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:42.043873 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-975e3763-2b5e-4932-9f09-832dace34618 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:42.051262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-975e3763-2b5e-4932-9f09-832dace34618 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:42.051738 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-975e3763-2b5e-4932-9f09-832dace34618 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:42.052527 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-975e3763-2b5e-4932-9f09-832dace34618 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:42.052955 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-975e3763-2b5e-4932-9f09-832dace34618 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:42.204676 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-975e3763-2b5e-4932-9f09-832dace34618 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:42.218615 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-975e3763-2b5e-4932-9f09-832dace34618 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:42.220106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-975e3763-2b5e-4932-9f09-832dace34618 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:42.221290 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-975e3763-2b5e-4932-9f09-832dace34618 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.185041 Apr 05 12:11:42.221850 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1416/2813] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:42 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:42.535767 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a6f54e20-d4f5-4224-95d8-c607a1ce1201 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:42.536934 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a6f54e20-d4f5-4224-95d8-c607a1ce1201 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:42.539865 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-872fa62e-07a7-44ab-a0c2-e98a8f4a024d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:42.540941 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-872fa62e-07a7-44ab-a0c2-e98a8f4a024d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:42.547310 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a6f54e20-d4f5-4224-95d8-c607a1ce1201 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:42.547759 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a6f54e20-d4f5-4224-95d8-c607a1ce1201 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:42.548543 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a6f54e20-d4f5-4224-95d8-c607a1ce1201 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:42.549004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a6f54e20-d4f5-4224-95d8-c607a1ce1201 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:42.549642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-872fa62e-07a7-44ab-a0c2-e98a8f4a024d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:42.550089 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-872fa62e-07a7-44ab-a0c2-e98a8f4a024d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:42.550836 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-872fa62e-07a7-44ab-a0c2-e98a8f4a024d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:42.551263 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-872fa62e-07a7-44ab-a0c2-e98a8f4a024d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:42.683895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-872fa62e-07a7-44ab-a0c2-e98a8f4a024d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:42.684121 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a6f54e20-d4f5-4224-95d8-c607a1ce1201 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:42.691958 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a6f54e20-d4f5-4224-95d8-c607a1ce1201 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.162963 Apr 05 12:11:42.692300 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-872fa62e-07a7-44ab-a0c2-e98a8f4a024d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.158845 Apr 05 12:11:42.692636 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1398/2814] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:42 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:42.693191 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1417/2815] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:42 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:42.937040 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b1a37e4b-dbe3-4143-bf60-9f32d0561d18 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:42.937715 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b1a37e4b-dbe3-4143-bf60-9f32d0561d18 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:42.944500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b1a37e4b-dbe3-4143-bf60-9f32d0561d18 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:42.944966 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b1a37e4b-dbe3-4143-bf60-9f32d0561d18 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:42.945760 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b1a37e4b-dbe3-4143-bf60-9f32d0561d18 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:42.946225 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b1a37e4b-dbe3-4143-bf60-9f32d0561d18 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:43.080691 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b1a37e4b-dbe3-4143-bf60-9f32d0561d18 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:43.089380 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b1a37e4b-dbe3-4143-bf60-9f32d0561d18 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.158937 Apr 05 12:11:43.089986 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1399/2816] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:42 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:43.243281 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6f152e21-eb64-46a1-9884-d1b3186c23df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:43.244363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6f152e21-eb64-46a1-9884-d1b3186c23df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:43.252822 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f152e21-eb64-46a1-9884-d1b3186c23df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:43.253270 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f152e21-eb64-46a1-9884-d1b3186c23df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:43.254369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f152e21-eb64-46a1-9884-d1b3186c23df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:43.254806 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f152e21-eb64-46a1-9884-d1b3186c23df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:43.390102 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6f152e21-eb64-46a1-9884-d1b3186c23df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:43.398522 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6f152e21-eb64-46a1-9884-d1b3186c23df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:43.400031 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6f152e21-eb64-46a1-9884-d1b3186c23df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:43.401229 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6f152e21-eb64-46a1-9884-d1b3186c23df tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.164773 Apr 05 12:11:43.401797 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1418/2817] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:43 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:43.713267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c3df508e-b4d7-4052-9163-a5c756933872 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:43.714138 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-aba8e013-e448-4fc7-8c4d-420873fd3448 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:43.714750 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c3df508e-b4d7-4052-9163-a5c756933872 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:43.714921 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-aba8e013-e448-4fc7-8c4d-420873fd3448 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:43.722224 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aba8e013-e448-4fc7-8c4d-420873fd3448 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:43.722371 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3df508e-b4d7-4052-9163-a5c756933872 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:43.722650 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aba8e013-e448-4fc7-8c4d-420873fd3448 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:43.722810 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3df508e-b4d7-4052-9163-a5c756933872 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:43.723410 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aba8e013-e448-4fc7-8c4d-420873fd3448 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:43.723573 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3df508e-b4d7-4052-9163-a5c756933872 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:43.723835 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3df508e-b4d7-4052-9163-a5c756933872 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:43.723982 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aba8e013-e448-4fc7-8c4d-420873fd3448 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:43.857637 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-aba8e013-e448-4fc7-8c4d-420873fd3448 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:43.861323 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c3df508e-b4d7-4052-9163-a5c756933872 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:43.865795 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-aba8e013-e448-4fc7-8c4d-420873fd3448 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.158905 Apr 05 12:11:43.866372 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1419/2818] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:43 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:11:43.870806 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c3df508e-b4d7-4052-9163-a5c756933872 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.163959 Apr 05 12:11:43.871367 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1400/2819] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:43 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:44.109995 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-017b9e53-380f-4cf4-9d6e-6d0270a2c44b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:44.110609 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-017b9e53-380f-4cf4-9d6e-6d0270a2c44b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:44.116924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-017b9e53-380f-4cf4-9d6e-6d0270a2c44b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:44.117349 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-017b9e53-380f-4cf4-9d6e-6d0270a2c44b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:44.118105 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-017b9e53-380f-4cf4-9d6e-6d0270a2c44b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:44.118537 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-017b9e53-380f-4cf4-9d6e-6d0270a2c44b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:44.252944 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-017b9e53-380f-4cf4-9d6e-6d0270a2c44b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:44.261173 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-017b9e53-380f-4cf4-9d6e-6d0270a2c44b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.156967 Apr 05 12:11:44.261749 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1420/2820] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:44 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:44.423066 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-13194664-b0e5-4a71-ac50-c040f0c6a637 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:44.423933 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-13194664-b0e5-4a71-ac50-c040f0c6a637 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:44.434366 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13194664-b0e5-4a71-ac50-c040f0c6a637 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:44.435226 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13194664-b0e5-4a71-ac50-c040f0c6a637 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:44.436558 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13194664-b0e5-4a71-ac50-c040f0c6a637 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:44.437850 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13194664-b0e5-4a71-ac50-c040f0c6a637 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:44.578029 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-13194664-b0e5-4a71-ac50-c040f0c6a637 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:44.586573 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-13194664-b0e5-4a71-ac50-c040f0c6a637 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:44.588109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-13194664-b0e5-4a71-ac50-c040f0c6a637 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:44.589314 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-13194664-b0e5-4a71-ac50-c040f0c6a637 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.173019 Apr 05 12:11:44.589831 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1401/2821] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:44 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:44.887555 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-95ce92f3-5f2f-4882-b5bc-162e8b73e2a6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:44.888603 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-95ce92f3-5f2f-4882-b5bc-162e8b73e2a6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:44.891054 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-062192b6-ff29-4d68-b789-215f21e4d18c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:44.891808 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-062192b6-ff29-4d68-b789-215f21e4d18c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:44.895958 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95ce92f3-5f2f-4882-b5bc-162e8b73e2a6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:44.896439 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95ce92f3-5f2f-4882-b5bc-162e8b73e2a6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:44.897218 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95ce92f3-5f2f-4882-b5bc-162e8b73e2a6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:44.897647 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95ce92f3-5f2f-4882-b5bc-162e8b73e2a6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:44.898672 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-062192b6-ff29-4d68-b789-215f21e4d18c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:44.899146 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-062192b6-ff29-4d68-b789-215f21e4d18c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:44.899914 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-062192b6-ff29-4d68-b789-215f21e4d18c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:44.900411 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-062192b6-ff29-4d68-b789-215f21e4d18c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:45.031625 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-95ce92f3-5f2f-4882-b5bc-162e8b73e2a6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:45.032926 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-062192b6-ff29-4d68-b789-215f21e4d18c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:45.040092 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-95ce92f3-5f2f-4882-b5bc-162e8b73e2a6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.159205 Apr 05 12:11:45.040699 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-062192b6-ff29-4d68-b789-215f21e4d18c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.155713 Apr 05 12:11:45.040877 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1421/2822] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:44 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:45.041255 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1402/2823] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:44 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:45.285431 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a81345b8-0d1b-46a6-9edb-0fee0881d91b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:45.286417 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a81345b8-0d1b-46a6-9edb-0fee0881d91b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:45.296540 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a81345b8-0d1b-46a6-9edb-0fee0881d91b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:45.297287 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a81345b8-0d1b-46a6-9edb-0fee0881d91b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:45.298530 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a81345b8-0d1b-46a6-9edb-0fee0881d91b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:45.299242 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a81345b8-0d1b-46a6-9edb-0fee0881d91b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:45.443466 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a81345b8-0d1b-46a6-9edb-0fee0881d91b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:45.452305 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a81345b8-0d1b-46a6-9edb-0fee0881d91b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.173297 Apr 05 12:11:45.452868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1422/2824] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:45 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:45.612491 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0223673e-b334-4c0c-b821-983a1948664f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:45.613459 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0223673e-b334-4c0c-b821-983a1948664f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:45.623624 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0223673e-b334-4c0c-b821-983a1948664f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:45.624446 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0223673e-b334-4c0c-b821-983a1948664f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:45.625706 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0223673e-b334-4c0c-b821-983a1948664f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:45.626437 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0223673e-b334-4c0c-b821-983a1948664f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:45.767761 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0223673e-b334-4c0c-b821-983a1948664f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:45.776015 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0223673e-b334-4c0c-b821-983a1948664f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:45.777530 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0223673e-b334-4c0c-b821-983a1948664f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:45.778710 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0223673e-b334-4c0c-b821-983a1948664f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.173070 Apr 05 12:11:45.779260 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1403/2825] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:45 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:46.060689 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b533d5cc-c898-4ae7-92a3-0431deb40159 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:46.061626 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7de094b7-4be5-4d23-8b87-ebd22722db0f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:46.062346 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b533d5cc-c898-4ae7-92a3-0431deb40159 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:46.062518 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7de094b7-4be5-4d23-8b87-ebd22722db0f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:46.068985 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7de094b7-4be5-4d23-8b87-ebd22722db0f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:46.069160 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b533d5cc-c898-4ae7-92a3-0431deb40159 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:46.069440 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7de094b7-4be5-4d23-8b87-ebd22722db0f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:46.069589 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b533d5cc-c898-4ae7-92a3-0431deb40159 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:46.070212 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7de094b7-4be5-4d23-8b87-ebd22722db0f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:46.070362 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b533d5cc-c898-4ae7-92a3-0431deb40159 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:46.070651 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7de094b7-4be5-4d23-8b87-ebd22722db0f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:46.070813 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b533d5cc-c898-4ae7-92a3-0431deb40159 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:46.204563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7de094b7-4be5-4d23-8b87-ebd22722db0f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:46.212474 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7de094b7-4be5-4d23-8b87-ebd22722db0f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.158083 Apr 05 12:11:46.212648 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b533d5cc-c898-4ae7-92a3-0431deb40159 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:46.213058 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1404/2826] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:46 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:46.220340 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b533d5cc-c898-4ae7-92a3-0431deb40159 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.166220 Apr 05 12:11:46.220897 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1423/2827] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:46 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:46.470006 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b6616755-31a5-4006-a017-9c92275a0492 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:46.470659 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b6616755-31a5-4006-a017-9c92275a0492 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:46.477431 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b6616755-31a5-4006-a017-9c92275a0492 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:46.477914 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b6616755-31a5-4006-a017-9c92275a0492 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:46.478714 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b6616755-31a5-4006-a017-9c92275a0492 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:46.479178 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b6616755-31a5-4006-a017-9c92275a0492 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:46.619114 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b6616755-31a5-4006-a017-9c92275a0492 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:46.629338 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b6616755-31a5-4006-a017-9c92275a0492 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.163151 Apr 05 12:11:46.629888 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1405/2828] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:46 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:46.801357 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9dc78b30-e8c5-4cd1-bd2e-e537732294b0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:46.802331 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9dc78b30-e8c5-4cd1-bd2e-e537732294b0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:46.812471 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9dc78b30-e8c5-4cd1-bd2e-e537732294b0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:46.812912 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9dc78b30-e8c5-4cd1-bd2e-e537732294b0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:46.813657 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9dc78b30-e8c5-4cd1-bd2e-e537732294b0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:46.814085 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9dc78b30-e8c5-4cd1-bd2e-e537732294b0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:46.946274 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9dc78b30-e8c5-4cd1-bd2e-e537732294b0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:46.955159 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9dc78b30-e8c5-4cd1-bd2e-e537732294b0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:46.956663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9dc78b30-e8c5-4cd1-bd2e-e537732294b0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:46.957808 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9dc78b30-e8c5-4cd1-bd2e-e537732294b0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.163099 Apr 05 12:11:46.958364 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1424/2829] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:46 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:47.230715 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2a86919d-8ead-4d89-b5bb-a71034f66244 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:47.231301 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2a86919d-8ead-4d89-b5bb-a71034f66244 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:47.237479 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b4ef3186-98af-42df-90cd-24e73de48915 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:47.238092 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b4ef3186-98af-42df-90cd-24e73de48915 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:47.238539 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2a86919d-8ead-4d89-b5bb-a71034f66244 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:47.239009 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2a86919d-8ead-4d89-b5bb-a71034f66244 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:47.239789 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2a86919d-8ead-4d89-b5bb-a71034f66244 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:47.240262 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2a86919d-8ead-4d89-b5bb-a71034f66244 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:47.244587 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b4ef3186-98af-42df-90cd-24e73de48915 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:47.245030 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b4ef3186-98af-42df-90cd-24e73de48915 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:47.245780 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b4ef3186-98af-42df-90cd-24e73de48915 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:47.246207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b4ef3186-98af-42df-90cd-24e73de48915 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:47.375369 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2a86919d-8ead-4d89-b5bb-a71034f66244 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:47.380761 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b4ef3186-98af-42df-90cd-24e73de48915 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:47.384039 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2a86919d-8ead-4d89-b5bb-a71034f66244 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.157316 Apr 05 12:11:47.384648 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1406/2830] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:47 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:47.388942 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b4ef3186-98af-42df-90cd-24e73de48915 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.155254 Apr 05 12:11:47.389587 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1425/2831] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:47 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:47.651190 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6f8c67eb-00ca-46f7-9053-632992d96aa7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:47.652032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6f8c67eb-00ca-46f7-9053-632992d96aa7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:47.659919 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6f8c67eb-00ca-46f7-9053-632992d96aa7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:47.660404 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6f8c67eb-00ca-46f7-9053-632992d96aa7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:47.661167 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6f8c67eb-00ca-46f7-9053-632992d96aa7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:47.661601 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6f8c67eb-00ca-46f7-9053-632992d96aa7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:47.814833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6f8c67eb-00ca-46f7-9053-632992d96aa7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:47.826801 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6f8c67eb-00ca-46f7-9053-632992d96aa7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.182247 Apr 05 12:11:47.827584 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1407/2832] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:47 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:47.977381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3b8ceff3-dac3-4caf-8eb5-1ff1fbbcb2f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:47.978112 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3b8ceff3-dac3-4caf-8eb5-1ff1fbbcb2f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:47.985236 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b8ceff3-dac3-4caf-8eb5-1ff1fbbcb2f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:47.985680 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b8ceff3-dac3-4caf-8eb5-1ff1fbbcb2f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:47.986425 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b8ceff3-dac3-4caf-8eb5-1ff1fbbcb2f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:47.986848 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3b8ceff3-dac3-4caf-8eb5-1ff1fbbcb2f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:48.125691 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3b8ceff3-dac3-4caf-8eb5-1ff1fbbcb2f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:48.134497 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3b8ceff3-dac3-4caf-8eb5-1ff1fbbcb2f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:48.135987 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3b8ceff3-dac3-4caf-8eb5-1ff1fbbcb2f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:48.137164 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3b8ceff3-dac3-4caf-8eb5-1ff1fbbcb2f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.164464 Apr 05 12:11:48.137762 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1426/2833] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:47 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:48.405303 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fd84ffff-4dfd-4cff-b841-bfa4430468fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:48.406224 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fd84ffff-4dfd-4cff-b841-bfa4430468fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:48.410509 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1b0310fe-4554-4b1b-ae01-2752c4aeaae5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:48.411114 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1b0310fe-4554-4b1b-ae01-2752c4aeaae5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:48.413111 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd84ffff-4dfd-4cff-b841-bfa4430468fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:48.413561 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd84ffff-4dfd-4cff-b841-bfa4430468fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:48.414332 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd84ffff-4dfd-4cff-b841-bfa4430468fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:48.414761 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd84ffff-4dfd-4cff-b841-bfa4430468fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:48.417594 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1b0310fe-4554-4b1b-ae01-2752c4aeaae5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:48.418052 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1b0310fe-4554-4b1b-ae01-2752c4aeaae5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:48.418803 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1b0310fe-4554-4b1b-ae01-2752c4aeaae5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:48.419227 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1b0310fe-4554-4b1b-ae01-2752c4aeaae5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:48.549843 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fd84ffff-4dfd-4cff-b841-bfa4430468fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:48.554718 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1b0310fe-4554-4b1b-ae01-2752c4aeaae5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:48.558286 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fd84ffff-4dfd-4cff-b841-bfa4430468fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.159448 Apr 05 12:11:48.558869 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1408/2834] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:48 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:48.562809 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1b0310fe-4554-4b1b-ae01-2752c4aeaae5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.156171 Apr 05 12:11:48.563401 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1427/2835] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:48 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:48.848436 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-457bf397-0a4a-4392-85bc-db39816dc3b3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:48.849308 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-457bf397-0a4a-4392-85bc-db39816dc3b3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:48.859442 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-457bf397-0a4a-4392-85bc-db39816dc3b3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:48.859890 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-457bf397-0a4a-4392-85bc-db39816dc3b3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:48.860719 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-457bf397-0a4a-4392-85bc-db39816dc3b3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:48.861153 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-457bf397-0a4a-4392-85bc-db39816dc3b3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:49.000007 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-457bf397-0a4a-4392-85bc-db39816dc3b3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:49.008299 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-457bf397-0a4a-4392-85bc-db39816dc3b3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.166314 Apr 05 12:11:49.008858 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1409/2836] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:48 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:49.157624 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fa1de909-eeeb-433a-9851-2f857ebfa419 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:49.158457 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fa1de909-eeeb-433a-9851-2f857ebfa419 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:49.166727 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fa1de909-eeeb-433a-9851-2f857ebfa419 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:49.167326 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fa1de909-eeeb-433a-9851-2f857ebfa419 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:49.168388 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fa1de909-eeeb-433a-9851-2f857ebfa419 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:49.168964 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fa1de909-eeeb-433a-9851-2f857ebfa419 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:49.307956 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fa1de909-eeeb-433a-9851-2f857ebfa419 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:49.316837 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fa1de909-eeeb-433a-9851-2f857ebfa419 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:49.318328 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fa1de909-eeeb-433a-9851-2f857ebfa419 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:49.319519 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fa1de909-eeeb-433a-9851-2f857ebfa419 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.167320 Apr 05 12:11:49.320154 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1428/2837] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:49 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:49.579564 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-29fd423d-d7d1-4b0b-be07-444bdde6f707 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:49.580317 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-29fd423d-d7d1-4b0b-be07-444bdde6f707 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:49.582034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-33c5592a-4e14-4f71-80c0-322c9d6f3b26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:49.582669 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-33c5592a-4e14-4f71-80c0-322c9d6f3b26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:49.587415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-29fd423d-d7d1-4b0b-be07-444bdde6f707 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:49.587887 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-29fd423d-d7d1-4b0b-be07-444bdde6f707 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:49.588677 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-29fd423d-d7d1-4b0b-be07-444bdde6f707 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:49.589112 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-29fd423d-d7d1-4b0b-be07-444bdde6f707 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:49.589402 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-33c5592a-4e14-4f71-80c0-322c9d6f3b26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:49.589846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-33c5592a-4e14-4f71-80c0-322c9d6f3b26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:49.590594 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-33c5592a-4e14-4f71-80c0-322c9d6f3b26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:49.591020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-33c5592a-4e14-4f71-80c0-322c9d6f3b26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:49.725212 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-33c5592a-4e14-4f71-80c0-322c9d6f3b26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:49.726776 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-29fd423d-d7d1-4b0b-be07-444bdde6f707 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:49.733218 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-33c5592a-4e14-4f71-80c0-322c9d6f3b26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.155580 Apr 05 12:11:49.733849 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1429/2838] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:49 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:49.734753 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-29fd423d-d7d1-4b0b-be07-444bdde6f707 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.161918 Apr 05 12:11:49.735300 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1410/2839] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:49 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:50.029890 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3e9ad705-f7ed-4dd3-a8c2-d4e942db12f7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:50.030912 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3e9ad705-f7ed-4dd3-a8c2-d4e942db12f7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:50.041316 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3e9ad705-f7ed-4dd3-a8c2-d4e942db12f7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:50.042115 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3e9ad705-f7ed-4dd3-a8c2-d4e942db12f7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:50.043368 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3e9ad705-f7ed-4dd3-a8c2-d4e942db12f7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:50.044124 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3e9ad705-f7ed-4dd3-a8c2-d4e942db12f7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:50.200003 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3e9ad705-f7ed-4dd3-a8c2-d4e942db12f7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:50.208496 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3e9ad705-f7ed-4dd3-a8c2-d4e942db12f7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.185164 Apr 05 12:11:50.209066 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1430/2840] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:50 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:50.342540 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a0341a34-5ae0-4e06-acc4-3659e7265054 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:50.343466 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a0341a34-5ae0-4e06-acc4-3659e7265054 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:50.353660 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a0341a34-5ae0-4e06-acc4-3659e7265054 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:50.354440 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a0341a34-5ae0-4e06-acc4-3659e7265054 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:50.355669 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a0341a34-5ae0-4e06-acc4-3659e7265054 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:50.356435 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a0341a34-5ae0-4e06-acc4-3659e7265054 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:50.497318 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a0341a34-5ae0-4e06-acc4-3659e7265054 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:50.506482 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a0341a34-5ae0-4e06-acc4-3659e7265054 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:50.507989 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a0341a34-5ae0-4e06-acc4-3659e7265054 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:50.509178 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a0341a34-5ae0-4e06-acc4-3659e7265054 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.173751 Apr 05 12:11:50.509770 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1411/2841] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:50 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:50.753042 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-35e565e8-5ebb-4152-8005-28ed2c54809d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:50.753656 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-35e565e8-5ebb-4152-8005-28ed2c54809d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:50.758611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3cf5fe05-b37a-4b13-83ed-b3a71fcff209 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:50.759204 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3cf5fe05-b37a-4b13-83ed-b3a71fcff209 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:50.761458 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-35e565e8-5ebb-4152-8005-28ed2c54809d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:50.761944 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-35e565e8-5ebb-4152-8005-28ed2c54809d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:50.762928 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-35e565e8-5ebb-4152-8005-28ed2c54809d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:50.763228 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-35e565e8-5ebb-4152-8005-28ed2c54809d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:50.765797 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3cf5fe05-b37a-4b13-83ed-b3a71fcff209 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:50.766244 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3cf5fe05-b37a-4b13-83ed-b3a71fcff209 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:50.767049 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3cf5fe05-b37a-4b13-83ed-b3a71fcff209 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:50.767457 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3cf5fe05-b37a-4b13-83ed-b3a71fcff209 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:50.899207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-35e565e8-5ebb-4152-8005-28ed2c54809d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:50.903320 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3cf5fe05-b37a-4b13-83ed-b3a71fcff209 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:50.907518 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-35e565e8-5ebb-4152-8005-28ed2c54809d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.159341 Apr 05 12:11:50.908134 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1431/2842] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:50 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:50.911155 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3cf5fe05-b37a-4b13-83ed-b3a71fcff209 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.156553 Apr 05 12:11:50.911716 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1412/2843] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:50 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:51.229868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9fa6273e-861a-41cf-a452-f2f1121296d4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:51.230866 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9fa6273e-861a-41cf-a452-f2f1121296d4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:51.240939 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fa6273e-861a-41cf-a452-f2f1121296d4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:51.241692 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fa6273e-861a-41cf-a452-f2f1121296d4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:51.242898 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fa6273e-861a-41cf-a452-f2f1121296d4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:51.243644 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fa6273e-861a-41cf-a452-f2f1121296d4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:51.391551 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9fa6273e-861a-41cf-a452-f2f1121296d4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:51.399871 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9fa6273e-861a-41cf-a452-f2f1121296d4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.176436 Apr 05 12:11:51.400490 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1432/2844] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:51 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:51.529896 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ca21c50a-6aea-44c4-a369-98552514f882 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:51.530648 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ca21c50a-6aea-44c4-a369-98552514f882 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:51.538650 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ca21c50a-6aea-44c4-a369-98552514f882 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:51.539210 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ca21c50a-6aea-44c4-a369-98552514f882 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:51.540193 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ca21c50a-6aea-44c4-a369-98552514f882 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:51.540720 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ca21c50a-6aea-44c4-a369-98552514f882 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:51.701373 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ca21c50a-6aea-44c4-a369-98552514f882 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:51.709971 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ca21c50a-6aea-44c4-a369-98552514f882 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:51.711467 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ca21c50a-6aea-44c4-a369-98552514f882 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:51.712678 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ca21c50a-6aea-44c4-a369-98552514f882 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.187752 Apr 05 12:11:51.713235 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1413/2845] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:51 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:51.929122 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-662020c3-630e-4ddd-bcf3-fb30652293a9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:51.930121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-662020c3-630e-4ddd-bcf3-fb30652293a9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:51.932384 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2e4de998-3e96-432d-a370-781c38b52155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:51.933639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2e4de998-3e96-432d-a370-781c38b52155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:51.939714 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-662020c3-630e-4ddd-bcf3-fb30652293a9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:51.940189 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-662020c3-630e-4ddd-bcf3-fb30652293a9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:51.940950 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-662020c3-630e-4ddd-bcf3-fb30652293a9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:51.941376 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-662020c3-630e-4ddd-bcf3-fb30652293a9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:51.942971 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2e4de998-3e96-432d-a370-781c38b52155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:51.943448 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2e4de998-3e96-432d-a370-781c38b52155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:51.944242 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2e4de998-3e96-432d-a370-781c38b52155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:51.944672 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2e4de998-3e96-432d-a370-781c38b52155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:52.073693 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-662020c3-630e-4ddd-bcf3-fb30652293a9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:52.076361 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2e4de998-3e96-432d-a370-781c38b52155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:52.081954 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-662020c3-630e-4ddd-bcf3-fb30652293a9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.159580 Apr 05 12:11:52.082527 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1433/2846] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:51 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:52.084100 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2e4de998-3e96-432d-a370-781c38b52155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.158193 Apr 05 12:11:52.084697 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1414/2847] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:51 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:52.423094 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1fc64f75-ea88-47fc-baba-f52462e6cf5d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:52.423743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1fc64f75-ea88-47fc-baba-f52462e6cf5d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:52.431442 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1fc64f75-ea88-47fc-baba-f52462e6cf5d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:52.431993 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1fc64f75-ea88-47fc-baba-f52462e6cf5d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:52.432960 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1fc64f75-ea88-47fc-baba-f52462e6cf5d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:52.433495 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1fc64f75-ea88-47fc-baba-f52462e6cf5d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:52.572863 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1fc64f75-ea88-47fc-baba-f52462e6cf5d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:52.581098 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1fc64f75-ea88-47fc-baba-f52462e6cf5d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.164349 Apr 05 12:11:52.581665 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1434/2848] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:52 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:52.734861 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f044a440-286b-48e1-bbd8-f1a19416da88 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:52.735914 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f044a440-286b-48e1-bbd8-f1a19416da88 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:52.746140 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f044a440-286b-48e1-bbd8-f1a19416da88 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:52.746892 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f044a440-286b-48e1-bbd8-f1a19416da88 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:52.748167 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f044a440-286b-48e1-bbd8-f1a19416da88 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:52.748951 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f044a440-286b-48e1-bbd8-f1a19416da88 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:52.897157 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f044a440-286b-48e1-bbd8-f1a19416da88 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:52.905952 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f044a440-286b-48e1-bbd8-f1a19416da88 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:52.907619 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f044a440-286b-48e1-bbd8-f1a19416da88 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:52.908828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f044a440-286b-48e1-bbd8-f1a19416da88 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.180585 Apr 05 12:11:52.909400 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1415/2849] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:52 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:53.102925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c7a0a45e-2790-458a-a11b-156574caf72e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:53.103904 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-625f2c44-030f-4b89-8dd7-839ecea0baa7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:53.104722 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c7a0a45e-2790-458a-a11b-156574caf72e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:53.104946 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-625f2c44-030f-4b89-8dd7-839ecea0baa7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:53.113063 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c7a0a45e-2790-458a-a11b-156574caf72e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:53.113303 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-625f2c44-030f-4b89-8dd7-839ecea0baa7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:53.113492 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c7a0a45e-2790-458a-a11b-156574caf72e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:53.113754 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-625f2c44-030f-4b89-8dd7-839ecea0baa7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:53.114252 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c7a0a45e-2790-458a-a11b-156574caf72e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:53.114507 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-625f2c44-030f-4b89-8dd7-839ecea0baa7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:53.114678 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c7a0a45e-2790-458a-a11b-156574caf72e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:53.114945 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-625f2c44-030f-4b89-8dd7-839ecea0baa7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:53.247753 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c7a0a45e-2790-458a-a11b-156574caf72e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:53.251280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-625f2c44-030f-4b89-8dd7-839ecea0baa7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:53.256600 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c7a0a45e-2790-458a-a11b-156574caf72e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.160224 Apr 05 12:11:53.257396 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1435/2850] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:53 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:53.259868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-625f2c44-030f-4b89-8dd7-839ecea0baa7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.162325 Apr 05 12:11:53.260529 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1416/2851] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:53 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:53.599119 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-092ba372-2854-4c2e-9117-11d4ea509c42 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:53.599719 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-092ba372-2854-4c2e-9117-11d4ea509c42 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:53.606329 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-092ba372-2854-4c2e-9117-11d4ea509c42 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:53.606793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-092ba372-2854-4c2e-9117-11d4ea509c42 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:53.607512 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-092ba372-2854-4c2e-9117-11d4ea509c42 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:53.607936 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-092ba372-2854-4c2e-9117-11d4ea509c42 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:53.748097 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-092ba372-2854-4c2e-9117-11d4ea509c42 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:53.757050 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-092ba372-2854-4c2e-9117-11d4ea509c42 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.161988 Apr 05 12:11:53.757600 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1436/2852] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:53 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:53.928118 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ee790572-41e1-49bc-bea2-8dc16416f049 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:53.928744 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ee790572-41e1-49bc-bea2-8dc16416f049 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:53.935298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee790572-41e1-49bc-bea2-8dc16416f049 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:53.935746 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee790572-41e1-49bc-bea2-8dc16416f049 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:53.936563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee790572-41e1-49bc-bea2-8dc16416f049 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:53.936998 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ee790572-41e1-49bc-bea2-8dc16416f049 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:54.072986 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ee790572-41e1-49bc-bea2-8dc16416f049 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:54.082173 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ee790572-41e1-49bc-bea2-8dc16416f049 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:54.083666 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ee790572-41e1-49bc-bea2-8dc16416f049 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:54.084887 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ee790572-41e1-49bc-bea2-8dc16416f049 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.160978 Apr 05 12:11:54.085457 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1417/2853] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:53 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:54.275364 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e4de830a-3988-4def-8476-b233147a1182 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:54.276022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e4de830a-3988-4def-8476-b233147a1182 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:54.279044 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c0203d86-e6a6-475f-b038-ff9107f9c6ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:54.279912 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c0203d86-e6a6-475f-b038-ff9107f9c6ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:54.283995 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e4de830a-3988-4def-8476-b233147a1182 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:54.284475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e4de830a-3988-4def-8476-b233147a1182 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:54.285233 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e4de830a-3988-4def-8476-b233147a1182 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:54.285667 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e4de830a-3988-4def-8476-b233147a1182 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:54.286706 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0203d86-e6a6-475f-b038-ff9107f9c6ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:54.287153 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0203d86-e6a6-475f-b038-ff9107f9c6ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:54.287876 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0203d86-e6a6-475f-b038-ff9107f9c6ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:54.288399 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c0203d86-e6a6-475f-b038-ff9107f9c6ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:54.423901 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c0203d86-e6a6-475f-b038-ff9107f9c6ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:54.424933 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e4de830a-3988-4def-8476-b233147a1182 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:54.432025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c0203d86-e6a6-475f-b038-ff9107f9c6ff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.157918 Apr 05 12:11:54.432625 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1418/2854] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:54 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:54.433310 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e4de830a-3988-4def-8476-b233147a1182 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.162958 Apr 05 12:11:54.433947 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1437/2855] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:54 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:54.778706 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ae0f3129-cc40-47b6-90a8-bfcd34ca5c3e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:54.779986 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ae0f3129-cc40-47b6-90a8-bfcd34ca5c3e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:54.792210 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae0f3129-cc40-47b6-90a8-bfcd34ca5c3e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:54.793006 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae0f3129-cc40-47b6-90a8-bfcd34ca5c3e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:54.794699 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae0f3129-cc40-47b6-90a8-bfcd34ca5c3e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:54.795453 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae0f3129-cc40-47b6-90a8-bfcd34ca5c3e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:54.941835 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ae0f3129-cc40-47b6-90a8-bfcd34ca5c3e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:54.950226 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ae0f3129-cc40-47b6-90a8-bfcd34ca5c3e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.178018 Apr 05 12:11:54.950793 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1419/2856] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:54 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:55.107022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8860752c-8854-42e6-a4d1-89ad96b5b471 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:55.108022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8860752c-8854-42e6-a4d1-89ad96b5b471 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:55.118656 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8860752c-8854-42e6-a4d1-89ad96b5b471 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:55.119397 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8860752c-8854-42e6-a4d1-89ad96b5b471 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:55.120680 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8860752c-8854-42e6-a4d1-89ad96b5b471 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:55.121387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8860752c-8854-42e6-a4d1-89ad96b5b471 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:55.259992 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8860752c-8854-42e6-a4d1-89ad96b5b471 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:55.270883 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8860752c-8854-42e6-a4d1-89ad96b5b471 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:55.272404 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8860752c-8854-42e6-a4d1-89ad96b5b471 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:55.273546 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8860752c-8854-42e6-a4d1-89ad96b5b471 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.173308 Apr 05 12:11:55.274108 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1438/2857] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:55 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:55.453596 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6a6288c8-0fde-4589-8fad-73d6bd1c9968 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:55.454239 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ee82634d-f2c1-4974-97d9-45264d7b319d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:55.454610 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6a6288c8-0fde-4589-8fad-73d6bd1c9968 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:55.454730 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ee82634d-f2c1-4974-97d9-45264d7b319d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:55.461029 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6a6288c8-0fde-4589-8fad-73d6bd1c9968 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:55.461194 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ee82634d-f2c1-4974-97d9-45264d7b319d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:55.461422 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6a6288c8-0fde-4589-8fad-73d6bd1c9968 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:55.461582 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ee82634d-f2c1-4974-97d9-45264d7b319d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:55.462210 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ee82634d-f2c1-4974-97d9-45264d7b319d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:55.462353 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6a6288c8-0fde-4589-8fad-73d6bd1c9968 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:55.462641 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ee82634d-f2c1-4974-97d9-45264d7b319d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:55.462783 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6a6288c8-0fde-4589-8fad-73d6bd1c9968 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:55.595108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6a6288c8-0fde-4589-8fad-73d6bd1c9968 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:55.597838 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ee82634d-f2c1-4974-97d9-45264d7b319d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:55.603105 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6a6288c8-0fde-4589-8fad-73d6bd1c9968 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.156118 Apr 05 12:11:55.603684 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1420/2858] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:55 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:55.605481 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ee82634d-f2c1-4974-97d9-45264d7b319d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.157646 Apr 05 12:11:55.606030 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1439/2859] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:55 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:55.971156 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-463c8a22-2edf-45a4-afd6-a21cf2edf9ef tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:55.971868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-463c8a22-2edf-45a4-afd6-a21cf2edf9ef tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:55.979563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-463c8a22-2edf-45a4-afd6-a21cf2edf9ef tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:55.980111 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-463c8a22-2edf-45a4-afd6-a21cf2edf9ef tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:55.981004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-463c8a22-2edf-45a4-afd6-a21cf2edf9ef tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:55.981509 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-463c8a22-2edf-45a4-afd6-a21cf2edf9ef tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:56.118811 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-463c8a22-2edf-45a4-afd6-a21cf2edf9ef tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:56.134405 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-463c8a22-2edf-45a4-afd6-a21cf2edf9ef tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.168753 Apr 05 12:11:56.135087 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1421/2860] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:55 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:56.295779 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7356310b-0ba2-4dc5-9cc5-97436593c74a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:56.296792 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7356310b-0ba2-4dc5-9cc5-97436593c74a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:56.303569 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7356310b-0ba2-4dc5-9cc5-97436593c74a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:56.304025 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7356310b-0ba2-4dc5-9cc5-97436593c74a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:56.304816 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7356310b-0ba2-4dc5-9cc5-97436593c74a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:56.305251 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7356310b-0ba2-4dc5-9cc5-97436593c74a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:56.439642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7356310b-0ba2-4dc5-9cc5-97436593c74a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:56.448820 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7356310b-0ba2-4dc5-9cc5-97436593c74a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:56.450324 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7356310b-0ba2-4dc5-9cc5-97436593c74a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:56.451491 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7356310b-0ba2-4dc5-9cc5-97436593c74a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.162678 Apr 05 12:11:56.452054 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1440/2861] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:56 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:56.624647 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ce330ab6-f053-4e82-88c7-7380a5fc213a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:56.625658 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ce330ab6-f053-4e82-88c7-7380a5fc213a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:56.627524 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8f28b584-6d8a-4fb7-82e7-1d79b0e92bc2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:56.628297 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8f28b584-6d8a-4fb7-82e7-1d79b0e92bc2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:56.632560 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ce330ab6-f053-4e82-88c7-7380a5fc213a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:56.633010 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ce330ab6-f053-4e82-88c7-7380a5fc213a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:56.633775 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ce330ab6-f053-4e82-88c7-7380a5fc213a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:56.634209 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ce330ab6-f053-4e82-88c7-7380a5fc213a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:56.635248 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8f28b584-6d8a-4fb7-82e7-1d79b0e92bc2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:56.635708 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8f28b584-6d8a-4fb7-82e7-1d79b0e92bc2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:56.636495 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8f28b584-6d8a-4fb7-82e7-1d79b0e92bc2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:56.636938 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8f28b584-6d8a-4fb7-82e7-1d79b0e92bc2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:56.770343 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8f28b584-6d8a-4fb7-82e7-1d79b0e92bc2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:56.771592 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ce330ab6-f053-4e82-88c7-7380a5fc213a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:56.778491 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8f28b584-6d8a-4fb7-82e7-1d79b0e92bc2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.156278 Apr 05 12:11:56.779138 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ce330ab6-f053-4e82-88c7-7380a5fc213a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.161104 Apr 05 12:11:56.779278 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1441/2862] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:56 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:56.779693 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1422/2863] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:56 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:57.154080 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a162bf39-09ed-48f7-baaf-98c81fd7cf14 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:57.154798 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a162bf39-09ed-48f7-baaf-98c81fd7cf14 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:57.162288 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a162bf39-09ed-48f7-baaf-98c81fd7cf14 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:57.162823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a162bf39-09ed-48f7-baaf-98c81fd7cf14 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:57.163705 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a162bf39-09ed-48f7-baaf-98c81fd7cf14 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:57.164257 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a162bf39-09ed-48f7-baaf-98c81fd7cf14 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:57.304023 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a162bf39-09ed-48f7-baaf-98c81fd7cf14 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:57.312303 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a162bf39-09ed-48f7-baaf-98c81fd7cf14 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.162722 Apr 05 12:11:57.312878 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1442/2864] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:57 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:57.472327 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3933d20e-d496-4aa5-9807-213e7baa9fd0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:57.472934 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3933d20e-d496-4aa5-9807-213e7baa9fd0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:57.479574 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3933d20e-d496-4aa5-9807-213e7baa9fd0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:57.480022 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3933d20e-d496-4aa5-9807-213e7baa9fd0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:57.480806 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3933d20e-d496-4aa5-9807-213e7baa9fd0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:57.481235 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3933d20e-d496-4aa5-9807-213e7baa9fd0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:57.636558 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3933d20e-d496-4aa5-9807-213e7baa9fd0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:57.645343 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3933d20e-d496-4aa5-9807-213e7baa9fd0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:57.646846 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3933d20e-d496-4aa5-9807-213e7baa9fd0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:57.648021 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3933d20e-d496-4aa5-9807-213e7baa9fd0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.180596 Apr 05 12:11:57.648614 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1423/2865] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:57 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:57.796097 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d4fc812f-1d15-430f-bd44-61078e096c02 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:57.796659 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b9638905-c53b-4b41-bb28-f2f4b83d3f69 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:57.796777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b9638905-c53b-4b41-bb28-f2f4b83d3f69 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:57.796883 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d4fc812f-1d15-430f-bd44-61078e096c02 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:57.802799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b9638905-c53b-4b41-bb28-f2f4b83d3f69 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:57.803072 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d4fc812f-1d15-430f-bd44-61078e096c02 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:57.803247 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b9638905-c53b-4b41-bb28-f2f4b83d3f69 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:57.803513 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d4fc812f-1d15-430f-bd44-61078e096c02 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:57.804002 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b9638905-c53b-4b41-bb28-f2f4b83d3f69 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:57.804295 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d4fc812f-1d15-430f-bd44-61078e096c02 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:57.804462 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b9638905-c53b-4b41-bb28-f2f4b83d3f69 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:57.804729 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d4fc812f-1d15-430f-bd44-61078e096c02 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:57.938782 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d4fc812f-1d15-430f-bd44-61078e096c02 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:57.940464 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b9638905-c53b-4b41-bb28-f2f4b83d3f69 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:57.946845 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d4fc812f-1d15-430f-bd44-61078e096c02 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.154569 Apr 05 12:11:57.947430 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1443/2866] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:57 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:57.948446 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b9638905-c53b-4b41-bb28-f2f4b83d3f69 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.155964 Apr 05 12:11:57.949778 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1424/2867] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:57 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:58.333761 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-368180e3-4ab7-41ba-9ac3-36979f80e43c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:58.334776 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-368180e3-4ab7-41ba-9ac3-36979f80e43c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:58.344942 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-368180e3-4ab7-41ba-9ac3-36979f80e43c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:58.345684 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-368180e3-4ab7-41ba-9ac3-36979f80e43c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:58.347021 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-368180e3-4ab7-41ba-9ac3-36979f80e43c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:58.347703 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-368180e3-4ab7-41ba-9ac3-36979f80e43c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:58.489682 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-368180e3-4ab7-41ba-9ac3-36979f80e43c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:58.497865 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-368180e3-4ab7-41ba-9ac3-36979f80e43c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.170702 Apr 05 12:11:58.498433 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1444/2868] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:58 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:58.670444 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-791d2518-9390-4415-ab1b-63bcf6a5ebdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:58.671309 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-791d2518-9390-4415-ab1b-63bcf6a5ebdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:58.681848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-791d2518-9390-4415-ab1b-63bcf6a5ebdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:58.682590 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-791d2518-9390-4415-ab1b-63bcf6a5ebdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:58.683823 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-791d2518-9390-4415-ab1b-63bcf6a5ebdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:58.684588 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-791d2518-9390-4415-ab1b-63bcf6a5ebdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:58.832768 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-791d2518-9390-4415-ab1b-63bcf6a5ebdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:58.844473 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-791d2518-9390-4415-ab1b-63bcf6a5ebdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:58.845985 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-791d2518-9390-4415-ab1b-63bcf6a5ebdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:58.847162 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-791d2518-9390-4415-ab1b-63bcf6a5ebdc tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.183439 Apr 05 12:11:58.847717 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1425/2869] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:58 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:58.968817 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-52a5ff5c-2152-4c3b-9ff5-37423ac50296 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:58.969718 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8f59847e-d3cb-4698-81a0-e7dfcaccd841 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:58.969903 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-52a5ff5c-2152-4c3b-9ff5-37423ac50296 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:58.970330 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8f59847e-d3cb-4698-81a0-e7dfcaccd841 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:58.976502 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-52a5ff5c-2152-4c3b-9ff5-37423ac50296 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:58.976689 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f59847e-d3cb-4698-81a0-e7dfcaccd841 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:58.976956 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-52a5ff5c-2152-4c3b-9ff5-37423ac50296 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:58.977129 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f59847e-d3cb-4698-81a0-e7dfcaccd841 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:58.977763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-52a5ff5c-2152-4c3b-9ff5-37423ac50296 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:58.977915 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f59847e-d3cb-4698-81a0-e7dfcaccd841 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:58.978192 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-52a5ff5c-2152-4c3b-9ff5-37423ac50296 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:58.978361 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f59847e-d3cb-4698-81a0-e7dfcaccd841 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:59.108661 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-52a5ff5c-2152-4c3b-9ff5-37423ac50296 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:59.109594 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8f59847e-d3cb-4698-81a0-e7dfcaccd841 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:59.117404 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-52a5ff5c-2152-4c3b-9ff5-37423ac50296 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.155479 Apr 05 12:11:59.117995 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1445/2870] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:58 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:59.119132 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8f59847e-d3cb-4698-81a0-e7dfcaccd841 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.156145 Apr 05 12:11:59.119708 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1426/2871] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:58 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:59.517265 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6391d857-5e5c-40f3-9dba-70569b23430c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:59.518109 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6391d857-5e5c-40f3-9dba-70569b23430c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:59.526787 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6391d857-5e5c-40f3-9dba-70569b23430c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:59.527393 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6391d857-5e5c-40f3-9dba-70569b23430c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:59.528584 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6391d857-5e5c-40f3-9dba-70569b23430c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:59.529159 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6391d857-5e5c-40f3-9dba-70569b23430c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:59.664785 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6391d857-5e5c-40f3-9dba-70569b23430c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:11:59.672946 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6391d857-5e5c-40f3-9dba-70569b23430c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.161106 Apr 05 12:11:59.673519 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1446/2872] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:11:59 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:59.866025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d16278c3-965a-4476-8b36-270cb8c32278 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:11:59.866585 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d16278c3-965a-4476-8b36-270cb8c32278 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:11:59.873714 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d16278c3-965a-4476-8b36-270cb8c32278 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:59.874156 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d16278c3-965a-4476-8b36-270cb8c32278 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:11:59.875007 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d16278c3-965a-4476-8b36-270cb8c32278 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:11:59.875438 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d16278c3-965a-4476-8b36-270cb8c32278 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:00.018985 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d16278c3-965a-4476-8b36-270cb8c32278 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:00.032233 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d16278c3-965a-4476-8b36-270cb8c32278 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:00.034814 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d16278c3-965a-4476-8b36-270cb8c32278 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:00.036643 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d16278c3-965a-4476-8b36-270cb8c32278 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.174206 Apr 05 12:12:00.037396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1427/2873] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:11:59 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:00.139055 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1c5d6234-a152-48fd-bea5-39b045c56691 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:00.139898 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1c5d6234-a152-48fd-bea5-39b045c56691 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:00.143575 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5aedf7df-8c0e-4724-94ef-a1007bdaa925 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:00.144628 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5aedf7df-8c0e-4724-94ef-a1007bdaa925 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:00.150709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1c5d6234-a152-48fd-bea5-39b045c56691 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:00.151459 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1c5d6234-a152-48fd-bea5-39b045c56691 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:00.152800 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1c5d6234-a152-48fd-bea5-39b045c56691 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:00.153528 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1c5d6234-a152-48fd-bea5-39b045c56691 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:00.154491 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5aedf7df-8c0e-4724-94ef-a1007bdaa925 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:00.155236 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5aedf7df-8c0e-4724-94ef-a1007bdaa925 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:00.156628 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5aedf7df-8c0e-4724-94ef-a1007bdaa925 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:00.157369 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5aedf7df-8c0e-4724-94ef-a1007bdaa925 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:00.301339 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1c5d6234-a152-48fd-bea5-39b045c56691 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:00.305278 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5aedf7df-8c0e-4724-94ef-a1007bdaa925 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:00.309270 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1c5d6234-a152-48fd-bea5-39b045c56691 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.176937 Apr 05 12:12:00.309857 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1447/2874] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:00 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:00.312948 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5aedf7df-8c0e-4724-94ef-a1007bdaa925 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.178198 Apr 05 12:12:00.313523 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1428/2875] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:00 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:00.694635 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-70e21512-d82f-430d-9c29-42eb66fe1fb0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:00.695628 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-70e21512-d82f-430d-9c29-42eb66fe1fb0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:00.705051 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-70e21512-d82f-430d-9c29-42eb66fe1fb0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:00.705500 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-70e21512-d82f-430d-9c29-42eb66fe1fb0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:00.706254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-70e21512-d82f-430d-9c29-42eb66fe1fb0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:00.706680 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-70e21512-d82f-430d-9c29-42eb66fe1fb0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:00.855751 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-70e21512-d82f-430d-9c29-42eb66fe1fb0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:00.866092 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-70e21512-d82f-430d-9c29-42eb66fe1fb0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.178004 Apr 05 12:12:00.866669 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1448/2876] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:00 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:01.063405 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-283ce514-b452-48f6-81db-b37c9aacd925 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:01.064310 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-283ce514-b452-48f6-81db-b37c9aacd925 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:01.074867 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-283ce514-b452-48f6-81db-b37c9aacd925 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:01.075611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-283ce514-b452-48f6-81db-b37c9aacd925 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:01.076902 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-283ce514-b452-48f6-81db-b37c9aacd925 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:01.077612 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-283ce514-b452-48f6-81db-b37c9aacd925 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:01.223946 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-283ce514-b452-48f6-81db-b37c9aacd925 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:01.232455 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-283ce514-b452-48f6-81db-b37c9aacd925 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:01.233951 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-283ce514-b452-48f6-81db-b37c9aacd925 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:01.235194 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-283ce514-b452-48f6-81db-b37c9aacd925 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.178516 Apr 05 12:12:01.235769 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1429/2877] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:01 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:01.330726 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8d2ce1fa-0260-4f9f-84a9-98f82bb9f385 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:01.331358 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8d2ce1fa-0260-4f9f-84a9-98f82bb9f385 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:01.332422 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b2c1e8cc-f13f-4c7d-a7f4-98733581b90e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:01.333135 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b2c1e8cc-f13f-4c7d-a7f4-98733581b90e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:01.338979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8d2ce1fa-0260-4f9f-84a9-98f82bb9f385 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:01.339506 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8d2ce1fa-0260-4f9f-84a9-98f82bb9f385 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:01.340187 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b2c1e8cc-f13f-4c7d-a7f4-98733581b90e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:01.340381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8d2ce1fa-0260-4f9f-84a9-98f82bb9f385 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:01.340727 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b2c1e8cc-f13f-4c7d-a7f4-98733581b90e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:01.340933 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8d2ce1fa-0260-4f9f-84a9-98f82bb9f385 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:01.341619 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b2c1e8cc-f13f-4c7d-a7f4-98733581b90e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:01.342129 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b2c1e8cc-f13f-4c7d-a7f4-98733581b90e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:01.475897 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b2c1e8cc-f13f-4c7d-a7f4-98733581b90e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:01.478004 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8d2ce1fa-0260-4f9f-84a9-98f82bb9f385 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:01.483793 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b2c1e8cc-f13f-4c7d-a7f4-98733581b90e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.156232 Apr 05 12:12:01.484482 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1430/2878] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:01 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:01.486151 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8d2ce1fa-0260-4f9f-84a9-98f82bb9f385 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.162131 Apr 05 12:12:01.489811 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1449/2879] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:01 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:01.883590 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d1ba61bd-f3d5-4950-87d8-e21f34a72692 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:01.884339 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d1ba61bd-f3d5-4950-87d8-e21f34a72692 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:01.895562 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d1ba61bd-f3d5-4950-87d8-e21f34a72692 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:01.896013 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d1ba61bd-f3d5-4950-87d8-e21f34a72692 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:01.896814 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d1ba61bd-f3d5-4950-87d8-e21f34a72692 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:01.897237 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d1ba61bd-f3d5-4950-87d8-e21f34a72692 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:02.038834 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d1ba61bd-f3d5-4950-87d8-e21f34a72692 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:02.046778 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d1ba61bd-f3d5-4950-87d8-e21f34a72692 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.167123 Apr 05 12:12:02.047432 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1431/2880] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:01 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:02.259904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5f431b30-dfa7-4e7e-92a1-a062668baf1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:02.260799 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5f431b30-dfa7-4e7e-92a1-a062668baf1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:02.268316 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5f431b30-dfa7-4e7e-92a1-a062668baf1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:02.268773 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5f431b30-dfa7-4e7e-92a1-a062668baf1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:02.269529 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5f431b30-dfa7-4e7e-92a1-a062668baf1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:02.269960 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5f431b30-dfa7-4e7e-92a1-a062668baf1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:02.452598 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5f431b30-dfa7-4e7e-92a1-a062668baf1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:02.462293 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5f431b30-dfa7-4e7e-92a1-a062668baf1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:02.463798 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5f431b30-dfa7-4e7e-92a1-a062668baf1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:02.464992 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5f431b30-dfa7-4e7e-92a1-a062668baf1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.209337 Apr 05 12:12:02.465563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1450/2881] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:02 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:02.501453 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3da8403c-8545-4353-83c8-5287bcf8e42a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:02.502061 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3da8403c-8545-4353-83c8-5287bcf8e42a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:02.502826 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8727a15c-9c03-4298-a840-8e529b7b65e2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:02.503643 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8727a15c-9c03-4298-a840-8e529b7b65e2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:02.509082 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3da8403c-8545-4353-83c8-5287bcf8e42a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:02.509525 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3da8403c-8545-4353-83c8-5287bcf8e42a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:02.509683 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8727a15c-9c03-4298-a840-8e529b7b65e2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:02.510069 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8727a15c-9c03-4298-a840-8e529b7b65e2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:02.510293 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3da8403c-8545-4353-83c8-5287bcf8e42a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:02.510715 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3da8403c-8545-4353-83c8-5287bcf8e42a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:02.510872 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8727a15c-9c03-4298-a840-8e529b7b65e2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:02.511243 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8727a15c-9c03-4298-a840-8e529b7b65e2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:02.644264 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8727a15c-9c03-4298-a840-8e529b7b65e2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:02.645177 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3da8403c-8545-4353-83c8-5287bcf8e42a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:02.652324 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8727a15c-9c03-4298-a840-8e529b7b65e2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.153213 Apr 05 12:12:02.652898 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1451/2882] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:02 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:12:02.653124 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3da8403c-8545-4353-83c8-5287bcf8e42a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.155663 Apr 05 12:12:02.653872 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1432/2883] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:02 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:03.065080 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d57fbb5d-0ecb-45b3-9010-4c6b4e2dae2a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:03.065690 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d57fbb5d-0ecb-45b3-9010-4c6b4e2dae2a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:03.071771 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d57fbb5d-0ecb-45b3-9010-4c6b4e2dae2a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:03.072270 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d57fbb5d-0ecb-45b3-9010-4c6b4e2dae2a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:03.073118 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d57fbb5d-0ecb-45b3-9010-4c6b4e2dae2a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:03.073446 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d57fbb5d-0ecb-45b3-9010-4c6b4e2dae2a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:03.205159 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d57fbb5d-0ecb-45b3-9010-4c6b4e2dae2a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:03.213394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d57fbb5d-0ecb-45b3-9010-4c6b4e2dae2a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.152191 Apr 05 12:12:03.213973 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1452/2884] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:03 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:03.485121 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3af62c52-0011-44a8-a448-e921145945c3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:03.485734 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3af62c52-0011-44a8-a448-e921145945c3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:03.492420 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3af62c52-0011-44a8-a448-e921145945c3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:03.492662 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3af62c52-0011-44a8-a448-e921145945c3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:03.493437 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3af62c52-0011-44a8-a448-e921145945c3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:03.493861 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3af62c52-0011-44a8-a448-e921145945c3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:03.647972 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3af62c52-0011-44a8-a448-e921145945c3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:03.658945 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3af62c52-0011-44a8-a448-e921145945c3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:03.660511 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3af62c52-0011-44a8-a448-e921145945c3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:03.661716 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3af62c52-0011-44a8-a448-e921145945c3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.182013 Apr 05 12:12:03.662280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1433/2885] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:03 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:03.669863 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-128eeb37-5550-481b-a3ab-331ece9271d4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:03.670477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-128eeb37-5550-481b-a3ab-331ece9271d4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:03.670825 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-237ce8ae-602a-413f-9e3b-f8718be66267 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:03.671453 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-237ce8ae-602a-413f-9e3b-f8718be66267 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:03.676678 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-128eeb37-5550-481b-a3ab-331ece9271d4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:03.677166 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-128eeb37-5550-481b-a3ab-331ece9271d4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:03.677931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-128eeb37-5550-481b-a3ab-331ece9271d4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:03.678219 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-237ce8ae-602a-413f-9e3b-f8718be66267 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:03.678402 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-128eeb37-5550-481b-a3ab-331ece9271d4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:03.678670 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-237ce8ae-602a-413f-9e3b-f8718be66267 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:03.679432 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-237ce8ae-602a-413f-9e3b-f8718be66267 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:03.679954 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-237ce8ae-602a-413f-9e3b-f8718be66267 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:03.818091 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-237ce8ae-602a-413f-9e3b-f8718be66267 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:03.820894 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-128eeb37-5550-481b-a3ab-331ece9271d4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:03.826119 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-237ce8ae-602a-413f-9e3b-f8718be66267 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.159737 Apr 05 12:12:03.826716 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1453/2886] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:03 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:03.828822 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-128eeb37-5550-481b-a3ab-331ece9271d4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.162378 Apr 05 12:12:03.829408 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1434/2887] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:03 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:04.235027 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-91943d48-a4c7-42c6-9009-74ab8568effc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:04.235643 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-91943d48-a4c7-42c6-9009-74ab8568effc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:04.242354 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-91943d48-a4c7-42c6-9009-74ab8568effc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:04.242810 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-91943d48-a4c7-42c6-9009-74ab8568effc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:04.243570 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-91943d48-a4c7-42c6-9009-74ab8568effc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:04.244004 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-91943d48-a4c7-42c6-9009-74ab8568effc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:04.380208 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-91943d48-a4c7-42c6-9009-74ab8568effc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:04.388104 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-91943d48-a4c7-42c6-9009-74ab8568effc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.159615 Apr 05 12:12:04.388653 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1454/2888] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:04 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:04.684858 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a7b0c3bb-2814-42cd-82e4-df5081f17a38 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:04.685733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a7b0c3bb-2814-42cd-82e4-df5081f17a38 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:04.693299 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a7b0c3bb-2814-42cd-82e4-df5081f17a38 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:04.693750 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a7b0c3bb-2814-42cd-82e4-df5081f17a38 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:04.694523 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a7b0c3bb-2814-42cd-82e4-df5081f17a38 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:04.694959 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a7b0c3bb-2814-42cd-82e4-df5081f17a38 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:04.827835 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a7b0c3bb-2814-42cd-82e4-df5081f17a38 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:04.838153 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a7b0c3bb-2814-42cd-82e4-df5081f17a38 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:04.840369 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a7b0c3bb-2814-42cd-82e4-df5081f17a38 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:04.841833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a7b0c3bb-2814-42cd-82e4-df5081f17a38 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.163563 Apr 05 12:12:04.842623 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1435/2889] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:04 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:04.844180 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6152743a-b02c-40e4-b029-86b6de67a3f2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:04.844823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6152743a-b02c-40e4-b029-86b6de67a3f2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:04.847151 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8f62f0e2-8a74-4452-bdf4-8b6de19a4757 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:04.847747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8f62f0e2-8a74-4452-bdf4-8b6de19a4757 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:04.851653 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6152743a-b02c-40e4-b029-86b6de67a3f2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:04.852116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6152743a-b02c-40e4-b029-86b6de67a3f2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:04.852886 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6152743a-b02c-40e4-b029-86b6de67a3f2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:04.853296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6152743a-b02c-40e4-b029-86b6de67a3f2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:04.854106 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f62f0e2-8a74-4452-bdf4-8b6de19a4757 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:04.854556 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f62f0e2-8a74-4452-bdf4-8b6de19a4757 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:04.855319 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f62f0e2-8a74-4452-bdf4-8b6de19a4757 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:04.855748 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f62f0e2-8a74-4452-bdf4-8b6de19a4757 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:04.985391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6152743a-b02c-40e4-b029-86b6de67a3f2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:04.989836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8f62f0e2-8a74-4452-bdf4-8b6de19a4757 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:04.995337 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6152743a-b02c-40e4-b029-86b6de67a3f2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.155799 Apr 05 12:12:04.996202 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1455/2890] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:04 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:04.998010 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8f62f0e2-8a74-4452-bdf4-8b6de19a4757 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.154449 Apr 05 12:12:04.998568 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1436/2891] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:04 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:05.408866 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ef3b3aba-668e-49d2-bfee-57178fcf5c8a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:05.409474 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ef3b3aba-668e-49d2-bfee-57178fcf5c8a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:05.415903 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ef3b3aba-668e-49d2-bfee-57178fcf5c8a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:05.416384 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ef3b3aba-668e-49d2-bfee-57178fcf5c8a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:05.417136 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ef3b3aba-668e-49d2-bfee-57178fcf5c8a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:05.417563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ef3b3aba-668e-49d2-bfee-57178fcf5c8a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:05.555181 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ef3b3aba-668e-49d2-bfee-57178fcf5c8a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:05.563021 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ef3b3aba-668e-49d2-bfee-57178fcf5c8a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.159607 Apr 05 12:12:05.563560 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1456/2892] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:05 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:05.864058 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-58a4d5d7-efa0-401d-b067-9af1fb07e2cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:05.864812 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-58a4d5d7-efa0-401d-b067-9af1fb07e2cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:05.873568 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-58a4d5d7-efa0-401d-b067-9af1fb07e2cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:05.874131 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-58a4d5d7-efa0-401d-b067-9af1fb07e2cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:05.875142 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-58a4d5d7-efa0-401d-b067-9af1fb07e2cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:05.875820 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-58a4d5d7-efa0-401d-b067-9af1fb07e2cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:06.017346 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-525b0038-1137-455e-bf97-29f4849cd26b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:06.017959 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-525b0038-1137-455e-bf97-29f4849cd26b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:06.020554 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-58a4d5d7-efa0-401d-b067-9af1fb07e2cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:06.026040 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-525b0038-1137-455e-bf97-29f4849cd26b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:06.026490 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-525b0038-1137-455e-bf97-29f4849cd26b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:06.027281 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-525b0038-1137-455e-bf97-29f4849cd26b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:06.027693 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-525b0038-1137-455e-bf97-29f4849cd26b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:06.029039 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-58a4d5d7-efa0-401d-b067-9af1fb07e2cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:06.030499 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-58a4d5d7-efa0-401d-b067-9af1fb07e2cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:06.031742 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-58a4d5d7-efa0-401d-b067-9af1fb07e2cd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.173608 Apr 05 12:12:06.032327 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1437/2893] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:05 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:12:06.036636 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a96c2a29-f171-449c-b2c2-b4333d8fa8d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:06.037242 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a96c2a29-f171-449c-b2c2-b4333d8fa8d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:06.042855 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a96c2a29-f171-449c-b2c2-b4333d8fa8d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:06.043301 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a96c2a29-f171-449c-b2c2-b4333d8fa8d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:06.044057 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a96c2a29-f171-449c-b2c2-b4333d8fa8d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:06.044505 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a96c2a29-f171-449c-b2c2-b4333d8fa8d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:06.160126 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-525b0038-1137-455e-bf97-29f4849cd26b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:06.167975 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-525b0038-1137-455e-bf97-29f4849cd26b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.155716 Apr 05 12:12:06.168610 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1457/2894] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:06 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:06.172533 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a96c2a29-f171-449c-b2c2-b4333d8fa8d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:06.180534 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a96c2a29-f171-449c-b2c2-b4333d8fa8d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.147263 Apr 05 12:12:06.181118 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1438/2895] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:06 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:06.584831 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5bdefcb0-870d-4c93-bcc4-208a91767282 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:06.585916 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5bdefcb0-870d-4c93-bcc4-208a91767282 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:06.596597 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5bdefcb0-870d-4c93-bcc4-208a91767282 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:06.597341 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5bdefcb0-870d-4c93-bcc4-208a91767282 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:06.598566 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5bdefcb0-870d-4c93-bcc4-208a91767282 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:06.599285 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5bdefcb0-870d-4c93-bcc4-208a91767282 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:06.975174 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5bdefcb0-870d-4c93-bcc4-208a91767282 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:06.983169 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5bdefcb0-870d-4c93-bcc4-208a91767282 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.405246 Apr 05 12:12:06.983744 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1458/2896] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:06 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:07.054200 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a9e490f6-474d-4053-8a8f-c82b3b81a99b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:07.055252 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a9e490f6-474d-4053-8a8f-c82b3b81a99b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:07.064812 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a9e490f6-474d-4053-8a8f-c82b3b81a99b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:07.065263 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a9e490f6-474d-4053-8a8f-c82b3b81a99b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:07.066025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a9e490f6-474d-4053-8a8f-c82b3b81a99b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:07.066461 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a9e490f6-474d-4053-8a8f-c82b3b81a99b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:07.187552 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6bf18f1d-361c-4711-9346-8e68503b8bdd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:07.188451 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6bf18f1d-361c-4711-9346-8e68503b8bdd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:07.194989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6bf18f1d-361c-4711-9346-8e68503b8bdd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:07.195178 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6bf18f1d-361c-4711-9346-8e68503b8bdd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:07.195882 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6bf18f1d-361c-4711-9346-8e68503b8bdd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:07.196347 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6bf18f1d-361c-4711-9346-8e68503b8bdd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:07.212298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a9e490f6-474d-4053-8a8f-c82b3b81a99b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:07.220653 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a9e490f6-474d-4053-8a8f-c82b3b81a99b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:07.222211 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a9e490f6-474d-4053-8a8f-c82b3b81a99b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:07.223450 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a9e490f6-474d-4053-8a8f-c82b3b81a99b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.175780 Apr 05 12:12:07.223947 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1439/2897] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:07 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:07.228280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5ff2b260-1cfa-48d7-9298-f7385d25ac65 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:07.228886 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5ff2b260-1cfa-48d7-9298-f7385d25ac65 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:07.234704 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5ff2b260-1cfa-48d7-9298-f7385d25ac65 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:07.235159 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5ff2b260-1cfa-48d7-9298-f7385d25ac65 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:07.235929 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5ff2b260-1cfa-48d7-9298-f7385d25ac65 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:07.236393 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5ff2b260-1cfa-48d7-9298-f7385d25ac65 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:07.333258 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6bf18f1d-361c-4711-9346-8e68503b8bdd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:07.341054 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6bf18f1d-361c-4711-9346-8e68503b8bdd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.159288 Apr 05 12:12:07.341622 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1459/2898] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:07 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:07.372128 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5ff2b260-1cfa-48d7-9298-f7385d25ac65 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:07.380334 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5ff2b260-1cfa-48d7-9298-f7385d25ac65 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.155433 Apr 05 12:12:07.380900 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1440/2899] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:07 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:08.005119 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b20839ef-01e6-4840-905d-0e91217495e8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:08.006174 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b20839ef-01e6-4840-905d-0e91217495e8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:08.016394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b20839ef-01e6-4840-905d-0e91217495e8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:08.016912 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b20839ef-01e6-4840-905d-0e91217495e8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:08.017679 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b20839ef-01e6-4840-905d-0e91217495e8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:08.018137 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b20839ef-01e6-4840-905d-0e91217495e8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:08.153779 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b20839ef-01e6-4840-905d-0e91217495e8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:08.165845 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b20839ef-01e6-4840-905d-0e91217495e8 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.167426 Apr 05 12:12:08.166682 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1460/2900] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:07 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:08.245767 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-89339f8d-7a3c-4efc-bccc-bbd12f723795 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:08.246862 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-89339f8d-7a3c-4efc-bccc-bbd12f723795 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:08.257847 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-89339f8d-7a3c-4efc-bccc-bbd12f723795 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:08.258493 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-89339f8d-7a3c-4efc-bccc-bbd12f723795 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:08.259746 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-89339f8d-7a3c-4efc-bccc-bbd12f723795 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:08.260547 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-89339f8d-7a3c-4efc-bccc-bbd12f723795 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:08.358250 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-42690bd7-1fe6-4655-8a88-860a455d6c31 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:08.358862 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-42690bd7-1fe6-4655-8a88-860a455d6c31 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:08.365545 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-42690bd7-1fe6-4655-8a88-860a455d6c31 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:08.365959 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-42690bd7-1fe6-4655-8a88-860a455d6c31 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:08.366712 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-42690bd7-1fe6-4655-8a88-860a455d6c31 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:08.367146 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-42690bd7-1fe6-4655-8a88-860a455d6c31 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:08.408710 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-89339f8d-7a3c-4efc-bccc-bbd12f723795 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:08.416934 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-89339f8d-7a3c-4efc-bccc-bbd12f723795 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:08.418424 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-89339f8d-7a3c-4efc-bccc-bbd12f723795 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:08.419554 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-89339f8d-7a3c-4efc-bccc-bbd12f723795 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.180449 Apr 05 12:12:08.420179 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1441/2901] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:08 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:08.424498 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2e41f641-460f-47ef-848e-abfdf31fea61 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:08.425099 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2e41f641-460f-47ef-848e-abfdf31fea61 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:08.430706 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2e41f641-460f-47ef-848e-abfdf31fea61 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:08.431156 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2e41f641-460f-47ef-848e-abfdf31fea61 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:08.431926 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2e41f641-460f-47ef-848e-abfdf31fea61 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:08.432385 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2e41f641-460f-47ef-848e-abfdf31fea61 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:08.501614 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-42690bd7-1fe6-4655-8a88-860a455d6c31 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:08.510185 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-42690bd7-1fe6-4655-8a88-860a455d6c31 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.155773 Apr 05 12:12:08.510650 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1461/2902] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:08 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:12:08.564209 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2e41f641-460f-47ef-848e-abfdf31fea61 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:08.572709 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2e41f641-460f-47ef-848e-abfdf31fea61 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.151614 Apr 05 12:12:08.573287 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1442/2903] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:08 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:09.187091 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b8627f00-9c80-49d9-8809-d02942631f17 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:09.188232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b8627f00-9c80-49d9-8809-d02942631f17 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:09.195638 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b8627f00-9c80-49d9-8809-d02942631f17 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:09.196180 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b8627f00-9c80-49d9-8809-d02942631f17 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:09.197062 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b8627f00-9c80-49d9-8809-d02942631f17 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:09.197561 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b8627f00-9c80-49d9-8809-d02942631f17 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:09.339688 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b8627f00-9c80-49d9-8809-d02942631f17 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:09.348355 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b8627f00-9c80-49d9-8809-d02942631f17 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.167890 Apr 05 12:12:09.348958 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1462/2904] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:09 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:09.438019 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c4044586-6880-4d34-8099-a215fcc041f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:09.438597 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c4044586-6880-4d34-8099-a215fcc041f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:09.445309 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c4044586-6880-4d34-8099-a215fcc041f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:09.445759 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c4044586-6880-4d34-8099-a215fcc041f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:09.446524 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c4044586-6880-4d34-8099-a215fcc041f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:09.446956 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c4044586-6880-4d34-8099-a215fcc041f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:09.526937 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d0b88e11-2747-4855-920a-bdc76b901aec tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:09.527632 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d0b88e11-2747-4855-920a-bdc76b901aec tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:09.533795 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d0b88e11-2747-4855-920a-bdc76b901aec tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:09.534213 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d0b88e11-2747-4855-920a-bdc76b901aec tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:09.534954 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d0b88e11-2747-4855-920a-bdc76b901aec tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:09.535444 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d0b88e11-2747-4855-920a-bdc76b901aec tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:09.586215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c4044586-6880-4d34-8099-a215fcc041f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:09.594769 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c4044586-6880-4d34-8099-a215fcc041f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:09.596290 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c4044586-6880-4d34-8099-a215fcc041f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:09.597449 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c4044586-6880-4d34-8099-a215fcc041f2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.163597 Apr 05 12:12:09.598017 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1443/2905] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:09 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:09.602496 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3b620b2c-6698-4d3f-8628-c5873adccdcb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:09.603099 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3b620b2c-6698-4d3f-8628-c5873adccdcb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:09.608774 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b620b2c-6698-4d3f-8628-c5873adccdcb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:09.609220 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b620b2c-6698-4d3f-8628-c5873adccdcb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:09.610086 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b620b2c-6698-4d3f-8628-c5873adccdcb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:09.610518 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b620b2c-6698-4d3f-8628-c5873adccdcb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:09.682171 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d0b88e11-2747-4855-920a-bdc76b901aec tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:09.690389 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d0b88e11-2747-4855-920a-bdc76b901aec tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.167362 Apr 05 12:12:09.690970 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1463/2906] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:09 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:09.742343 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3b620b2c-6698-4d3f-8628-c5873adccdcb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:09.754150 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3b620b2c-6698-4d3f-8628-c5873adccdcb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.154396 Apr 05 12:12:09.754896 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1444/2907] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:09 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:10.370176 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0e8550c7-2cfc-4d79-8c80-883b34e56e1f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:10.371211 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0e8550c7-2cfc-4d79-8c80-883b34e56e1f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:10.382069 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0e8550c7-2cfc-4d79-8c80-883b34e56e1f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:10.382804 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0e8550c7-2cfc-4d79-8c80-883b34e56e1f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:10.383991 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0e8550c7-2cfc-4d79-8c80-883b34e56e1f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:10.384784 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0e8550c7-2cfc-4d79-8c80-883b34e56e1f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:10.518654 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0e8550c7-2cfc-4d79-8c80-883b34e56e1f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:10.527310 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0e8550c7-2cfc-4d79-8c80-883b34e56e1f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.163532 Apr 05 12:12:10.527889 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1464/2908] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:10 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:10.619588 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f826c823-80a1-44a0-8d69-a69a4f6ab946 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:10.620840 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f826c823-80a1-44a0-8d69-a69a4f6ab946 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:10.629599 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f826c823-80a1-44a0-8d69-a69a4f6ab946 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:10.630030 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f826c823-80a1-44a0-8d69-a69a4f6ab946 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:10.630807 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f826c823-80a1-44a0-8d69-a69a4f6ab946 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:10.631247 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f826c823-80a1-44a0-8d69-a69a4f6ab946 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:10.706891 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3091f42d-43cb-4b78-a38f-3fe25b74acfc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:10.707505 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3091f42d-43cb-4b78-a38f-3fe25b74acfc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:10.713872 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3091f42d-43cb-4b78-a38f-3fe25b74acfc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:10.714329 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3091f42d-43cb-4b78-a38f-3fe25b74acfc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:10.715093 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3091f42d-43cb-4b78-a38f-3fe25b74acfc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:10.715531 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3091f42d-43cb-4b78-a38f-3fe25b74acfc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:10.776611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f826c823-80a1-44a0-8d69-a69a4f6ab946 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:10.784954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f826c823-80a1-44a0-8d69-a69a4f6ab946 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:10.786447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f826c823-80a1-44a0-8d69-a69a4f6ab946 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:10.787714 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f826c823-80a1-44a0-8d69-a69a4f6ab946 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.174737 Apr 05 12:12:10.788196 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1445/2909] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:10 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:10.792467 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-eb4168ce-3b24-4be9-b356-3bbd78fd694c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:10.793064 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-eb4168ce-3b24-4be9-b356-3bbd78fd694c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:10.799077 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eb4168ce-3b24-4be9-b356-3bbd78fd694c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:10.799526 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eb4168ce-3b24-4be9-b356-3bbd78fd694c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:10.800313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eb4168ce-3b24-4be9-b356-3bbd78fd694c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:10.800742 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eb4168ce-3b24-4be9-b356-3bbd78fd694c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:10.851005 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3091f42d-43cb-4b78-a38f-3fe25b74acfc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:10.859046 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3091f42d-43cb-4b78-a38f-3fe25b74acfc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.156034 Apr 05 12:12:10.859638 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1465/2910] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:10 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:10.933347 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-eb4168ce-3b24-4be9-b356-3bbd78fd694c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:10.943322 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-eb4168ce-3b24-4be9-b356-3bbd78fd694c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.154192 Apr 05 12:12:10.943900 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1446/2911] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:10 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:11.548048 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c6620a3d-9271-4c60-9622-f73c71d39b5a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:11.549019 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c6620a3d-9271-4c60-9622-f73c71d39b5a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:11.558655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c6620a3d-9271-4c60-9622-f73c71d39b5a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:11.559331 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c6620a3d-9271-4c60-9622-f73c71d39b5a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:11.560561 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c6620a3d-9271-4c60-9622-f73c71d39b5a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:11.561170 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c6620a3d-9271-4c60-9622-f73c71d39b5a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:11.694272 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c6620a3d-9271-4c60-9622-f73c71d39b5a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:11.704226 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c6620a3d-9271-4c60-9622-f73c71d39b5a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.162281 Apr 05 12:12:11.704799 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1466/2912] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:11 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:11.811171 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-80f83c00-fbd7-4208-b2e1-c1650cb6a4d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:11.812158 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-80f83c00-fbd7-4208-b2e1-c1650cb6a4d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:11.822672 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-80f83c00-fbd7-4208-b2e1-c1650cb6a4d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:11.823417 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-80f83c00-fbd7-4208-b2e1-c1650cb6a4d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:11.824735 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-80f83c00-fbd7-4208-b2e1-c1650cb6a4d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:11.825458 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-80f83c00-fbd7-4208-b2e1-c1650cb6a4d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:11.876418 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ea858904-fd60-4ecc-866e-70da45b07b2b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:11.877030 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ea858904-fd60-4ecc-866e-70da45b07b2b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:11.883554 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea858904-fd60-4ecc-866e-70da45b07b2b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:11.884032 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea858904-fd60-4ecc-866e-70da45b07b2b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:11.884913 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea858904-fd60-4ecc-866e-70da45b07b2b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:11.885344 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea858904-fd60-4ecc-866e-70da45b07b2b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:11.963470 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-80f83c00-fbd7-4208-b2e1-c1650cb6a4d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:11.972267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-80f83c00-fbd7-4208-b2e1-c1650cb6a4d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:11.974554 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-80f83c00-fbd7-4208-b2e1-c1650cb6a4d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:11.975893 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-80f83c00-fbd7-4208-b2e1-c1650cb6a4d0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.171487 Apr 05 12:12:11.976653 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1447/2913] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:11 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:11.982194 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-79013b98-3207-4217-b231-49d2880ea8bd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:11.982869 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-79013b98-3207-4217-b231-49d2880ea8bd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:11.990142 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79013b98-3207-4217-b231-49d2880ea8bd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:11.990605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79013b98-3207-4217-b231-49d2880ea8bd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:11.991370 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79013b98-3207-4217-b231-49d2880ea8bd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:11.991814 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-79013b98-3207-4217-b231-49d2880ea8bd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:12.020148 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ea858904-fd60-4ecc-866e-70da45b07b2b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:12.028588 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ea858904-fd60-4ecc-866e-70da45b07b2b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.155978 Apr 05 12:12:12.029416 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1467/2914] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:11 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:12.145457 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-79013b98-3207-4217-b231-49d2880ea8bd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:12.153797 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-79013b98-3207-4217-b231-49d2880ea8bd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.176119 Apr 05 12:12:12.154351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1448/2915] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:11 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:12.725535 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-65f23d8a-1317-4b74-ad5e-5c8438e76f68 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:12.726520 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-65f23d8a-1317-4b74-ad5e-5c8438e76f68 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:12.736316 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-65f23d8a-1317-4b74-ad5e-5c8438e76f68 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:12.736760 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-65f23d8a-1317-4b74-ad5e-5c8438e76f68 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:12.737535 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-65f23d8a-1317-4b74-ad5e-5c8438e76f68 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:12.737937 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-65f23d8a-1317-4b74-ad5e-5c8438e76f68 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:12.884767 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-65f23d8a-1317-4b74-ad5e-5c8438e76f68 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:12.897106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-65f23d8a-1317-4b74-ad5e-5c8438e76f68 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.177717 Apr 05 12:12:12.897906 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1468/2916] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:12 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:13.003030 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e11e731e-aa9c-48f8-8d04-ef61f387acb2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:13.004649 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e11e731e-aa9c-48f8-8d04-ef61f387acb2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:13.015139 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e11e731e-aa9c-48f8-8d04-ef61f387acb2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:13.015895 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e11e731e-aa9c-48f8-8d04-ef61f387acb2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:13.017213 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e11e731e-aa9c-48f8-8d04-ef61f387acb2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:13.017940 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e11e731e-aa9c-48f8-8d04-ef61f387acb2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:13.046004 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3cf16e92-9ed8-48e1-9c01-99ede9445f0b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:13.046612 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3cf16e92-9ed8-48e1-9c01-99ede9445f0b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:13.052743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3cf16e92-9ed8-48e1-9c01-99ede9445f0b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:13.053184 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3cf16e92-9ed8-48e1-9c01-99ede9445f0b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:13.053936 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3cf16e92-9ed8-48e1-9c01-99ede9445f0b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:13.054361 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3cf16e92-9ed8-48e1-9c01-99ede9445f0b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:13.157149 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e11e731e-aa9c-48f8-8d04-ef61f387acb2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:13.165701 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e11e731e-aa9c-48f8-8d04-ef61f387acb2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:13.167446 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e11e731e-aa9c-48f8-8d04-ef61f387acb2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:13.168681 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e11e731e-aa9c-48f8-8d04-ef61f387acb2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.172449 Apr 05 12:12:13.169276 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1449/2917] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:12 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:13.173691 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f64230e6-9afc-4e05-9d2f-077bfe0fa3ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:13.174674 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f64230e6-9afc-4e05-9d2f-077bfe0fa3ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:13.179991 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f64230e6-9afc-4e05-9d2f-077bfe0fa3ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:13.180479 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f64230e6-9afc-4e05-9d2f-077bfe0fa3ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:13.181245 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f64230e6-9afc-4e05-9d2f-077bfe0fa3ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:13.181681 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f64230e6-9afc-4e05-9d2f-077bfe0fa3ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:13.189409 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3cf16e92-9ed8-48e1-9c01-99ede9445f0b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:13.197392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3cf16e92-9ed8-48e1-9c01-99ede9445f0b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.155187 Apr 05 12:12:13.197961 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1469/2918] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:13 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:13.323181 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f64230e6-9afc-4e05-9d2f-077bfe0fa3ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:13.331054 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f64230e6-9afc-4e05-9d2f-077bfe0fa3ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.160851 Apr 05 12:12:13.331597 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1450/2919] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:13 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:13.919979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-68915bd8-129a-4a54-965d-86d2f731d17e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:13.920747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-68915bd8-129a-4a54-965d-86d2f731d17e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:13.929518 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-68915bd8-129a-4a54-965d-86d2f731d17e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:13.930111 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-68915bd8-129a-4a54-965d-86d2f731d17e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:13.931116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-68915bd8-129a-4a54-965d-86d2f731d17e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:13.931693 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-68915bd8-129a-4a54-965d-86d2f731d17e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:14.074469 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-68915bd8-129a-4a54-965d-86d2f731d17e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:14.082821 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-68915bd8-129a-4a54-965d-86d2f731d17e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.168093 Apr 05 12:12:14.083527 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1470/2920] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:13 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:14.190923 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-196b1317-3ba4-4e9f-82a6-445ef83b7d4b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:14.191827 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-196b1317-3ba4-4e9f-82a6-445ef83b7d4b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:14.202260 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-196b1317-3ba4-4e9f-82a6-445ef83b7d4b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:14.203003 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-196b1317-3ba4-4e9f-82a6-445ef83b7d4b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:14.204308 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-196b1317-3ba4-4e9f-82a6-445ef83b7d4b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:14.205033 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-196b1317-3ba4-4e9f-82a6-445ef83b7d4b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:14.214661 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-204ed5cf-c329-4661-adba-3ca7bf591ff1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:14.215266 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-204ed5cf-c329-4661-adba-3ca7bf591ff1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:14.221638 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-204ed5cf-c329-4661-adba-3ca7bf591ff1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:14.222087 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-204ed5cf-c329-4661-adba-3ca7bf591ff1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:14.222834 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-204ed5cf-c329-4661-adba-3ca7bf591ff1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:14.223261 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-204ed5cf-c329-4661-adba-3ca7bf591ff1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:14.359590 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-204ed5cf-c329-4661-adba-3ca7bf591ff1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:14.367967 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-204ed5cf-c329-4661-adba-3ca7bf591ff1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.157066 Apr 05 12:12:14.368561 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1471/2921] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:14 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:14.373074 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1c024219-c17f-4044-a736-a5760de3162b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:14.373677 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1c024219-c17f-4044-a736-a5760de3162b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:14.380280 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1c024219-c17f-4044-a736-a5760de3162b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:14.380728 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1c024219-c17f-4044-a736-a5760de3162b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:14.381495 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1c024219-c17f-4044-a736-a5760de3162b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:14.381958 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1c024219-c17f-4044-a736-a5760de3162b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:14.525354 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1c024219-c17f-4044-a736-a5760de3162b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:14.533358 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1c024219-c17f-4044-a736-a5760de3162b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.163826 Apr 05 12:12:14.533949 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1472/2922] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:14 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:14.580180 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-196b1317-3ba4-4e9f-82a6-445ef83b7d4b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:14.588659 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-196b1317-3ba4-4e9f-82a6-445ef83b7d4b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:14.590138 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-196b1317-3ba4-4e9f-82a6-445ef83b7d4b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:14.591280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-196b1317-3ba4-4e9f-82a6-445ef83b7d4b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.406968 Apr 05 12:12:14.591837 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1451/2923] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:14 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:15.104383 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2c8f71cc-91eb-40dd-a2ca-7dc474a76d3f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:15.105388 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2c8f71cc-91eb-40dd-a2ca-7dc474a76d3f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:15.116305 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2c8f71cc-91eb-40dd-a2ca-7dc474a76d3f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:15.117049 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2c8f71cc-91eb-40dd-a2ca-7dc474a76d3f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:15.118335 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2c8f71cc-91eb-40dd-a2ca-7dc474a76d3f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:15.119058 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2c8f71cc-91eb-40dd-a2ca-7dc474a76d3f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:15.259680 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2c8f71cc-91eb-40dd-a2ca-7dc474a76d3f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:15.271725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2c8f71cc-91eb-40dd-a2ca-7dc474a76d3f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.173514 Apr 05 12:12:15.272531 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1473/2924] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:15 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:15.389425 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ae8b7be3-9476-41e9-9a5a-2fff6c462464 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:15.390322 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ae8b7be3-9476-41e9-9a5a-2fff6c462464 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:15.400848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae8b7be3-9476-41e9-9a5a-2fff6c462464 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:15.401592 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae8b7be3-9476-41e9-9a5a-2fff6c462464 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:15.402831 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae8b7be3-9476-41e9-9a5a-2fff6c462464 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:15.403543 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae8b7be3-9476-41e9-9a5a-2fff6c462464 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:15.542921 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ae8b7be3-9476-41e9-9a5a-2fff6c462464 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:15.550415 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e38540ab-8bcf-43fb-bf34-dabbe8d71cb0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:15.551020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e38540ab-8bcf-43fb-bf34-dabbe8d71cb0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:15.551627 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ae8b7be3-9476-41e9-9a5a-2fff6c462464 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.168797 Apr 05 12:12:15.552229 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1452/2925] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:15 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:15.557024 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e38540ab-8bcf-43fb-bf34-dabbe8d71cb0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:15.557478 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e38540ab-8bcf-43fb-bf34-dabbe8d71cb0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:15.558231 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e38540ab-8bcf-43fb-bf34-dabbe8d71cb0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:15.558660 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e38540ab-8bcf-43fb-bf34-dabbe8d71cb0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:15.609347 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2cf70536-dc04-429f-98a5-7af6fe85f7e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:15.609961 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2cf70536-dc04-429f-98a5-7af6fe85f7e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:15.615976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2cf70536-dc04-429f-98a5-7af6fe85f7e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:15.616530 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2cf70536-dc04-429f-98a5-7af6fe85f7e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:15.617352 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2cf70536-dc04-429f-98a5-7af6fe85f7e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:15.617869 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2cf70536-dc04-429f-98a5-7af6fe85f7e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:15.692719 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e38540ab-8bcf-43fb-bf34-dabbe8d71cb0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:15.701072 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e38540ab-8bcf-43fb-bf34-dabbe8d71cb0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.154579 Apr 05 12:12:15.701834 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1474/2926] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:15 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:12:15.755821 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2cf70536-dc04-429f-98a5-7af6fe85f7e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:15.764505 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2cf70536-dc04-429f-98a5-7af6fe85f7e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:15.766024 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2cf70536-dc04-429f-98a5-7af6fe85f7e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:15.767378 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2cf70536-dc04-429f-98a5-7af6fe85f7e0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.161845 Apr 05 12:12:15.767968 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1453/2927] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:15 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:16.296602 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2edf61ea-1834-4cc8-923f-988099c47d20 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:16.297608 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2edf61ea-1834-4cc8-923f-988099c47d20 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:16.305053 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2edf61ea-1834-4cc8-923f-988099c47d20 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:16.305528 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2edf61ea-1834-4cc8-923f-988099c47d20 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:16.306331 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2edf61ea-1834-4cc8-923f-988099c47d20 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:16.306792 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2edf61ea-1834-4cc8-923f-988099c47d20 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:16.448786 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2edf61ea-1834-4cc8-923f-988099c47d20 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:16.457204 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2edf61ea-1834-4cc8-923f-988099c47d20 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.167102 Apr 05 12:12:16.457793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1475/2928] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:16 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:16.572346 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-500eccdf-5fd4-42fb-9556-6db5c2b0856d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:16.573121 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-500eccdf-5fd4-42fb-9556-6db5c2b0856d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:16.582791 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-500eccdf-5fd4-42fb-9556-6db5c2b0856d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:16.583492 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-500eccdf-5fd4-42fb-9556-6db5c2b0856d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:16.584733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-500eccdf-5fd4-42fb-9556-6db5c2b0856d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:16.585389 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-500eccdf-5fd4-42fb-9556-6db5c2b0856d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:16.718155 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-562f6bad-b010-4988-bf91-f5a54e45c583 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:16.718766 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-562f6bad-b010-4988-bf91-f5a54e45c583 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:16.725135 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-562f6bad-b010-4988-bf91-f5a54e45c583 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:16.725586 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-562f6bad-b010-4988-bf91-f5a54e45c583 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:16.725818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-500eccdf-5fd4-42fb-9556-6db5c2b0856d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:16.726355 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-562f6bad-b010-4988-bf91-f5a54e45c583 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:16.726785 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-562f6bad-b010-4988-bf91-f5a54e45c583 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:16.733765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-500eccdf-5fd4-42fb-9556-6db5c2b0856d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.167409 Apr 05 12:12:16.734353 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1454/2929] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:16 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:16.786560 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ac174dd6-4357-4d03-9f7c-725636863b90 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:16.787185 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ac174dd6-4357-4d03-9f7c-725636863b90 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:16.793450 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ac174dd6-4357-4d03-9f7c-725636863b90 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:16.793798 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ac174dd6-4357-4d03-9f7c-725636863b90 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:16.794584 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ac174dd6-4357-4d03-9f7c-725636863b90 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:16.794995 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ac174dd6-4357-4d03-9f7c-725636863b90 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:16.860942 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-562f6bad-b010-4988-bf91-f5a54e45c583 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:16.868793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-562f6bad-b010-4988-bf91-f5a54e45c583 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.154519 Apr 05 12:12:16.869370 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1476/2930] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:16 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:16.927722 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ac174dd6-4357-4d03-9f7c-725636863b90 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:16.936516 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ac174dd6-4357-4d03-9f7c-725636863b90 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:16.938028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ac174dd6-4357-4d03-9f7c-725636863b90 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:16.939345 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ac174dd6-4357-4d03-9f7c-725636863b90 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.156867 Apr 05 12:12:16.939881 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1455/2931] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:16 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:12:17.476124 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b4407dd7-9e34-49b4-bb2d-ae5260b3b45c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:17.476777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b4407dd7-9e34-49b4-bb2d-ae5260b3b45c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:17.483897 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b4407dd7-9e34-49b4-bb2d-ae5260b3b45c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:17.484393 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b4407dd7-9e34-49b4-bb2d-ae5260b3b45c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:17.485187 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b4407dd7-9e34-49b4-bb2d-ae5260b3b45c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:17.485640 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b4407dd7-9e34-49b4-bb2d-ae5260b3b45c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:17.627287 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b4407dd7-9e34-49b4-bb2d-ae5260b3b45c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:17.635943 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b4407dd7-9e34-49b4-bb2d-ae5260b3b45c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.163983 Apr 05 12:12:17.636558 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1477/2932] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:17 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:17.752984 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c71e44c4-fcb0-4d1f-8f09-b7709f3cacb7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:17.753946 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c71e44c4-fcb0-4d1f-8f09-b7709f3cacb7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:17.762127 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c71e44c4-fcb0-4d1f-8f09-b7709f3cacb7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:17.762679 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c71e44c4-fcb0-4d1f-8f09-b7709f3cacb7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:17.763611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c71e44c4-fcb0-4d1f-8f09-b7709f3cacb7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:17.764156 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c71e44c4-fcb0-4d1f-8f09-b7709f3cacb7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:17.885583 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-362eb0f6-7559-4b33-ba5d-cdedd3ae0aa7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:17.886203 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-362eb0f6-7559-4b33-ba5d-cdedd3ae0aa7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:17.892136 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-362eb0f6-7559-4b33-ba5d-cdedd3ae0aa7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:17.892582 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-362eb0f6-7559-4b33-ba5d-cdedd3ae0aa7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:17.893337 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-362eb0f6-7559-4b33-ba5d-cdedd3ae0aa7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:17.893760 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-362eb0f6-7559-4b33-ba5d-cdedd3ae0aa7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:17.896870 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c71e44c4-fcb0-4d1f-8f09-b7709f3cacb7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:17.904618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c71e44c4-fcb0-4d1f-8f09-b7709f3cacb7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.156661 Apr 05 12:12:17.905193 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1456/2933] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:17 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:17.957897 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f808b39c-708f-45cb-9dc8-902f0e70abe7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:17.958500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f808b39c-708f-45cb-9dc8-902f0e70abe7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:17.964671 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f808b39c-708f-45cb-9dc8-902f0e70abe7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:17.965194 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f808b39c-708f-45cb-9dc8-902f0e70abe7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:17.965996 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f808b39c-708f-45cb-9dc8-902f0e70abe7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:17.966430 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f808b39c-708f-45cb-9dc8-902f0e70abe7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:18.028213 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-362eb0f6-7559-4b33-ba5d-cdedd3ae0aa7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:18.036045 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-362eb0f6-7559-4b33-ba5d-cdedd3ae0aa7 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.154435 Apr 05 12:12:18.036655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1478/2934] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:17 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:18.109250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f808b39c-708f-45cb-9dc8-902f0e70abe7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:18.117797 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f808b39c-708f-45cb-9dc8-902f0e70abe7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:18.119316 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f808b39c-708f-45cb-9dc8-902f0e70abe7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:18.120494 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f808b39c-708f-45cb-9dc8-902f0e70abe7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.166723 Apr 05 12:12:18.121051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1457/2935] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:17 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:18.657461 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-604096fd-12d1-4fe2-9fbb-3b5eb0a352d9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:18.658502 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-604096fd-12d1-4fe2-9fbb-3b5eb0a352d9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:18.669009 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-604096fd-12d1-4fe2-9fbb-3b5eb0a352d9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:18.669743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-604096fd-12d1-4fe2-9fbb-3b5eb0a352d9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:18.670977 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-604096fd-12d1-4fe2-9fbb-3b5eb0a352d9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:18.671687 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-604096fd-12d1-4fe2-9fbb-3b5eb0a352d9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:18.813311 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-604096fd-12d1-4fe2-9fbb-3b5eb0a352d9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:18.821529 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-604096fd-12d1-4fe2-9fbb-3b5eb0a352d9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.170629 Apr 05 12:12:18.822305 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1479/2936] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:18 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:18.921889 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-31321a49-5c72-4234-bc98-bf0de1ce6019 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:18.922549 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-31321a49-5c72-4234-bc98-bf0de1ce6019 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:18.931408 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-31321a49-5c72-4234-bc98-bf0de1ce6019 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:18.931855 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-31321a49-5c72-4234-bc98-bf0de1ce6019 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:18.932853 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-31321a49-5c72-4234-bc98-bf0de1ce6019 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:18.933442 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-31321a49-5c72-4234-bc98-bf0de1ce6019 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:19.053229 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d7991dee-334a-45f8-a015-14c70ba128d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:19.053843 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d7991dee-334a-45f8-a015-14c70ba128d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:19.059993 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d7991dee-334a-45f8-a015-14c70ba128d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:19.060482 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d7991dee-334a-45f8-a015-14c70ba128d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:19.061250 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d7991dee-334a-45f8-a015-14c70ba128d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:19.061682 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d7991dee-334a-45f8-a015-14c70ba128d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:19.073911 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-31321a49-5c72-4234-bc98-bf0de1ce6019 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:19.082177 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-31321a49-5c72-4234-bc98-bf0de1ce6019 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.164127 Apr 05 12:12:19.082761 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1458/2937] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:18 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:19.145421 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1e9d071b-011b-4efa-bfeb-03c55e8b0606 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:19.146244 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1e9d071b-011b-4efa-bfeb-03c55e8b0606 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:19.153746 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1e9d071b-011b-4efa-bfeb-03c55e8b0606 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:19.154180 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1e9d071b-011b-4efa-bfeb-03c55e8b0606 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:19.154943 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1e9d071b-011b-4efa-bfeb-03c55e8b0606 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:19.155368 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1e9d071b-011b-4efa-bfeb-03c55e8b0606 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:19.199029 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d7991dee-334a-45f8-a015-14c70ba128d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:19.207313 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d7991dee-334a-45f8-a015-14c70ba128d3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.157844 Apr 05 12:12:19.207948 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1480/2938] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:19 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:19.305633 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1e9d071b-011b-4efa-bfeb-03c55e8b0606 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:19.314257 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1e9d071b-011b-4efa-bfeb-03c55e8b0606 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:19.315761 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1e9d071b-011b-4efa-bfeb-03c55e8b0606 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:19.316938 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1e9d071b-011b-4efa-bfeb-03c55e8b0606 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.178715 Apr 05 12:12:19.317496 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1459/2939] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:19 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:12:19.838915 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-988b5bf4-75ea-49fd-a6db-b39fae3850cc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:19.839538 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-988b5bf4-75ea-49fd-a6db-b39fae3850cc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:19.846333 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-988b5bf4-75ea-49fd-a6db-b39fae3850cc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:19.846771 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-988b5bf4-75ea-49fd-a6db-b39fae3850cc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:19.847518 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-988b5bf4-75ea-49fd-a6db-b39fae3850cc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:19.847945 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-988b5bf4-75ea-49fd-a6db-b39fae3850cc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:19.983580 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-988b5bf4-75ea-49fd-a6db-b39fae3850cc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:19.991442 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-988b5bf4-75ea-49fd-a6db-b39fae3850cc tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.156451 Apr 05 12:12:19.992017 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1481/2940] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:19 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:20.103544 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-40f043d7-a5b1-486c-853a-e4d097204ee7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:20.104450 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-40f043d7-a5b1-486c-853a-e4d097204ee7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:20.114942 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-40f043d7-a5b1-486c-853a-e4d097204ee7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:20.115693 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-40f043d7-a5b1-486c-853a-e4d097204ee7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:20.117017 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-40f043d7-a5b1-486c-853a-e4d097204ee7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:20.117740 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-40f043d7-a5b1-486c-853a-e4d097204ee7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:20.224744 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6185f02f-9602-444d-8844-522413ab6f4c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:20.225354 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6185f02f-9602-444d-8844-522413ab6f4c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:20.231591 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6185f02f-9602-444d-8844-522413ab6f4c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:20.232039 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6185f02f-9602-444d-8844-522413ab6f4c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:20.232826 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6185f02f-9602-444d-8844-522413ab6f4c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:20.233265 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6185f02f-9602-444d-8844-522413ab6f4c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:20.263305 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-40f043d7-a5b1-486c-853a-e4d097204ee7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:20.271198 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-40f043d7-a5b1-486c-853a-e4d097204ee7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.174080 Apr 05 12:12:20.271778 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1460/2941] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:20 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:20.335049 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ab89c5fb-ff33-41ed-bc83-e47c14dc5f00 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:20.335899 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ab89c5fb-ff33-41ed-bc83-e47c14dc5f00 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:20.342114 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab89c5fb-ff33-41ed-bc83-e47c14dc5f00 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:20.342737 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab89c5fb-ff33-41ed-bc83-e47c14dc5f00 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:20.343502 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab89c5fb-ff33-41ed-bc83-e47c14dc5f00 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:20.343993 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab89c5fb-ff33-41ed-bc83-e47c14dc5f00 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:20.371687 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6185f02f-9602-444d-8844-522413ab6f4c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:20.380342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6185f02f-9602-444d-8844-522413ab6f4c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.159528 Apr 05 12:12:20.380983 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1482/2942] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:20 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:20.476347 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ab89c5fb-ff33-41ed-bc83-e47c14dc5f00 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:20.484706 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ab89c5fb-ff33-41ed-bc83-e47c14dc5f00 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:20.486319 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ab89c5fb-ff33-41ed-bc83-e47c14dc5f00 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:20.487561 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ab89c5fb-ff33-41ed-bc83-e47c14dc5f00 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.156497 Apr 05 12:12:20.488111 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1461/2943] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:20 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:21.008770 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b9ab0c95-64d3-4dcf-b977-f02aca9d344e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:21.009354 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b9ab0c95-64d3-4dcf-b977-f02aca9d344e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:21.015953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9ab0c95-64d3-4dcf-b977-f02aca9d344e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:21.016363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9ab0c95-64d3-4dcf-b977-f02aca9d344e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:21.017124 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9ab0c95-64d3-4dcf-b977-f02aca9d344e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:21.017555 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9ab0c95-64d3-4dcf-b977-f02aca9d344e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:21.153981 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b9ab0c95-64d3-4dcf-b977-f02aca9d344e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:21.162228 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b9ab0c95-64d3-4dcf-b977-f02aca9d344e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.157345 Apr 05 12:12:21.162783 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1483/2944] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:21 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:21.292902 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0ade022f-03a0-4b4f-8923-b83088c0167c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:21.293816 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0ade022f-03a0-4b4f-8923-b83088c0167c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:21.302300 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0ade022f-03a0-4b4f-8923-b83088c0167c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:21.302723 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0ade022f-03a0-4b4f-8923-b83088c0167c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:21.303512 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0ade022f-03a0-4b4f-8923-b83088c0167c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:21.303945 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0ade022f-03a0-4b4f-8923-b83088c0167c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:21.396913 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cf56e613-a753-4128-8c00-72db086b8f41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:21.397607 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cf56e613-a753-4128-8c00-72db086b8f41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:21.403802 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cf56e613-a753-4128-8c00-72db086b8f41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:21.404370 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cf56e613-a753-4128-8c00-72db086b8f41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:21.405257 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cf56e613-a753-4128-8c00-72db086b8f41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:21.405697 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cf56e613-a753-4128-8c00-72db086b8f41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:21.437756 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0ade022f-03a0-4b4f-8923-b83088c0167c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:21.446309 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0ade022f-03a0-4b4f-8923-b83088c0167c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.159959 Apr 05 12:12:21.446910 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1462/2945] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:21 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:21.506560 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fa8ebddf-7863-435d-9640-62683e3b0c7f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:21.507176 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fa8ebddf-7863-435d-9640-62683e3b0c7f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:21.513452 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fa8ebddf-7863-435d-9640-62683e3b0c7f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:21.513881 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fa8ebddf-7863-435d-9640-62683e3b0c7f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:21.514648 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fa8ebddf-7863-435d-9640-62683e3b0c7f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:21.515081 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fa8ebddf-7863-435d-9640-62683e3b0c7f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:21.548091 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cf56e613-a753-4128-8c00-72db086b8f41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:21.556191 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cf56e613-a753-4128-8c00-72db086b8f41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.163172 Apr 05 12:12:21.556774 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1484/2946] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:21 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:21.650572 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fa8ebddf-7863-435d-9640-62683e3b0c7f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:21.659266 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fa8ebddf-7863-435d-9640-62683e3b0c7f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:21.660812 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fa8ebddf-7863-435d-9640-62683e3b0c7f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:21.661971 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fa8ebddf-7863-435d-9640-62683e3b0c7f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.159725 Apr 05 12:12:21.662513 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1463/2947] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:21 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:22.186116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9fbe4138-c033-4351-8c5f-95bd6109fa68 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:22.187090 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9fbe4138-c033-4351-8c5f-95bd6109fa68 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:22.197577 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fbe4138-c033-4351-8c5f-95bd6109fa68 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:22.198315 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fbe4138-c033-4351-8c5f-95bd6109fa68 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:22.199544 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fbe4138-c033-4351-8c5f-95bd6109fa68 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:22.200317 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fbe4138-c033-4351-8c5f-95bd6109fa68 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:22.340287 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9fbe4138-c033-4351-8c5f-95bd6109fa68 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:22.348757 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9fbe4138-c033-4351-8c5f-95bd6109fa68 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.169181 Apr 05 12:12:22.349293 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1485/2948] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:22 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:22.468038 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9228d577-8875-4462-9865-aa9fc657d514 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:22.469151 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9228d577-8875-4462-9865-aa9fc657d514 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:22.476467 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9228d577-8875-4462-9865-aa9fc657d514 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:22.476923 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9228d577-8875-4462-9865-aa9fc657d514 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:22.477689 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9228d577-8875-4462-9865-aa9fc657d514 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:22.478128 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9228d577-8875-4462-9865-aa9fc657d514 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:22.575157 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-07a770fc-f8ed-4609-a374-25133b0f1166 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:22.575766 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-07a770fc-f8ed-4609-a374-25133b0f1166 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:22.582110 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-07a770fc-f8ed-4609-a374-25133b0f1166 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:22.582555 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-07a770fc-f8ed-4609-a374-25133b0f1166 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:22.583297 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-07a770fc-f8ed-4609-a374-25133b0f1166 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:22.583729 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-07a770fc-f8ed-4609-a374-25133b0f1166 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:22.615256 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9228d577-8875-4462-9865-aa9fc657d514 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:22.623406 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9228d577-8875-4462-9865-aa9fc657d514 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.161773 Apr 05 12:12:22.623983 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1464/2949] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:22 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:22.680543 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b2b892e0-6ff6-4243-9c42-9d9b0ef4ff90 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:22.681153 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b2b892e0-6ff6-4243-9c42-9d9b0ef4ff90 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:22.687557 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b2b892e0-6ff6-4243-9c42-9d9b0ef4ff90 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:22.688011 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b2b892e0-6ff6-4243-9c42-9d9b0ef4ff90 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:22.688808 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b2b892e0-6ff6-4243-9c42-9d9b0ef4ff90 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:22.689244 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b2b892e0-6ff6-4243-9c42-9d9b0ef4ff90 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:22.715472 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-07a770fc-f8ed-4609-a374-25133b0f1166 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:22.723682 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-07a770fc-f8ed-4609-a374-25133b0f1166 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.153852 Apr 05 12:12:22.724277 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1486/2950] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:22 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:22.826512 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b2b892e0-6ff6-4243-9c42-9d9b0ef4ff90 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:22.835152 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b2b892e0-6ff6-4243-9c42-9d9b0ef4ff90 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:22.836676 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b2b892e0-6ff6-4243-9c42-9d9b0ef4ff90 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:22.837854 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b2b892e0-6ff6-4243-9c42-9d9b0ef4ff90 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.161164 Apr 05 12:12:22.838404 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1465/2951] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:22 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:23.369787 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-aa1116b4-cf5e-47dc-951d-12f88818255f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:23.370601 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-aa1116b4-cf5e-47dc-951d-12f88818255f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:23.381795 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aa1116b4-cf5e-47dc-951d-12f88818255f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:23.382573 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aa1116b4-cf5e-47dc-951d-12f88818255f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:23.383882 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aa1116b4-cf5e-47dc-951d-12f88818255f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:23.384637 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aa1116b4-cf5e-47dc-951d-12f88818255f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:23.525365 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-aa1116b4-cf5e-47dc-951d-12f88818255f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:23.533554 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-aa1116b4-cf5e-47dc-951d-12f88818255f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.170565 Apr 05 12:12:23.534102 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1487/2952] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:23 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:23.645131 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1a17300a-6786-4bc0-9eb2-89d79c95747f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:23.646017 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1a17300a-6786-4bc0-9eb2-89d79c95747f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:23.656809 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1a17300a-6786-4bc0-9eb2-89d79c95747f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:23.657548 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1a17300a-6786-4bc0-9eb2-89d79c95747f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:23.658785 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1a17300a-6786-4bc0-9eb2-89d79c95747f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:23.659508 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1a17300a-6786-4bc0-9eb2-89d79c95747f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:23.740856 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4fd00975-0a4a-488b-a110-079c4c459de8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:23.741444 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4fd00975-0a4a-488b-a110-079c4c459de8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:23.747537 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4fd00975-0a4a-488b-a110-079c4c459de8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:23.747983 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4fd00975-0a4a-488b-a110-079c4c459de8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:23.748792 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4fd00975-0a4a-488b-a110-079c4c459de8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:23.749221 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4fd00975-0a4a-488b-a110-079c4c459de8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:23.798495 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1a17300a-6786-4bc0-9eb2-89d79c95747f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:23.807804 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1a17300a-6786-4bc0-9eb2-89d79c95747f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.169230 Apr 05 12:12:23.808588 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1466/2953] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:23 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:23.856154 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b38fe1eb-40a6-4c46-ac6b-0652974902f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:23.856800 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b38fe1eb-40a6-4c46-ac6b-0652974902f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:23.862663 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b38fe1eb-40a6-4c46-ac6b-0652974902f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:23.863111 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b38fe1eb-40a6-4c46-ac6b-0652974902f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:23.863870 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b38fe1eb-40a6-4c46-ac6b-0652974902f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:23.864334 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b38fe1eb-40a6-4c46-ac6b-0652974902f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:23.888160 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4fd00975-0a4a-488b-a110-079c4c459de8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:23.896129 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4fd00975-0a4a-488b-a110-079c4c459de8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.159055 Apr 05 12:12:23.896630 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1488/2954] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:23 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:12:24.001730 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b38fe1eb-40a6-4c46-ac6b-0652974902f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:24.011296 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b38fe1eb-40a6-4c46-ac6b-0652974902f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:24.012825 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b38fe1eb-40a6-4c46-ac6b-0652974902f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:24.014013 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b38fe1eb-40a6-4c46-ac6b-0652974902f4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.161864 Apr 05 12:12:24.014574 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1467/2955] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:23 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:12:24.554852 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a35adf00-1053-4695-af17-9ec5fff28f35 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:24.555922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a35adf00-1053-4695-af17-9ec5fff28f35 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:24.565795 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a35adf00-1053-4695-af17-9ec5fff28f35 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:24.566237 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a35adf00-1053-4695-af17-9ec5fff28f35 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:24.566982 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a35adf00-1053-4695-af17-9ec5fff28f35 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:24.567405 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a35adf00-1053-4695-af17-9ec5fff28f35 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:24.717659 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a35adf00-1053-4695-af17-9ec5fff28f35 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:24.726022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a35adf00-1053-4695-af17-9ec5fff28f35 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.177562 Apr 05 12:12:24.726602 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1489/2956] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:24 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:24.828372 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3f2b2303-e1e0-4b6a-a471-dfb27b57a78f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:24.828931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3f2b2303-e1e0-4b6a-a471-dfb27b57a78f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:24.835682 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f2b2303-e1e0-4b6a-a471-dfb27b57a78f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:24.836163 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f2b2303-e1e0-4b6a-a471-dfb27b57a78f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:24.836919 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f2b2303-e1e0-4b6a-a471-dfb27b57a78f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:24.837352 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f2b2303-e1e0-4b6a-a471-dfb27b57a78f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:24.913924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b1b57ed0-d9bc-4f6c-8be8-dfa91cd0ab6b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:24.914726 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b1b57ed0-d9bc-4f6c-8be8-dfa91cd0ab6b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:24.921351 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b1b57ed0-d9bc-4f6c-8be8-dfa91cd0ab6b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:24.921822 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b1b57ed0-d9bc-4f6c-8be8-dfa91cd0ab6b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:24.922578 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b1b57ed0-d9bc-4f6c-8be8-dfa91cd0ab6b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:24.923004 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b1b57ed0-d9bc-4f6c-8be8-dfa91cd0ab6b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:24.976304 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3f2b2303-e1e0-4b6a-a471-dfb27b57a78f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:24.984608 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3f2b2303-e1e0-4b6a-a471-dfb27b57a78f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.162691 Apr 05 12:12:24.985199 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1468/2957] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:24 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:25.031731 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ff9ae3be-6c8a-49dd-895c-089d755be755 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:25.032391 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ff9ae3be-6c8a-49dd-895c-089d755be755 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:25.038355 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff9ae3be-6c8a-49dd-895c-089d755be755 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:25.038849 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff9ae3be-6c8a-49dd-895c-089d755be755 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:25.039614 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff9ae3be-6c8a-49dd-895c-089d755be755 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:25.040053 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff9ae3be-6c8a-49dd-895c-089d755be755 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:25.054871 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b1b57ed0-d9bc-4f6c-8be8-dfa91cd0ab6b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:25.062938 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b1b57ed0-d9bc-4f6c-8be8-dfa91cd0ab6b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.152920 Apr 05 12:12:25.063596 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1490/2958] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:24 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:25.173957 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ff9ae3be-6c8a-49dd-895c-089d755be755 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:25.182504 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ff9ae3be-6c8a-49dd-895c-089d755be755 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:25.184009 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ff9ae3be-6c8a-49dd-895c-089d755be755 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:25.185209 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ff9ae3be-6c8a-49dd-895c-089d755be755 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.157371 Apr 05 12:12:25.185784 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1469/2959] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:25 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:25.745052 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4cda3fb9-c539-4e10-8c4d-4a7f256b4a83 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:25.745884 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4cda3fb9-c539-4e10-8c4d-4a7f256b4a83 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:25.754851 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cda3fb9-c539-4e10-8c4d-4a7f256b4a83 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:25.755436 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cda3fb9-c539-4e10-8c4d-4a7f256b4a83 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:25.756487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cda3fb9-c539-4e10-8c4d-4a7f256b4a83 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:25.757057 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cda3fb9-c539-4e10-8c4d-4a7f256b4a83 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:25.891137 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4cda3fb9-c539-4e10-8c4d-4a7f256b4a83 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:25.899708 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4cda3fb9-c539-4e10-8c4d-4a7f256b4a83 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.159992 Apr 05 12:12:25.900352 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1491/2960] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:25 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:26.006563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4116c9f3-c271-4e4e-9820-50118fe68e16 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:26.007425 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4116c9f3-c271-4e4e-9820-50118fe68e16 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:26.017784 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4116c9f3-c271-4e4e-9820-50118fe68e16 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:26.018543 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4116c9f3-c271-4e4e-9820-50118fe68e16 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:26.019788 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4116c9f3-c271-4e4e-9820-50118fe68e16 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:26.020563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4116c9f3-c271-4e4e-9820-50118fe68e16 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:26.079780 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8dff2eb2-fbb9-4ce8-b7ca-62c942a93fd3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:26.080415 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8dff2eb2-fbb9-4ce8-b7ca-62c942a93fd3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:26.086894 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8dff2eb2-fbb9-4ce8-b7ca-62c942a93fd3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:26.087353 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8dff2eb2-fbb9-4ce8-b7ca-62c942a93fd3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:26.088101 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8dff2eb2-fbb9-4ce8-b7ca-62c942a93fd3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:26.088613 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8dff2eb2-fbb9-4ce8-b7ca-62c942a93fd3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:26.168799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4116c9f3-c271-4e4e-9820-50118fe68e16 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:26.176836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4116c9f3-c271-4e4e-9820-50118fe68e16 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.177369 Apr 05 12:12:26.177440 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1470/2961] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:25 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:26.202738 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6d7f95ba-5672-45f2-beed-533caa319355 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:26.203502 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6d7f95ba-5672-45f2-beed-533caa319355 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:26.209347 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6d7f95ba-5672-45f2-beed-533caa319355 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:26.209801 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6d7f95ba-5672-45f2-beed-533caa319355 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:26.210558 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6d7f95ba-5672-45f2-beed-533caa319355 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:26.210973 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6d7f95ba-5672-45f2-beed-533caa319355 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:26.225443 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8dff2eb2-fbb9-4ce8-b7ca-62c942a93fd3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:26.233197 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8dff2eb2-fbb9-4ce8-b7ca-62c942a93fd3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.157397 Apr 05 12:12:26.233765 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1492/2962] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:26 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:26.343137 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6d7f95ba-5672-45f2-beed-533caa319355 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:26.351460 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6d7f95ba-5672-45f2-beed-533caa319355 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:26.352974 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6d7f95ba-5672-45f2-beed-533caa319355 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:26.354130 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6d7f95ba-5672-45f2-beed-533caa319355 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.155317 Apr 05 12:12:26.354661 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1471/2963] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:26 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:12:26.921302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6c73f808-c550-43d2-b92e-40a8785ac7a1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:26.922278 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6c73f808-c550-43d2-b92e-40a8785ac7a1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:26.933091 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6c73f808-c550-43d2-b92e-40a8785ac7a1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:26.933828 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6c73f808-c550-43d2-b92e-40a8785ac7a1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:26.935084 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6c73f808-c550-43d2-b92e-40a8785ac7a1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:26.935800 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6c73f808-c550-43d2-b92e-40a8785ac7a1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:27.078266 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6c73f808-c550-43d2-b92e-40a8785ac7a1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:27.086921 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6c73f808-c550-43d2-b92e-40a8785ac7a1 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.172092 Apr 05 12:12:27.087488 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1493/2964] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:26 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:27.198452 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-708d8cee-b297-421b-8f67-55edfb40f107 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:27.199392 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-708d8cee-b297-421b-8f67-55edfb40f107 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:27.207857 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-708d8cee-b297-421b-8f67-55edfb40f107 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:27.208407 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-708d8cee-b297-421b-8f67-55edfb40f107 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:27.209164 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-708d8cee-b297-421b-8f67-55edfb40f107 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:27.209602 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-708d8cee-b297-421b-8f67-55edfb40f107 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:27.250677 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9c5c72bd-7353-4bff-9870-beef018d23b3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:27.251283 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9c5c72bd-7353-4bff-9870-beef018d23b3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:27.258931 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9c5c72bd-7353-4bff-9870-beef018d23b3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:27.259689 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9c5c72bd-7353-4bff-9870-beef018d23b3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:27.260685 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9c5c72bd-7353-4bff-9870-beef018d23b3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:27.261189 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9c5c72bd-7353-4bff-9870-beef018d23b3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:27.356765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-708d8cee-b297-421b-8f67-55edfb40f107 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:27.365228 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-708d8cee-b297-421b-8f67-55edfb40f107 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.173345 Apr 05 12:12:27.366014 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1472/2965] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:27 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:27.373093 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-da06dd8d-8f27-4ec3-87bd-46c8656ab881 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:27.373746 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-da06dd8d-8f27-4ec3-87bd-46c8656ab881 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:27.381613 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-da06dd8d-8f27-4ec3-87bd-46c8656ab881 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:27.382154 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-da06dd8d-8f27-4ec3-87bd-46c8656ab881 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:27.383024 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-da06dd8d-8f27-4ec3-87bd-46c8656ab881 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:27.383546 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-da06dd8d-8f27-4ec3-87bd-46c8656ab881 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:27.407357 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9c5c72bd-7353-4bff-9870-beef018d23b3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:27.415114 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9c5c72bd-7353-4bff-9870-beef018d23b3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.168296 Apr 05 12:12:27.415717 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1494/2966] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:27 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:27.520677 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-da06dd8d-8f27-4ec3-87bd-46c8656ab881 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:27.529026 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-da06dd8d-8f27-4ec3-87bd-46c8656ab881 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:27.530484 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-da06dd8d-8f27-4ec3-87bd-46c8656ab881 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:27.531653 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-da06dd8d-8f27-4ec3-87bd-46c8656ab881 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.163255 Apr 05 12:12:27.532225 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1473/2967] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:27 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:12:28.112856 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-04b52693-bc18-4f5f-a800-624b9dba88a3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:28.113588 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-04b52693-bc18-4f5f-a800-624b9dba88a3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:28.121290 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-04b52693-bc18-4f5f-a800-624b9dba88a3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:28.121814 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-04b52693-bc18-4f5f-a800-624b9dba88a3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:28.122690 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-04b52693-bc18-4f5f-a800-624b9dba88a3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:28.123188 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-04b52693-bc18-4f5f-a800-624b9dba88a3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:28.265012 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-04b52693-bc18-4f5f-a800-624b9dba88a3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:28.273329 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-04b52693-bc18-4f5f-a800-624b9dba88a3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.166546 Apr 05 12:12:28.273887 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1495/2968] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:28 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:28.387102 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ff8d2555-5dd7-42c8-8cca-3f4c7da1e768 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:28.387974 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ff8d2555-5dd7-42c8-8cca-3f4c7da1e768 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:28.398337 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff8d2555-5dd7-42c8-8cca-3f4c7da1e768 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:28.399079 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff8d2555-5dd7-42c8-8cca-3f4c7da1e768 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:28.400349 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff8d2555-5dd7-42c8-8cca-3f4c7da1e768 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:28.401065 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ff8d2555-5dd7-42c8-8cca-3f4c7da1e768 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:28.432777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7aac7fb4-92b5-4ead-b1bd-502dffa69827 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:28.433367 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7aac7fb4-92b5-4ead-b1bd-502dffa69827 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:28.439434 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7aac7fb4-92b5-4ead-b1bd-502dffa69827 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:28.439891 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7aac7fb4-92b5-4ead-b1bd-502dffa69827 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:28.440741 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7aac7fb4-92b5-4ead-b1bd-502dffa69827 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:28.441153 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7aac7fb4-92b5-4ead-b1bd-502dffa69827 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:28.541747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ff8d2555-5dd7-42c8-8cca-3f4c7da1e768 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:28.550210 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ff8d2555-5dd7-42c8-8cca-3f4c7da1e768 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.169556 Apr 05 12:12:28.550789 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1474/2969] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:28 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:28.555356 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a215ad68-0c6a-4287-b31e-a23ff91e340e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:28.555955 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a215ad68-0c6a-4287-b31e-a23ff91e340e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:28.561921 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a215ad68-0c6a-4287-b31e-a23ff91e340e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:28.562431 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a215ad68-0c6a-4287-b31e-a23ff91e340e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:28.563195 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a215ad68-0c6a-4287-b31e-a23ff91e340e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:28.563622 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a215ad68-0c6a-4287-b31e-a23ff91e340e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:28.580851 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7aac7fb4-92b5-4ead-b1bd-502dffa69827 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:28.588451 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7aac7fb4-92b5-4ead-b1bd-502dffa69827 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.159574 Apr 05 12:12:28.589020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1496/2970] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:28 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:28.704614 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a215ad68-0c6a-4287-b31e-a23ff91e340e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:28.713348 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a215ad68-0c6a-4287-b31e-a23ff91e340e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:28.714896 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a215ad68-0c6a-4287-b31e-a23ff91e340e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:28.716062 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a215ad68-0c6a-4287-b31e-a23ff91e340e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.164329 Apr 05 12:12:28.716622 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1475/2971] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:28 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:29.295218 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-06ff0c25-ab29-4ccb-a253-4467d6cf228f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:29.296354 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-06ff0c25-ab29-4ccb-a253-4467d6cf228f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:29.306908 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-06ff0c25-ab29-4ccb-a253-4467d6cf228f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:29.307665 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-06ff0c25-ab29-4ccb-a253-4467d6cf228f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:29.308990 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-06ff0c25-ab29-4ccb-a253-4467d6cf228f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:29.309709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-06ff0c25-ab29-4ccb-a253-4467d6cf228f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:29.448403 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-06ff0c25-ab29-4ccb-a253-4467d6cf228f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:29.456826 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-06ff0c25-ab29-4ccb-a253-4467d6cf228f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.168322 Apr 05 12:12:29.457827 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1497/2972] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:29 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:29.571452 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f418cf7e-48a1-443a-a704-e0e28b7b495c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:29.572544 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f418cf7e-48a1-443a-a704-e0e28b7b495c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:29.581936 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f418cf7e-48a1-443a-a704-e0e28b7b495c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:29.582443 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f418cf7e-48a1-443a-a704-e0e28b7b495c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:29.583208 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f418cf7e-48a1-443a-a704-e0e28b7b495c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:29.583646 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f418cf7e-48a1-443a-a704-e0e28b7b495c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:29.606111 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-dc34e73f-7107-4326-9639-037e09a0cf55 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:29.606730 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-dc34e73f-7107-4326-9639-037e09a0cf55 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:29.612935 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dc34e73f-7107-4326-9639-037e09a0cf55 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:29.613351 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dc34e73f-7107-4326-9639-037e09a0cf55 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:29.614121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dc34e73f-7107-4326-9639-037e09a0cf55 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:29.614550 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dc34e73f-7107-4326-9639-037e09a0cf55 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:29.718570 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f418cf7e-48a1-443a-a704-e0e28b7b495c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:29.726393 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f418cf7e-48a1-443a-a704-e0e28b7b495c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.161489 Apr 05 12:12:29.726972 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1476/2973] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:29 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:29.734320 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b514efd2-0873-48be-a0cb-9ee464625163 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:29.734994 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b514efd2-0873-48be-a0cb-9ee464625163 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:29.740652 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b514efd2-0873-48be-a0cb-9ee464625163 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:29.741097 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b514efd2-0873-48be-a0cb-9ee464625163 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:29.741880 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b514efd2-0873-48be-a0cb-9ee464625163 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:29.742303 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b514efd2-0873-48be-a0cb-9ee464625163 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:29.748024 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-dc34e73f-7107-4326-9639-037e09a0cf55 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:29.756397 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-dc34e73f-7107-4326-9639-037e09a0cf55 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.154322 Apr 05 12:12:29.757269 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1498/2974] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:29 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:29.875932 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b514efd2-0873-48be-a0cb-9ee464625163 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:29.885259 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b514efd2-0873-48be-a0cb-9ee464625163 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:29.886968 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b514efd2-0873-48be-a0cb-9ee464625163 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:29.888158 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b514efd2-0873-48be-a0cb-9ee464625163 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.157435 Apr 05 12:12:29.888719 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1477/2975] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:29 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:12:30.475905 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a09d8a28-a3c9-4b1f-ab85-7062376c9d42 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:30.476701 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a09d8a28-a3c9-4b1f-ab85-7062376c9d42 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:30.484893 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a09d8a28-a3c9-4b1f-ab85-7062376c9d42 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:30.485428 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a09d8a28-a3c9-4b1f-ab85-7062376c9d42 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:30.486612 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a09d8a28-a3c9-4b1f-ab85-7062376c9d42 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:30.487044 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a09d8a28-a3c9-4b1f-ab85-7062376c9d42 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:30.627006 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a09d8a28-a3c9-4b1f-ab85-7062376c9d42 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:30.635506 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a09d8a28-a3c9-4b1f-ab85-7062376c9d42 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.164543 Apr 05 12:12:30.636102 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1499/2976] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:30 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:30.747847 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-edbd6998-9b6d-4f6d-9faf-fec5dfd7a7c6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:30.748754 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-edbd6998-9b6d-4f6d-9faf-fec5dfd7a7c6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:30.759663 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-edbd6998-9b6d-4f6d-9faf-fec5dfd7a7c6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:30.760492 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-edbd6998-9b6d-4f6d-9faf-fec5dfd7a7c6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:30.761730 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-edbd6998-9b6d-4f6d-9faf-fec5dfd7a7c6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:30.762493 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-edbd6998-9b6d-4f6d-9faf-fec5dfd7a7c6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:30.773706 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ab6e8109-bbec-4f24-a087-d42abea65f06 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:30.774314 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ab6e8109-bbec-4f24-a087-d42abea65f06 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:30.780522 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ab6e8109-bbec-4f24-a087-d42abea65f06 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:30.780974 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ab6e8109-bbec-4f24-a087-d42abea65f06 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:30.781729 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ab6e8109-bbec-4f24-a087-d42abea65f06 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:30.782160 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ab6e8109-bbec-4f24-a087-d42abea65f06 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:30.895393 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-edbd6998-9b6d-4f6d-9faf-fec5dfd7a7c6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:30.903493 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-edbd6998-9b6d-4f6d-9faf-fec5dfd7a7c6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.162070 Apr 05 12:12:30.904172 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1478/2977] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:30 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:30.911599 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3e825747-11a1-4ee9-bdf1-7716fa13ddd8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:30.912374 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3e825747-11a1-4ee9-bdf1-7716fa13ddd8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:30.918301 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ab6e8109-bbec-4f24-a087-d42abea65f06 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:30.918521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e825747-11a1-4ee9-bdf1-7716fa13ddd8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:30.918897 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e825747-11a1-4ee9-bdf1-7716fa13ddd8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:30.919656 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e825747-11a1-4ee9-bdf1-7716fa13ddd8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:30.920110 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e825747-11a1-4ee9-bdf1-7716fa13ddd8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:30.927081 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ab6e8109-bbec-4f24-a087-d42abea65f06 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.157196 Apr 05 12:12:30.927669 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1500/2978] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:30 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:31.060977 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3e825747-11a1-4ee9-bdf1-7716fa13ddd8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:31.069337 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3e825747-11a1-4ee9-bdf1-7716fa13ddd8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:31.070822 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3e825747-11a1-4ee9-bdf1-7716fa13ddd8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:31.072016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3e825747-11a1-4ee9-bdf1-7716fa13ddd8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.164208 Apr 05 12:12:31.072619 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1479/2979] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:30 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:12:31.656028 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-87f186b3-dda9-4373-96fc-aec27d7833c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:31.657050 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-87f186b3-dda9-4373-96fc-aec27d7833c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:31.664402 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-87f186b3-dda9-4373-96fc-aec27d7833c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:31.664845 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-87f186b3-dda9-4373-96fc-aec27d7833c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:31.665593 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-87f186b3-dda9-4373-96fc-aec27d7833c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:31.666014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-87f186b3-dda9-4373-96fc-aec27d7833c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:31.803463 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-87f186b3-dda9-4373-96fc-aec27d7833c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:31.811444 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-87f186b3-dda9-4373-96fc-aec27d7833c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.159912 Apr 05 12:12:31.812011 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1501/2980] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:31 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:31.926055 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d3549e86-4a72-4f56-9006-ae8f1f0cda98 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:31.927066 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d3549e86-4a72-4f56-9006-ae8f1f0cda98 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:31.937677 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d3549e86-4a72-4f56-9006-ae8f1f0cda98 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:31.938430 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d3549e86-4a72-4f56-9006-ae8f1f0cda98 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:31.939591 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d3549e86-4a72-4f56-9006-ae8f1f0cda98 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:31.940027 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d3549e86-4a72-4f56-9006-ae8f1f0cda98 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:31.948393 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-419d2d73-b46e-4573-b114-c22dd9d5811f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:31.949011 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-419d2d73-b46e-4573-b114-c22dd9d5811f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:31.956394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-419d2d73-b46e-4573-b114-c22dd9d5811f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:31.956853 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-419d2d73-b46e-4573-b114-c22dd9d5811f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:31.957618 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-419d2d73-b46e-4573-b114-c22dd9d5811f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:31.958039 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-419d2d73-b46e-4573-b114-c22dd9d5811f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:32.075611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d3549e86-4a72-4f56-9006-ae8f1f0cda98 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:32.083901 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d3549e86-4a72-4f56-9006-ae8f1f0cda98 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.164437 Apr 05 12:12:32.084742 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1480/2981] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:31 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:32.088884 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-419d2d73-b46e-4573-b114-c22dd9d5811f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:32.096724 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-419d2d73-b46e-4573-b114-c22dd9d5811f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.152828 Apr 05 12:12:32.097280 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1502/2982] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:31 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:32.106184 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-eeffdbce-2786-48f4-bb30-a41bcab38206 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:32.106184 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-eeffdbce-2786-48f4-bb30-a41bcab38206 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:32.106184 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eeffdbce-2786-48f4-bb30-a41bcab38206 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:32.106184 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eeffdbce-2786-48f4-bb30-a41bcab38206 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:32.106607 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eeffdbce-2786-48f4-bb30-a41bcab38206 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:32.106607 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eeffdbce-2786-48f4-bb30-a41bcab38206 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:32.241734 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-eeffdbce-2786-48f4-bb30-a41bcab38206 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:32.251805 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-eeffdbce-2786-48f4-bb30-a41bcab38206 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:32.253329 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-eeffdbce-2786-48f4-bb30-a41bcab38206 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:32.254803 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-eeffdbce-2786-48f4-bb30-a41bcab38206 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.160820 Apr 05 12:12:32.255383 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1481/2983] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:32 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:32.833080 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5a65188d-7176-4661-a3fe-059c1059344b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:32.834002 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5a65188d-7176-4661-a3fe-059c1059344b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:32.844517 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5a65188d-7176-4661-a3fe-059c1059344b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:32.845248 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5a65188d-7176-4661-a3fe-059c1059344b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:32.846496 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5a65188d-7176-4661-a3fe-059c1059344b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:32.847226 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5a65188d-7176-4661-a3fe-059c1059344b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:33.041807 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5a65188d-7176-4661-a3fe-059c1059344b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:33.049930 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5a65188d-7176-4661-a3fe-059c1059344b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.223538 Apr 05 12:12:33.050494 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1503/2984] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:32 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:33.105031 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d7ebcf77-68fd-497a-8d6e-43291a0b248e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:33.105992 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d7ebcf77-68fd-497a-8d6e-43291a0b248e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:33.116581 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-551064b4-1af0-467b-ad09-501fa5052d04 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:33.117120 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d7ebcf77-68fd-497a-8d6e-43291a0b248e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:33.117753 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-551064b4-1af0-467b-ad09-501fa5052d04 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:33.117990 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d7ebcf77-68fd-497a-8d6e-43291a0b248e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:33.119157 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d7ebcf77-68fd-497a-8d6e-43291a0b248e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:33.120189 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d7ebcf77-68fd-497a-8d6e-43291a0b248e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:33.127388 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-551064b4-1af0-467b-ad09-501fa5052d04 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:33.127838 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-551064b4-1af0-467b-ad09-501fa5052d04 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:33.128953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-551064b4-1af0-467b-ad09-501fa5052d04 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:33.129382 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-551064b4-1af0-467b-ad09-501fa5052d04 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:33.268151 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-551064b4-1af0-467b-ad09-501fa5052d04 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:33.275976 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-551064b4-1af0-467b-ad09-501fa5052d04 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.165524 Apr 05 12:12:33.276585 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1504/2985] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:33 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:33.281462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4a94a85d-423f-4f2a-8aac-fb6578e03af2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:33.282384 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4a94a85d-423f-4f2a-8aac-fb6578e03af2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:33.288910 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a94a85d-423f-4f2a-8aac-fb6578e03af2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:33.289360 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a94a85d-423f-4f2a-8aac-fb6578e03af2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:33.290120 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a94a85d-423f-4f2a-8aac-fb6578e03af2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:33.290552 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a94a85d-423f-4f2a-8aac-fb6578e03af2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:33.303136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d7ebcf77-68fd-497a-8d6e-43291a0b248e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:33.311107 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d7ebcf77-68fd-497a-8d6e-43291a0b248e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.212624 Apr 05 12:12:33.311677 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1482/2986] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:33 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:33.423049 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4a94a85d-423f-4f2a-8aac-fb6578e03af2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:33.432100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4a94a85d-423f-4f2a-8aac-fb6578e03af2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:33.433703 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4a94a85d-423f-4f2a-8aac-fb6578e03af2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:33.434843 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4a94a85d-423f-4f2a-8aac-fb6578e03af2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.157383 Apr 05 12:12:33.435410 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1505/2987] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:33 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:34.071487 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bc979527-fe2d-40b2-822c-9f37117eb0cd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:34.072590 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bc979527-fe2d-40b2-822c-9f37117eb0cd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:34.082677 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bc979527-fe2d-40b2-822c-9f37117eb0cd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:34.083412 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bc979527-fe2d-40b2-822c-9f37117eb0cd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:34.084724 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bc979527-fe2d-40b2-822c-9f37117eb0cd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:34.085438 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bc979527-fe2d-40b2-822c-9f37117eb0cd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:34.234569 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-bc979527-fe2d-40b2-822c-9f37117eb0cd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:34.242470 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bc979527-fe2d-40b2-822c-9f37117eb0cd tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.177526 Apr 05 12:12:34.243029 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1483/2988] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:34 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:34.294149 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a5c3a88c-4412-4889-a0a1-fd211653b1ce tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:34.294745 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a5c3a88c-4412-4889-a0a1-fd211653b1ce tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:34.302167 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5c3a88c-4412-4889-a0a1-fd211653b1ce tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:34.302617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5c3a88c-4412-4889-a0a1-fd211653b1ce tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:34.303387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5c3a88c-4412-4889-a0a1-fd211653b1ce tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:34.303821 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a5c3a88c-4412-4889-a0a1-fd211653b1ce tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:34.328576 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3cf6e183-6b37-4c43-9581-07b925ff1939 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:34.329140 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3cf6e183-6b37-4c43-9581-07b925ff1939 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:34.335579 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3cf6e183-6b37-4c43-9581-07b925ff1939 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:34.336041 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3cf6e183-6b37-4c43-9581-07b925ff1939 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:34.336847 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3cf6e183-6b37-4c43-9581-07b925ff1939 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:34.337282 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3cf6e183-6b37-4c43-9581-07b925ff1939 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:34.442983 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a5c3a88c-4412-4889-a0a1-fd211653b1ce tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:34.452433 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a5c3a88c-4412-4889-a0a1-fd211653b1ce tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.162139 Apr 05 12:12:34.453022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1506/2989] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:34 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:34.457805 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c81d0cd2-81ed-4c03-ba87-eeb3983318ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:34.458406 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c81d0cd2-81ed-4c03-ba87-eeb3983318ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:34.464118 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c81d0cd2-81ed-4c03-ba87-eeb3983318ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:34.464576 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c81d0cd2-81ed-4c03-ba87-eeb3983318ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:34.465371 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c81d0cd2-81ed-4c03-ba87-eeb3983318ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:34.465802 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c81d0cd2-81ed-4c03-ba87-eeb3983318ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:34.473737 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3cf6e183-6b37-4c43-9581-07b925ff1939 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:34.481467 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3cf6e183-6b37-4c43-9581-07b925ff1939 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.156821 Apr 05 12:12:34.482040 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1484/2990] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:34 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:34.595598 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c81d0cd2-81ed-4c03-ba87-eeb3983318ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:34.604468 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c81d0cd2-81ed-4c03-ba87-eeb3983318ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:34.605977 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c81d0cd2-81ed-4c03-ba87-eeb3983318ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:34.607148 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c81d0cd2-81ed-4c03-ba87-eeb3983318ea tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.153183 Apr 05 12:12:34.607712 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1507/2991] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:34 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:35.264380 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e180fde1-8948-47b5-915a-8011d9fce399 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:35.265385 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e180fde1-8948-47b5-915a-8011d9fce399 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:35.273189 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e180fde1-8948-47b5-915a-8011d9fce399 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:35.273664 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e180fde1-8948-47b5-915a-8011d9fce399 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:35.274475 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e180fde1-8948-47b5-915a-8011d9fce399 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:35.274947 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e180fde1-8948-47b5-915a-8011d9fce399 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:35.420135 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e180fde1-8948-47b5-915a-8011d9fce399 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:35.431400 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e180fde1-8948-47b5-915a-8011d9fce399 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.173260 Apr 05 12:12:35.432236 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1485/2992] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:35 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:35.469624 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-14cdc246-6fd6-4b90-aa36-2541daaf76a5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:35.470183 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-14cdc246-6fd6-4b90-aa36-2541daaf76a5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:35.476851 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14cdc246-6fd6-4b90-aa36-2541daaf76a5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:35.477294 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14cdc246-6fd6-4b90-aa36-2541daaf76a5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:35.478035 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14cdc246-6fd6-4b90-aa36-2541daaf76a5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:35.478455 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-14cdc246-6fd6-4b90-aa36-2541daaf76a5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:35.498821 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d463a117-7e11-4cdf-965b-488c3361f73f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:35.499401 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d463a117-7e11-4cdf-965b-488c3361f73f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:35.506244 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d463a117-7e11-4cdf-965b-488c3361f73f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:35.506693 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d463a117-7e11-4cdf-965b-488c3361f73f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:35.507459 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d463a117-7e11-4cdf-965b-488c3361f73f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:35.507887 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d463a117-7e11-4cdf-965b-488c3361f73f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:35.615918 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-14cdc246-6fd6-4b90-aa36-2541daaf76a5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:35.624301 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-14cdc246-6fd6-4b90-aa36-2541daaf76a5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.158464 Apr 05 12:12:35.624895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1508/2993] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:35 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:12:35.629866 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8655baaa-de3c-4fe8-81d2-dc1252cb4b08 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:35.630795 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8655baaa-de3c-4fe8-81d2-dc1252cb4b08 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:35.636355 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8655baaa-de3c-4fe8-81d2-dc1252cb4b08 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:35.636811 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8655baaa-de3c-4fe8-81d2-dc1252cb4b08 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:35.637604 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8655baaa-de3c-4fe8-81d2-dc1252cb4b08 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:35.638155 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8655baaa-de3c-4fe8-81d2-dc1252cb4b08 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:35.640814 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d463a117-7e11-4cdf-965b-488c3361f73f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:35.648725 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d463a117-7e11-4cdf-965b-488c3361f73f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.153828 Apr 05 12:12:35.649386 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1486/2994] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:35 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:35.771315 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8655baaa-de3c-4fe8-81d2-dc1252cb4b08 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:35.780034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8655baaa-de3c-4fe8-81d2-dc1252cb4b08 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:35.781568 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8655baaa-de3c-4fe8-81d2-dc1252cb4b08 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:35.782733 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8655baaa-de3c-4fe8-81d2-dc1252cb4b08 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.156902 Apr 05 12:12:35.783267 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1509/2995] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:35 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:36.453815 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cd6bf7eb-7269-496b-ac09-9074c3a897a0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:36.454756 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cd6bf7eb-7269-496b-ac09-9074c3a897a0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:36.462966 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd6bf7eb-7269-496b-ac09-9074c3a897a0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:36.463415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd6bf7eb-7269-496b-ac09-9074c3a897a0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:36.464196 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd6bf7eb-7269-496b-ac09-9074c3a897a0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:36.464635 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd6bf7eb-7269-496b-ac09-9074c3a897a0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:36.602088 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-cd6bf7eb-7269-496b-ac09-9074c3a897a0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:36.610609 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cd6bf7eb-7269-496b-ac09-9074c3a897a0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.163207 Apr 05 12:12:36.611176 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1487/2996] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:36 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:36.644452 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c45765fd-a968-4f38-b26a-921793adc519 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:36.645061 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c45765fd-a968-4f38-b26a-921793adc519 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:36.651472 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c45765fd-a968-4f38-b26a-921793adc519 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:36.651924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c45765fd-a968-4f38-b26a-921793adc519 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:36.652709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c45765fd-a968-4f38-b26a-921793adc519 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:36.653140 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c45765fd-a968-4f38-b26a-921793adc519 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:36.666142 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-60cec497-3412-4568-88b1-ae22f927ac6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:36.666868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-60cec497-3412-4568-88b1-ae22f927ac6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:36.673100 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-60cec497-3412-4568-88b1-ae22f927ac6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:36.673547 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-60cec497-3412-4568-88b1-ae22f927ac6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:36.674311 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-60cec497-3412-4568-88b1-ae22f927ac6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:36.674742 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-60cec497-3412-4568-88b1-ae22f927ac6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:36.791542 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c45765fd-a968-4f38-b26a-921793adc519 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:36.799482 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c45765fd-a968-4f38-b26a-921793adc519 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.160516 Apr 05 12:12:36.800224 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1510/2997] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:36 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:36.804727 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-94035ab4-44cf-4559-8b19-5fb7fe8607b9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:36.805447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-94035ab4-44cf-4559-8b19-5fb7fe8607b9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:36.811129 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94035ab4-44cf-4559-8b19-5fb7fe8607b9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:36.811574 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94035ab4-44cf-4559-8b19-5fb7fe8607b9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:36.812369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94035ab4-44cf-4559-8b19-5fb7fe8607b9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:36.812803 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94035ab4-44cf-4559-8b19-5fb7fe8607b9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:36.816591 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-60cec497-3412-4568-88b1-ae22f927ac6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:36.824405 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-60cec497-3412-4568-88b1-ae22f927ac6e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.162011 Apr 05 12:12:36.824976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1488/2998] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:36 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:36.948351 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-94035ab4-44cf-4559-8b19-5fb7fe8607b9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:36.957382 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-94035ab4-44cf-4559-8b19-5fb7fe8607b9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:36.958868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-94035ab4-44cf-4559-8b19-5fb7fe8607b9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:36.960016 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-94035ab4-44cf-4559-8b19-5fb7fe8607b9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.158899 Apr 05 12:12:36.960606 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1511/2999] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:36 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:37.632639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1d69c37a-0f7e-4311-929f-f776dd8c581a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:37.633647 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1d69c37a-0f7e-4311-929f-f776dd8c581a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:37.644202 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1d69c37a-0f7e-4311-929f-f776dd8c581a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:37.644958 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1d69c37a-0f7e-4311-929f-f776dd8c581a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:37.646203 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1d69c37a-0f7e-4311-929f-f776dd8c581a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:37.646935 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1d69c37a-0f7e-4311-929f-f776dd8c581a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:37.789682 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1d69c37a-0f7e-4311-929f-f776dd8c581a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:37.801590 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1d69c37a-0f7e-4311-929f-f776dd8c581a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.175549 Apr 05 12:12:37.802344 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1489/3000] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:37 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:37.816757 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-513f9a08-d7f8-4c9c-8b58-1038009a1761 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:37.817391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-513f9a08-d7f8-4c9c-8b58-1038009a1761 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:37.823846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-513f9a08-d7f8-4c9c-8b58-1038009a1761 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:37.824348 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-513f9a08-d7f8-4c9c-8b58-1038009a1761 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:37.825089 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-513f9a08-d7f8-4c9c-8b58-1038009a1761 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:37.825520 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-513f9a08-d7f8-4c9c-8b58-1038009a1761 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:37.841292 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3b35f604-54e5-4150-88c9-a0bc85c8a4fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:37.841924 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3b35f604-54e5-4150-88c9-a0bc85c8a4fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:37.848336 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b35f604-54e5-4150-88c9-a0bc85c8a4fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:37.848793 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b35f604-54e5-4150-88c9-a0bc85c8a4fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:37.849566 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b35f604-54e5-4150-88c9-a0bc85c8a4fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:37.850003 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b35f604-54e5-4150-88c9-a0bc85c8a4fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:37.967637 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-513f9a08-d7f8-4c9c-8b58-1038009a1761 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:37.975592 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-513f9a08-d7f8-4c9c-8b58-1038009a1761 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.162772 Apr 05 12:12:37.976460 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1512/3001] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:37 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:37.980964 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1742e850-ac2d-4862-a4e3-87dc7a4e9840 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:37.981556 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1742e850-ac2d-4862-a4e3-87dc7a4e9840 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:37.987021 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1742e850-ac2d-4862-a4e3-87dc7a4e9840 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:37.987578 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1742e850-ac2d-4862-a4e3-87dc7a4e9840 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:37.988418 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1742e850-ac2d-4862-a4e3-87dc7a4e9840 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:37.988784 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1742e850-ac2d-4862-a4e3-87dc7a4e9840 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:37.992811 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3b35f604-54e5-4150-88c9-a0bc85c8a4fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:38.000777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3b35f604-54e5-4150-88c9-a0bc85c8a4fb tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.163351 Apr 05 12:12:38.001354 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1490/3002] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:37 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:38.123723 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1742e850-ac2d-4862-a4e3-87dc7a4e9840 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:38.136135 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1742e850-ac2d-4862-a4e3-87dc7a4e9840 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:38.138550 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1742e850-ac2d-4862-a4e3-87dc7a4e9840 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:38.140260 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1742e850-ac2d-4862-a4e3-87dc7a4e9840 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.162600 Apr 05 12:12:38.141017 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1513/3003] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:37 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:38.822991 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8f917b6d-375c-41ef-afae-9b6bf1df7eec tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:38.823816 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8f917b6d-375c-41ef-afae-9b6bf1df7eec tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:38.833423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f917b6d-375c-41ef-afae-9b6bf1df7eec tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:38.833881 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f917b6d-375c-41ef-afae-9b6bf1df7eec tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:38.834648 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f917b6d-375c-41ef-afae-9b6bf1df7eec tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:38.835091 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f917b6d-375c-41ef-afae-9b6bf1df7eec tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:38.974063 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8f917b6d-375c-41ef-afae-9b6bf1df7eec tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:38.981851 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8f917b6d-375c-41ef-afae-9b6bf1df7eec tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.165536 Apr 05 12:12:38.982639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1491/3004] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:38 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:38.992882 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-891cb2b2-e747-499d-8b9c-c4f3f02a86e5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:38.993488 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-891cb2b2-e747-499d-8b9c-c4f3f02a86e5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:38.999745 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-891cb2b2-e747-499d-8b9c-c4f3f02a86e5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:39.000274 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-891cb2b2-e747-499d-8b9c-c4f3f02a86e5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:39.001154 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-891cb2b2-e747-499d-8b9c-c4f3f02a86e5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:39.001462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-891cb2b2-e747-499d-8b9c-c4f3f02a86e5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:39.018193 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-713dca1c-796b-463c-8e1b-3e2fdb69af6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:39.019031 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-713dca1c-796b-463c-8e1b-3e2fdb69af6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:39.024906 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-713dca1c-796b-463c-8e1b-3e2fdb69af6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:39.025351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-713dca1c-796b-463c-8e1b-3e2fdb69af6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:39.026125 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-713dca1c-796b-463c-8e1b-3e2fdb69af6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:39.026549 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-713dca1c-796b-463c-8e1b-3e2fdb69af6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:39.146080 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-891cb2b2-e747-499d-8b9c-c4f3f02a86e5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:39.154276 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-891cb2b2-e747-499d-8b9c-c4f3f02a86e5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.165211 Apr 05 12:12:39.154845 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1514/3005] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:38 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:39.159224 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-82e6baf5-095e-49ca-9922-53f5b577910c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:39.159909 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-713dca1c-796b-463c-8e1b-3e2fdb69af6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:39.160184 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-82e6baf5-095e-49ca-9922-53f5b577910c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:39.165896 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-82e6baf5-095e-49ca-9922-53f5b577910c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:39.166335 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-82e6baf5-095e-49ca-9922-53f5b577910c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:39.167100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-82e6baf5-095e-49ca-9922-53f5b577910c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:39.167527 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-82e6baf5-095e-49ca-9922-53f5b577910c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:39.168823 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-713dca1c-796b-463c-8e1b-3e2fdb69af6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.154495 Apr 05 12:12:39.169473 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1492/3006] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:39 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:12:39.299256 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-82e6baf5-095e-49ca-9922-53f5b577910c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:39.308105 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-82e6baf5-095e-49ca-9922-53f5b577910c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:39.309574 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-82e6baf5-095e-49ca-9922-53f5b577910c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:39.310719 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-82e6baf5-095e-49ca-9922-53f5b577910c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.154999 Apr 05 12:12:39.311316 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1515/3007] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:39 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:40.003292 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-97c32ef3-4b1e-4e45-a137-d71b828fda18 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:40.004499 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-97c32ef3-4b1e-4e45-a137-d71b828fda18 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:40.013138 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-97c32ef3-4b1e-4e45-a137-d71b828fda18 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:40.013736 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-97c32ef3-4b1e-4e45-a137-d71b828fda18 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:40.014744 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-97c32ef3-4b1e-4e45-a137-d71b828fda18 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:40.015326 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-97c32ef3-4b1e-4e45-a137-d71b828fda18 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:40.156565 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-97c32ef3-4b1e-4e45-a137-d71b828fda18 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:40.164732 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-97c32ef3-4b1e-4e45-a137-d71b828fda18 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.168085 Apr 05 12:12:40.165300 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1493/3008] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:39 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:40.170744 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-174f9f56-4ab0-4648-a9f3-27ed6d7c8573 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:40.171325 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-174f9f56-4ab0-4648-a9f3-27ed6d7c8573 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:40.178242 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-174f9f56-4ab0-4648-a9f3-27ed6d7c8573 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:40.178692 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-174f9f56-4ab0-4648-a9f3-27ed6d7c8573 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:40.179445 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-174f9f56-4ab0-4648-a9f3-27ed6d7c8573 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:40.179876 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-174f9f56-4ab0-4648-a9f3-27ed6d7c8573 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:40.185901 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a32e1af3-da34-4673-9d21-ca19b1495d66 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:40.186505 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a32e1af3-da34-4673-9d21-ca19b1495d66 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:40.192424 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a32e1af3-da34-4673-9d21-ca19b1495d66 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:40.192865 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a32e1af3-da34-4673-9d21-ca19b1495d66 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:40.193615 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a32e1af3-da34-4673-9d21-ca19b1495d66 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:40.194037 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a32e1af3-da34-4673-9d21-ca19b1495d66 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:40.317401 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-174f9f56-4ab0-4648-a9f3-27ed6d7c8573 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:40.325573 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-174f9f56-4ab0-4648-a9f3-27ed6d7c8573 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.158722 Apr 05 12:12:40.326136 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1516/3009] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:40 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:40.326363 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a32e1af3-da34-4673-9d21-ca19b1495d66 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:40.330558 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a84b1299-e76e-44b2-9a41-c573ddb9ea42 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:40.331290 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a84b1299-e76e-44b2-9a41-c573ddb9ea42 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:40.334276 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a32e1af3-da34-4673-9d21-ca19b1495d66 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.152067 Apr 05 12:12:40.336116 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1494/3010] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:40 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:12:40.337027 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a84b1299-e76e-44b2-9a41-c573ddb9ea42 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:40.337470 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a84b1299-e76e-44b2-9a41-c573ddb9ea42 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:40.338220 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a84b1299-e76e-44b2-9a41-c573ddb9ea42 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:40.338647 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a84b1299-e76e-44b2-9a41-c573ddb9ea42 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:40.474230 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a84b1299-e76e-44b2-9a41-c573ddb9ea42 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:40.482806 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a84b1299-e76e-44b2-9a41-c573ddb9ea42 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:40.484322 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a84b1299-e76e-44b2-9a41-c573ddb9ea42 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:40.485479 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a84b1299-e76e-44b2-9a41-c573ddb9ea42 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.158409 Apr 05 12:12:40.486005 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1517/3011] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:40 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:41.186074 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1e2b84f2-fb8f-4392-a470-34c27d4af29a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:41.187127 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1e2b84f2-fb8f-4392-a470-34c27d4af29a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:41.197917 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1e2b84f2-fb8f-4392-a470-34c27d4af29a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:41.198677 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1e2b84f2-fb8f-4392-a470-34c27d4af29a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:41.199942 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1e2b84f2-fb8f-4392-a470-34c27d4af29a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:41.200716 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1e2b84f2-fb8f-4392-a470-34c27d4af29a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:41.343101 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d7436bb4-4d41-48f6-8892-0762cd16bd30 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:41.343649 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d7436bb4-4d41-48f6-8892-0762cd16bd30 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:41.350284 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d7436bb4-4d41-48f6-8892-0762cd16bd30 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:41.350702 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d7436bb4-4d41-48f6-8892-0762cd16bd30 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:41.351414 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1e2b84f2-fb8f-4392-a470-34c27d4af29a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:41.351543 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d7436bb4-4d41-48f6-8892-0762cd16bd30 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:41.351908 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d7436bb4-4d41-48f6-8892-0762cd16bd30 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:41.359850 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1e2b84f2-fb8f-4392-a470-34c27d4af29a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.180276 Apr 05 12:12:41.360448 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1495/3012] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:41 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:41.365095 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5cffaead-f829-4060-9c04-71dbf85648d0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:41.365689 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5cffaead-f829-4060-9c04-71dbf85648d0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:41.371541 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5cffaead-f829-4060-9c04-71dbf85648d0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:41.371994 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5cffaead-f829-4060-9c04-71dbf85648d0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:41.372824 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5cffaead-f829-4060-9c04-71dbf85648d0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:41.373256 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5cffaead-f829-4060-9c04-71dbf85648d0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:41.488430 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d7436bb4-4d41-48f6-8892-0762cd16bd30 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:41.496473 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d7436bb4-4d41-48f6-8892-0762cd16bd30 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.157321 Apr 05 12:12:41.497081 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1518/3013] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:41 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:41.506047 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3061d645-8671-48cf-94f6-05077e42f9c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:41.506677 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3061d645-8671-48cf-94f6-05077e42f9c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:41.509709 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5cffaead-f829-4060-9c04-71dbf85648d0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:41.512879 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3061d645-8671-48cf-94f6-05077e42f9c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:41.513331 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3061d645-8671-48cf-94f6-05077e42f9c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:41.514089 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3061d645-8671-48cf-94f6-05077e42f9c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:41.514521 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3061d645-8671-48cf-94f6-05077e42f9c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:41.517580 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5cffaead-f829-4060-9c04-71dbf85648d0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.156215 Apr 05 12:12:41.518193 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1496/3014] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:41 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:41.646963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3061d645-8671-48cf-94f6-05077e42f9c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:41.655989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3061d645-8671-48cf-94f6-05077e42f9c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:41.657511 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3061d645-8671-48cf-94f6-05077e42f9c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:41.658668 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3061d645-8671-48cf-94f6-05077e42f9c7 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.156839 Apr 05 12:12:41.659261 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1519/3015] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:41 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:42.381740 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f7e4dcea-8ed9-4797-8743-9873322adc76 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:42.382729 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f7e4dcea-8ed9-4797-8743-9873322adc76 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:42.393477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f7e4dcea-8ed9-4797-8743-9873322adc76 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:42.394115 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f7e4dcea-8ed9-4797-8743-9873322adc76 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:42.395349 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f7e4dcea-8ed9-4797-8743-9873322adc76 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:42.396057 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f7e4dcea-8ed9-4797-8743-9873322adc76 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:42.514119 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-41bfe3a4-7c00-497a-a910-cd17020b5cb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:42.514814 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-41bfe3a4-7c00-497a-a910-cd17020b5cb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:42.521189 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-41bfe3a4-7c00-497a-a910-cd17020b5cb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:42.521732 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-41bfe3a4-7c00-497a-a910-cd17020b5cb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:42.522615 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-41bfe3a4-7c00-497a-a910-cd17020b5cb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:42.523115 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-41bfe3a4-7c00-497a-a910-cd17020b5cb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:42.541872 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f7e4dcea-8ed9-4797-8743-9873322adc76 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:42.549939 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f7e4dcea-8ed9-4797-8743-9873322adc76 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.175049 Apr 05 12:12:42.550492 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1497/3016] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:42 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:42.554941 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-01140007-f198-425b-8ce7-a52b8ca852ef tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:42.555541 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-01140007-f198-425b-8ce7-a52b8ca852ef tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:42.561850 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-01140007-f198-425b-8ce7-a52b8ca852ef tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:42.562298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-01140007-f198-425b-8ce7-a52b8ca852ef tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:42.563073 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-01140007-f198-425b-8ce7-a52b8ca852ef tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:42.563472 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-01140007-f198-425b-8ce7-a52b8ca852ef tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:42.658095 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-41bfe3a4-7c00-497a-a910-cd17020b5cb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:42.666115 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-41bfe3a4-7c00-497a-a910-cd17020b5cb2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.155865 Apr 05 12:12:42.666693 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1520/3017] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:42 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:12:42.676556 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7e8b3a38-d08f-4de4-a19b-7450b3421f71 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:42.677198 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7e8b3a38-d08f-4de4-a19b-7450b3421f71 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:42.682873 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7e8b3a38-d08f-4de4-a19b-7450b3421f71 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:42.683335 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7e8b3a38-d08f-4de4-a19b-7450b3421f71 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:42.684116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7e8b3a38-d08f-4de4-a19b-7450b3421f71 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:42.684555 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7e8b3a38-d08f-4de4-a19b-7450b3421f71 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:42.695855 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-01140007-f198-425b-8ce7-a52b8ca852ef tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:42.704282 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-01140007-f198-425b-8ce7-a52b8ca852ef tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.152777 Apr 05 12:12:42.704855 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1498/3018] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:42 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:42.816271 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7e8b3a38-d08f-4de4-a19b-7450b3421f71 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:42.827556 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7e8b3a38-d08f-4de4-a19b-7450b3421f71 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:42.830067 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7e8b3a38-d08f-4de4-a19b-7450b3421f71 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:42.831946 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7e8b3a38-d08f-4de4-a19b-7450b3421f71 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.158838 Apr 05 12:12:42.832607 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1521/3019] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:42 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:12:43.569486 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9fd2a1cc-facf-470a-9672-7a6a7142163a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:43.570211 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9fd2a1cc-facf-470a-9672-7a6a7142163a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:43.577995 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9fd2a1cc-facf-470a-9672-7a6a7142163a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:43.578531 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9fd2a1cc-facf-470a-9672-7a6a7142163a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:43.579426 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9fd2a1cc-facf-470a-9672-7a6a7142163a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:43.579944 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9fd2a1cc-facf-470a-9672-7a6a7142163a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:43.683297 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a7fde94c-378d-484d-a862-56fcecb9c109 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:43.683890 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a7fde94c-378d-484d-a862-56fcecb9c109 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:43.691037 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7fde94c-378d-484d-a862-56fcecb9c109 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:43.691522 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7fde94c-378d-484d-a862-56fcecb9c109 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:43.692336 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7fde94c-378d-484d-a862-56fcecb9c109 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:43.692775 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a7fde94c-378d-484d-a862-56fcecb9c109 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:43.719166 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9fd2a1cc-facf-470a-9672-7a6a7142163a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:43.727508 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9fd2a1cc-facf-470a-9672-7a6a7142163a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.163234 Apr 05 12:12:43.728124 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1499/3020] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:43 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:43.732789 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9e637b2c-e589-46b1-b395-deaed9cf29a4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:43.733639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9e637b2c-e589-46b1-b395-deaed9cf29a4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:43.739871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9e637b2c-e589-46b1-b395-deaed9cf29a4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:43.740351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9e637b2c-e589-46b1-b395-deaed9cf29a4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:43.741137 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9e637b2c-e589-46b1-b395-deaed9cf29a4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:43.741613 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9e637b2c-e589-46b1-b395-deaed9cf29a4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:43.828023 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a7fde94c-378d-484d-a862-56fcecb9c109 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:43.836377 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a7fde94c-378d-484d-a862-56fcecb9c109 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.156890 Apr 05 12:12:43.837250 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1522/3021] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:43 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:43.854041 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8a0bc167-c094-457a-8a42-a95dac77658a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:43.854734 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8a0bc167-c094-457a-8a42-a95dac77658a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:43.860708 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8a0bc167-c094-457a-8a42-a95dac77658a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:43.861247 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8a0bc167-c094-457a-8a42-a95dac77658a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:43.862085 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8a0bc167-c094-457a-8a42-a95dac77658a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:43.862676 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8a0bc167-c094-457a-8a42-a95dac77658a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:43.882907 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9e637b2c-e589-46b1-b395-deaed9cf29a4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:43.891224 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9e637b2c-e589-46b1-b395-deaed9cf29a4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.162143 Apr 05 12:12:43.891936 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1500/3022] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:43 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:44.001582 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8a0bc167-c094-457a-8a42-a95dac77658a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:44.010291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8a0bc167-c094-457a-8a42-a95dac77658a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:44.011821 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8a0bc167-c094-457a-8a42-a95dac77658a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:44.013006 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8a0bc167-c094-457a-8a42-a95dac77658a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.162831 Apr 05 12:12:44.013540 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1523/3023] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:43 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:12:44.690426 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:12:44.691252 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Tue Apr 5 12:12:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:12:44.753041 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c3261fac-279d-412f-99c7-b95231253594 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:44.754454 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c3261fac-279d-412f-99c7-b95231253594 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:44.765247 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3261fac-279d-412f-99c7-b95231253594 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:44.765989 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3261fac-279d-412f-99c7-b95231253594 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:44.767239 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3261fac-279d-412f-99c7-b95231253594 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:44.767955 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3261fac-279d-412f-99c7-b95231253594 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:44.853842 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-353aa930-0f7f-4969-80b2-6ac141bea8e0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:44.854455 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-353aa930-0f7f-4969-80b2-6ac141bea8e0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:44.860850 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-353aa930-0f7f-4969-80b2-6ac141bea8e0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:44.861304 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-353aa930-0f7f-4969-80b2-6ac141bea8e0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:44.862062 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-353aa930-0f7f-4969-80b2-6ac141bea8e0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:44.862496 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-353aa930-0f7f-4969-80b2-6ac141bea8e0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:44.906253 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c3261fac-279d-412f-99c7-b95231253594 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:44.914090 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c3261fac-279d-412f-99c7-b95231253594 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.172015 Apr 05 12:12:44.914684 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1501/3024] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:44 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:44.919040 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6723730b-5e6e-4181-b7cb-f683b8456b6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:44.919594 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6723730b-5e6e-4181-b7cb-f683b8456b6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:44.925798 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6723730b-5e6e-4181-b7cb-f683b8456b6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:44.926240 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6723730b-5e6e-4181-b7cb-f683b8456b6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:44.926972 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6723730b-5e6e-4181-b7cb-f683b8456b6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:44.927400 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6723730b-5e6e-4181-b7cb-f683b8456b6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:44.996026 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-353aa930-0f7f-4969-80b2-6ac141bea8e0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:45.004183 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-353aa930-0f7f-4969-80b2-6ac141bea8e0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.154280 Apr 05 12:12:45.004832 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1524/3025] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:44 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:45.030737 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e8f0de53-89fd-43dc-8043-1894708df8ef tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:45.031301 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e8f0de53-89fd-43dc-8043-1894708df8ef tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:45.037410 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e8f0de53-89fd-43dc-8043-1894708df8ef tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:45.037849 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e8f0de53-89fd-43dc-8043-1894708df8ef tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:45.038597 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e8f0de53-89fd-43dc-8043-1894708df8ef tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:45.039020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e8f0de53-89fd-43dc-8043-1894708df8ef tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:45.060972 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6723730b-5e6e-4181-b7cb-f683b8456b6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:45.069160 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6723730b-5e6e-4181-b7cb-f683b8456b6b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.153562 Apr 05 12:12:45.069741 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1502/3026] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:44 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:45.173238 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e8f0de53-89fd-43dc-8043-1894708df8ef tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:45.185781 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e8f0de53-89fd-43dc-8043-1894708df8ef tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:45.188020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e8f0de53-89fd-43dc-8043-1894708df8ef tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:45.189736 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e8f0de53-89fd-43dc-8043-1894708df8ef tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.162506 Apr 05 12:12:45.190515 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1525/3027] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:45 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:12:45.936127 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-82759f20-7fb8-4a14-b23a-66b29f6c347a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:45.937077 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-82759f20-7fb8-4a14-b23a-66b29f6c347a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:45.945195 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-82759f20-7fb8-4a14-b23a-66b29f6c347a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:45.945640 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-82759f20-7fb8-4a14-b23a-66b29f6c347a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:45.946398 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-82759f20-7fb8-4a14-b23a-66b29f6c347a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:45.946828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-82759f20-7fb8-4a14-b23a-66b29f6c347a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:46.021606 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-394be4b9-b7ee-4ca4-a57f-c65303098f7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:46.022258 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-394be4b9-b7ee-4ca4-a57f-c65303098f7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:46.028843 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-394be4b9-b7ee-4ca4-a57f-c65303098f7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:46.029256 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-394be4b9-b7ee-4ca4-a57f-c65303098f7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:46.030045 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-394be4b9-b7ee-4ca4-a57f-c65303098f7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:46.030470 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-394be4b9-b7ee-4ca4-a57f-c65303098f7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:46.083256 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-82759f20-7fb8-4a14-b23a-66b29f6c347a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:46.091427 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-82759f20-7fb8-4a14-b23a-66b29f6c347a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.162548 Apr 05 12:12:46.091967 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1503/3028] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:45 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:46.096456 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-92ee8f2e-ecdb-404c-9252-237c14cac282 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:46.097131 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-92ee8f2e-ecdb-404c-9252-237c14cac282 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:46.102816 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-92ee8f2e-ecdb-404c-9252-237c14cac282 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:46.103262 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-92ee8f2e-ecdb-404c-9252-237c14cac282 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:46.104016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-92ee8f2e-ecdb-404c-9252-237c14cac282 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:46.104473 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-92ee8f2e-ecdb-404c-9252-237c14cac282 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:46.162969 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-394be4b9-b7ee-4ca4-a57f-c65303098f7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:46.170793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-394be4b9-b7ee-4ca4-a57f-c65303098f7d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.153237 Apr 05 12:12:46.171568 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1526/3029] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:46 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:46.208431 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2242f26c-2355-4681-90ef-66d7c9cf21d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:46.209033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2242f26c-2355-4681-90ef-66d7c9cf21d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:46.214861 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2242f26c-2355-4681-90ef-66d7c9cf21d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:46.215308 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2242f26c-2355-4681-90ef-66d7c9cf21d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:46.216056 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2242f26c-2355-4681-90ef-66d7c9cf21d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:46.216507 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2242f26c-2355-4681-90ef-66d7c9cf21d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:46.235208 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-92ee8f2e-ecdb-404c-9252-237c14cac282 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:46.243199 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-92ee8f2e-ecdb-404c-9252-237c14cac282 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.150270 Apr 05 12:12:46.243767 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1504/3030] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:46 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:46.345801 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2242f26c-2355-4681-90ef-66d7c9cf21d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:46.354789 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2242f26c-2355-4681-90ef-66d7c9cf21d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:46.356304 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2242f26c-2355-4681-90ef-66d7c9cf21d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:46.357449 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2242f26c-2355-4681-90ef-66d7c9cf21d8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.153002 Apr 05 12:12:46.358005 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1527/3031] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:46 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:47.113104 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6df4d54b-defe-4413-9854-d9a3883397f9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:47.113748 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6df4d54b-defe-4413-9854-d9a3883397f9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:47.120691 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6df4d54b-defe-4413-9854-d9a3883397f9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:47.121144 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6df4d54b-defe-4413-9854-d9a3883397f9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:47.121927 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6df4d54b-defe-4413-9854-d9a3883397f9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:47.122372 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6df4d54b-defe-4413-9854-d9a3883397f9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:47.188426 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-348423f2-ac1f-4da9-a96c-0204a9ce3ea5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:47.189332 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-348423f2-ac1f-4da9-a96c-0204a9ce3ea5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:47.197331 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-348423f2-ac1f-4da9-a96c-0204a9ce3ea5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:47.198012 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-348423f2-ac1f-4da9-a96c-0204a9ce3ea5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:47.199157 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-348423f2-ac1f-4da9-a96c-0204a9ce3ea5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:47.199798 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-348423f2-ac1f-4da9-a96c-0204a9ce3ea5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:47.269132 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6df4d54b-defe-4413-9854-d9a3883397f9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:47.277066 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6df4d54b-defe-4413-9854-d9a3883397f9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.170605 Apr 05 12:12:47.277635 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1505/3032] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:47 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:47.282081 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-afdedc04-56a2-459e-b63e-32f035ef597c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:47.282674 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-afdedc04-56a2-459e-b63e-32f035ef597c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:47.288382 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-afdedc04-56a2-459e-b63e-32f035ef597c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:47.288822 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-afdedc04-56a2-459e-b63e-32f035ef597c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:47.289576 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-afdedc04-56a2-459e-b63e-32f035ef597c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:47.289974 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-afdedc04-56a2-459e-b63e-32f035ef597c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:47.337048 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-348423f2-ac1f-4da9-a96c-0204a9ce3ea5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:47.345076 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-348423f2-ac1f-4da9-a96c-0204a9ce3ea5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.161535 Apr 05 12:12:47.345653 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1528/3033] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:47 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:47.376302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-39434520-039a-409f-9cce-8106456bfd29 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:47.376905 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-39434520-039a-409f-9cce-8106456bfd29 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:47.388368 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-39434520-039a-409f-9cce-8106456bfd29 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:47.388815 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-39434520-039a-409f-9cce-8106456bfd29 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:47.389623 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-39434520-039a-409f-9cce-8106456bfd29 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:47.390055 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-39434520-039a-409f-9cce-8106456bfd29 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:47.424305 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-afdedc04-56a2-459e-b63e-32f035ef597c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:47.432652 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-afdedc04-56a2-459e-b63e-32f035ef597c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.154048 Apr 05 12:12:47.433236 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1506/3034] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:47 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:47.527504 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-39434520-039a-409f-9cce-8106456bfd29 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:47.536514 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-39434520-039a-409f-9cce-8106456bfd29 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:47.538027 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-39434520-039a-409f-9cce-8106456bfd29 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:47.539194 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-39434520-039a-409f-9cce-8106456bfd29 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.166897 Apr 05 12:12:47.539764 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1529/3035] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:47 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:12:48.298531 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4406dc0b-69c1-4a34-9a24-31ce4f8b73c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:48.299539 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4406dc0b-69c1-4a34-9a24-31ce4f8b73c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:48.306835 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4406dc0b-69c1-4a34-9a24-31ce4f8b73c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:48.307305 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4406dc0b-69c1-4a34-9a24-31ce4f8b73c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:48.308109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4406dc0b-69c1-4a34-9a24-31ce4f8b73c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:48.308586 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4406dc0b-69c1-4a34-9a24-31ce4f8b73c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:48.363311 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4c3c6e16-cc1a-459e-834e-702df10409e8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:48.363882 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4c3c6e16-cc1a-459e-834e-702df10409e8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:48.370371 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4c3c6e16-cc1a-459e-834e-702df10409e8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:48.370822 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4c3c6e16-cc1a-459e-834e-702df10409e8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:48.371569 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4c3c6e16-cc1a-459e-834e-702df10409e8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:48.371996 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4c3c6e16-cc1a-459e-834e-702df10409e8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:48.448058 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4406dc0b-69c1-4a34-9a24-31ce4f8b73c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:48.456005 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4406dc0b-69c1-4a34-9a24-31ce4f8b73c2 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.163943 Apr 05 12:12:48.456686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1507/3036] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:48 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:48.461288 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-976cbd43-754b-4d38-af1a-04ada89115b2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:48.461906 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-976cbd43-754b-4d38-af1a-04ada89115b2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:48.467851 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-976cbd43-754b-4d38-af1a-04ada89115b2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:48.468333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-976cbd43-754b-4d38-af1a-04ada89115b2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:48.469097 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-976cbd43-754b-4d38-af1a-04ada89115b2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:48.469529 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-976cbd43-754b-4d38-af1a-04ada89115b2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:48.511575 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4c3c6e16-cc1a-459e-834e-702df10409e8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:48.519583 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4c3c6e16-cc1a-459e-834e-702df10409e8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.160283 Apr 05 12:12:48.520505 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1530/3037] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:48 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:48.557503 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fc5264be-ad94-4fda-97fd-dd3f744a2061 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:48.558109 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fc5264be-ad94-4fda-97fd-dd3f744a2061 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:48.564000 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc5264be-ad94-4fda-97fd-dd3f744a2061 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:48.564477 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc5264be-ad94-4fda-97fd-dd3f744a2061 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:48.565235 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc5264be-ad94-4fda-97fd-dd3f744a2061 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:48.565734 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc5264be-ad94-4fda-97fd-dd3f744a2061 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:48.604632 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-976cbd43-754b-4d38-af1a-04ada89115b2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:48.612842 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-976cbd43-754b-4d38-af1a-04ada89115b2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.155107 Apr 05 12:12:48.613430 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1508/3038] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:48 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:48.701350 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fc5264be-ad94-4fda-97fd-dd3f744a2061 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:48.709851 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fc5264be-ad94-4fda-97fd-dd3f744a2061 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:48.711349 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fc5264be-ad94-4fda-97fd-dd3f744a2061 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:48.712550 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fc5264be-ad94-4fda-97fd-dd3f744a2061 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.158820 Apr 05 12:12:48.713081 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1531/3039] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:48 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:12:49.475141 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-763d9edf-5b40-44ed-b532-9683738a1e94 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:49.475902 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-763d9edf-5b40-44ed-b532-9683738a1e94 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:49.484115 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-763d9edf-5b40-44ed-b532-9683738a1e94 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:49.484724 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-763d9edf-5b40-44ed-b532-9683738a1e94 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:49.485670 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-763d9edf-5b40-44ed-b532-9683738a1e94 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:49.486205 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-763d9edf-5b40-44ed-b532-9683738a1e94 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:49.537402 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8a651753-fd13-4dc3-85e1-300fb2cf4682 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:49.537977 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8a651753-fd13-4dc3-85e1-300fb2cf4682 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:49.544557 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8a651753-fd13-4dc3-85e1-300fb2cf4682 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:49.545022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8a651753-fd13-4dc3-85e1-300fb2cf4682 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:49.545770 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8a651753-fd13-4dc3-85e1-300fb2cf4682 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:49.546189 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8a651753-fd13-4dc3-85e1-300fb2cf4682 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:49.633850 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-763d9edf-5b40-44ed-b532-9683738a1e94 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:49.641879 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-763d9edf-5b40-44ed-b532-9683738a1e94 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.171714 Apr 05 12:12:49.642456 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1509/3040] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:49 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:49.646983 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8d4e4b63-8080-443a-81a7-791d9cdac4b8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:49.647595 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8d4e4b63-8080-443a-81a7-791d9cdac4b8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:49.653360 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8d4e4b63-8080-443a-81a7-791d9cdac4b8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:49.653819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8d4e4b63-8080-443a-81a7-791d9cdac4b8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:49.654586 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8d4e4b63-8080-443a-81a7-791d9cdac4b8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:49.655021 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8d4e4b63-8080-443a-81a7-791d9cdac4b8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:49.688287 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8a651753-fd13-4dc3-85e1-300fb2cf4682 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:49.696377 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8a651753-fd13-4dc3-85e1-300fb2cf4682 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.162757 Apr 05 12:12:49.696954 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1532/3041] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:49 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:12:49.733527 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-068ca594-9382-4dac-8d67-0d08a1898745 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:49.734040 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-068ca594-9382-4dac-8d67-0d08a1898745 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:49.740062 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-068ca594-9382-4dac-8d67-0d08a1898745 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:49.740524 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-068ca594-9382-4dac-8d67-0d08a1898745 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:49.741269 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-068ca594-9382-4dac-8d67-0d08a1898745 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:49.741692 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-068ca594-9382-4dac-8d67-0d08a1898745 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:49.786936 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8d4e4b63-8080-443a-81a7-791d9cdac4b8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:49.794798 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8d4e4b63-8080-443a-81a7-791d9cdac4b8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.151395 Apr 05 12:12:49.795379 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1510/3042] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:49 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:49.875177 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-068ca594-9382-4dac-8d67-0d08a1898745 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:49.884586 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-068ca594-9382-4dac-8d67-0d08a1898745 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:49.886268 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-068ca594-9382-4dac-8d67-0d08a1898745 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:49.887441 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-068ca594-9382-4dac-8d67-0d08a1898745 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.158051 Apr 05 12:12:49.888008 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1533/3043] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:49 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:12:50.659882 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8de69662-7fed-476f-ab71-7c74fc03b848 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:50.660502 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8de69662-7fed-476f-ab71-7c74fc03b848 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:50.666939 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8de69662-7fed-476f-ab71-7c74fc03b848 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:50.667378 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8de69662-7fed-476f-ab71-7c74fc03b848 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:50.668133 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8de69662-7fed-476f-ab71-7c74fc03b848 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:50.668742 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8de69662-7fed-476f-ab71-7c74fc03b848 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:50.713554 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-adc007b0-6f53-47f2-ae56-61369522607d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:50.714205 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-adc007b0-6f53-47f2-ae56-61369522607d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:50.720636 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-adc007b0-6f53-47f2-ae56-61369522607d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:50.721087 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-adc007b0-6f53-47f2-ae56-61369522607d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:50.721857 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-adc007b0-6f53-47f2-ae56-61369522607d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:50.722291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-adc007b0-6f53-47f2-ae56-61369522607d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:50.813275 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8de69662-7fed-476f-ab71-7c74fc03b848 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:50.821253 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8de69662-7fed-476f-ab71-7c74fc03b848 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.165656 Apr 05 12:12:50.821825 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1511/3044] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:50 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:50.826162 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-619f6433-a7ce-4f8f-b909-45d5208ff8dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:50.826972 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-619f6433-a7ce-4f8f-b909-45d5208ff8dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:50.832582 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-619f6433-a7ce-4f8f-b909-45d5208ff8dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:50.833350 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-619f6433-a7ce-4f8f-b909-45d5208ff8dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:50.834589 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-619f6433-a7ce-4f8f-b909-45d5208ff8dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:50.835288 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-619f6433-a7ce-4f8f-b909-45d5208ff8dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:50.858952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-adc007b0-6f53-47f2-ae56-61369522607d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:50.866979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-adc007b0-6f53-47f2-ae56-61369522607d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.157278 Apr 05 12:12:50.867559 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1534/3045] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:50 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:50.907707 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2833e0a2-e8f8-4443-8245-2572d4d605d1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:50.908336 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2833e0a2-e8f8-4443-8245-2572d4d605d1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:50.914476 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2833e0a2-e8f8-4443-8245-2572d4d605d1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:50.915216 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2833e0a2-e8f8-4443-8245-2572d4d605d1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:50.916117 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2833e0a2-e8f8-4443-8245-2572d4d605d1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:50.916563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2833e0a2-e8f8-4443-8245-2572d4d605d1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:50.971150 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-619f6433-a7ce-4f8f-b909-45d5208ff8dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:50.979442 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-619f6433-a7ce-4f8f-b909-45d5208ff8dc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.156650 Apr 05 12:12:50.980036 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1512/3046] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:50 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:51.054563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2833e0a2-e8f8-4443-8245-2572d4d605d1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:51.067192 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2833e0a2-e8f8-4443-8245-2572d4d605d1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:51.068818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2833e0a2-e8f8-4443-8245-2572d4d605d1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:51.069964 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2833e0a2-e8f8-4443-8245-2572d4d605d1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.166281 Apr 05 12:12:51.070528 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1535/3047] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:50 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:12:51.842588 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d0f0c63b-b300-4bd6-805c-79e757bb615a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:51.843442 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d0f0c63b-b300-4bd6-805c-79e757bb615a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:51.852192 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d0f0c63b-b300-4bd6-805c-79e757bb615a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:51.852646 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d0f0c63b-b300-4bd6-805c-79e757bb615a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:51.853396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d0f0c63b-b300-4bd6-805c-79e757bb615a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:51.853819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d0f0c63b-b300-4bd6-805c-79e757bb615a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:51.884479 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f5ba6d48-67ef-4d5d-8177-e1d1a821c3e3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:51.885169 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f5ba6d48-67ef-4d5d-8177-e1d1a821c3e3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:51.891589 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f5ba6d48-67ef-4d5d-8177-e1d1a821c3e3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:51.892115 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f5ba6d48-67ef-4d5d-8177-e1d1a821c3e3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:51.892948 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f5ba6d48-67ef-4d5d-8177-e1d1a821c3e3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:51.893465 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f5ba6d48-67ef-4d5d-8177-e1d1a821c3e3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:51.994062 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d0f0c63b-b300-4bd6-805c-79e757bb615a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:52.001818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d0f0c63b-b300-4bd6-805c-79e757bb615a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.165783 Apr 05 12:12:52.002369 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1513/3048] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:51 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:52.007104 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4cc20453-30b9-415c-a1b3-4b8dfd2eb892 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:52.007699 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4cc20453-30b9-415c-a1b3-4b8dfd2eb892 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:52.013330 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4cc20453-30b9-415c-a1b3-4b8dfd2eb892 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:52.013773 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4cc20453-30b9-415c-a1b3-4b8dfd2eb892 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:52.014518 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4cc20453-30b9-415c-a1b3-4b8dfd2eb892 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:52.014945 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4cc20453-30b9-415c-a1b3-4b8dfd2eb892 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:52.026210 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f5ba6d48-67ef-4d5d-8177-e1d1a821c3e3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:52.033908 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f5ba6d48-67ef-4d5d-8177-e1d1a821c3e3 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.153299 Apr 05 12:12:52.034506 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1536/3049] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:51 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:52.087471 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e42467f9-307e-4efe-bc8c-e1e8baf4793a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:52.088102 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e42467f9-307e-4efe-bc8c-e1e8baf4793a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:52.094114 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e42467f9-307e-4efe-bc8c-e1e8baf4793a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:52.094500 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e42467f9-307e-4efe-bc8c-e1e8baf4793a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:52.095265 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e42467f9-307e-4efe-bc8c-e1e8baf4793a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:52.095871 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e42467f9-307e-4efe-bc8c-e1e8baf4793a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:52.146713 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4cc20453-30b9-415c-a1b3-4b8dfd2eb892 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:52.154692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4cc20453-30b9-415c-a1b3-4b8dfd2eb892 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.151381 Apr 05 12:12:52.155271 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1514/3050] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:52 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:52.232747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e42467f9-307e-4efe-bc8c-e1e8baf4793a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:52.241565 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e42467f9-307e-4efe-bc8c-e1e8baf4793a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:52.243075 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e42467f9-307e-4efe-bc8c-e1e8baf4793a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:52.244278 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e42467f9-307e-4efe-bc8c-e1e8baf4793a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.160691 Apr 05 12:12:52.244894 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1537/3051] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:52 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:53.019179 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d921ad9e-1668-47d2-ad6d-c12815057beb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:53.019724 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d921ad9e-1668-47d2-ad6d-c12815057beb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:53.026590 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d921ad9e-1668-47d2-ad6d-c12815057beb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:53.027040 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d921ad9e-1668-47d2-ad6d-c12815057beb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:53.027798 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d921ad9e-1668-47d2-ad6d-c12815057beb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:53.028270 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d921ad9e-1668-47d2-ad6d-c12815057beb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:53.050697 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-453b4f2f-146b-4615-8084-5abbc5a86399 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:53.051501 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-453b4f2f-146b-4615-8084-5abbc5a86399 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:53.058473 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-453b4f2f-146b-4615-8084-5abbc5a86399 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:53.058941 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-453b4f2f-146b-4615-8084-5abbc5a86399 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:53.059692 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-453b4f2f-146b-4615-8084-5abbc5a86399 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:53.060114 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-453b4f2f-146b-4615-8084-5abbc5a86399 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:53.162924 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d921ad9e-1668-47d2-ad6d-c12815057beb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:53.170828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d921ad9e-1668-47d2-ad6d-c12815057beb tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.155673 Apr 05 12:12:53.171400 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1515/3052] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:53 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:53.175828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c9237eec-e172-43b2-a425-f93342618587 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:53.176455 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c9237eec-e172-43b2-a425-f93342618587 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:53.182903 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c9237eec-e172-43b2-a425-f93342618587 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:53.183351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c9237eec-e172-43b2-a425-f93342618587 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:53.184118 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c9237eec-e172-43b2-a425-f93342618587 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:53.184563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c9237eec-e172-43b2-a425-f93342618587 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:53.192737 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-453b4f2f-146b-4615-8084-5abbc5a86399 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:53.200510 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-453b4f2f-146b-4615-8084-5abbc5a86399 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.153604 Apr 05 12:12:53.201123 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1538/3053] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:53 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:53.262928 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f49ac73b-cc75-4723-860a-a791228064f0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:53.263638 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f49ac73b-cc75-4723-860a-a791228064f0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:53.269959 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f49ac73b-cc75-4723-860a-a791228064f0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:53.270350 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f49ac73b-cc75-4723-860a-a791228064f0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:53.271200 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f49ac73b-cc75-4723-860a-a791228064f0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:53.271680 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f49ac73b-cc75-4723-860a-a791228064f0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:53.316213 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c9237eec-e172-43b2-a425-f93342618587 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:53.324378 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c9237eec-e172-43b2-a425-f93342618587 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.152011 Apr 05 12:12:53.324955 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1516/3054] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:53 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:53.404489 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f49ac73b-cc75-4723-860a-a791228064f0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:53.413480 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f49ac73b-cc75-4723-860a-a791228064f0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:53.415013 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f49ac73b-cc75-4723-860a-a791228064f0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:53.416205 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f49ac73b-cc75-4723-860a-a791228064f0 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.157168 Apr 05 12:12:53.416777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1539/3055] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:53 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:54.193051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e9fcd74d-5e57-4049-95bf-027dc475e6a9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:54.193722 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e9fcd74d-5e57-4049-95bf-027dc475e6a9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:54.201483 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e9fcd74d-5e57-4049-95bf-027dc475e6a9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:54.202014 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e9fcd74d-5e57-4049-95bf-027dc475e6a9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:54.202948 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e9fcd74d-5e57-4049-95bf-027dc475e6a9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:54.203480 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e9fcd74d-5e57-4049-95bf-027dc475e6a9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:54.218532 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-562488a0-97c6-44d2-93f7-a14b238e086c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:54.219289 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-562488a0-97c6-44d2-93f7-a14b238e086c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:54.223503 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:12:54.225514 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Tue Apr 5 12:12:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d (ip 10.222.0.61) !!! Apr 05 12:12:54.228680 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-562488a0-97c6-44d2-93f7-a14b238e086c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:54.229140 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-562488a0-97c6-44d2-93f7-a14b238e086c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:54.229894 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-562488a0-97c6-44d2-93f7-a14b238e086c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:54.230328 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-562488a0-97c6-44d2-93f7-a14b238e086c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:54.341203 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e9fcd74d-5e57-4049-95bf-027dc475e6a9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:54.349235 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e9fcd74d-5e57-4049-95bf-027dc475e6a9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.163335 Apr 05 12:12:54.349801 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1517/3056] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:54 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:54.354104 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c9d3907e-f4cb-415d-82ba-2f2760a08ba6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:54.354732 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c9d3907e-f4cb-415d-82ba-2f2760a08ba6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:54.360269 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c9d3907e-f4cb-415d-82ba-2f2760a08ba6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:54.360697 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c9d3907e-f4cb-415d-82ba-2f2760a08ba6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:54.361443 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c9d3907e-f4cb-415d-82ba-2f2760a08ba6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:54.361861 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c9d3907e-f4cb-415d-82ba-2f2760a08ba6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:54.373612 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-562488a0-97c6-44d2-93f7-a14b238e086c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:54.382761 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-562488a0-97c6-44d2-93f7-a14b238e086c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.169020 Apr 05 12:12:54.383664 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1540/3057] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:54 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:54.438927 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e2e61709-2cbb-4ee6-a441-a002ac0abb7a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:54.439526 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e2e61709-2cbb-4ee6-a441-a002ac0abb7a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:54.445724 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e2e61709-2cbb-4ee6-a441-a002ac0abb7a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:54.446087 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e2e61709-2cbb-4ee6-a441-a002ac0abb7a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:54.446843 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e2e61709-2cbb-4ee6-a441-a002ac0abb7a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:54.447270 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e2e61709-2cbb-4ee6-a441-a002ac0abb7a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:54.499792 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c9d3907e-f4cb-415d-82ba-2f2760a08ba6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:54.508547 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c9d3907e-f4cb-415d-82ba-2f2760a08ba6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.157759 Apr 05 12:12:54.509343 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1518/3058] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:54 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:54.579103 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e2e61709-2cbb-4ee6-a441-a002ac0abb7a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:54.587830 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e2e61709-2cbb-4ee6-a441-a002ac0abb7a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:54.589358 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e2e61709-2cbb-4ee6-a441-a002ac0abb7a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:54.590508 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e2e61709-2cbb-4ee6-a441-a002ac0abb7a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.155641 Apr 05 12:12:54.591075 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1541/3059] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:54 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:55.370871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-aefa07fc-046b-41a3-8fbc-cf2c479687d7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:55.371893 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-aefa07fc-046b-41a3-8fbc-cf2c479687d7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:55.382903 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aefa07fc-046b-41a3-8fbc-cf2c479687d7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:55.383645 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aefa07fc-046b-41a3-8fbc-cf2c479687d7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:55.384952 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aefa07fc-046b-41a3-8fbc-cf2c479687d7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:55.385673 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aefa07fc-046b-41a3-8fbc-cf2c479687d7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:55.401350 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-00f75073-d6e0-45e5-9e22-6e296cb942c6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:55.401870 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-00f75073-d6e0-45e5-9e22-6e296cb942c6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:55.408557 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-00f75073-d6e0-45e5-9e22-6e296cb942c6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:55.409030 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-00f75073-d6e0-45e5-9e22-6e296cb942c6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:55.409913 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-00f75073-d6e0-45e5-9e22-6e296cb942c6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:55.410357 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-00f75073-d6e0-45e5-9e22-6e296cb942c6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:55.524107 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-aefa07fc-046b-41a3-8fbc-cf2c479687d7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:55.532188 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-aefa07fc-046b-41a3-8fbc-cf2c479687d7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.167899 Apr 05 12:12:55.532926 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1519/3060] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:55 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:55.537674 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ba0f4b1d-080b-4d2a-a362-8ecfc002b6aa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:55.538344 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ba0f4b1d-080b-4d2a-a362-8ecfc002b6aa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:55.544188 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ba0f4b1d-080b-4d2a-a362-8ecfc002b6aa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:55.544707 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ba0f4b1d-080b-4d2a-a362-8ecfc002b6aa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:55.545473 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ba0f4b1d-080b-4d2a-a362-8ecfc002b6aa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:55.545896 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ba0f4b1d-080b-4d2a-a362-8ecfc002b6aa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:55.546488 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-00f75073-d6e0-45e5-9e22-6e296cb942c6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:55.554470 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-00f75073-d6e0-45e5-9e22-6e296cb942c6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.157085 Apr 05 12:12:55.555039 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1542/3061] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:55 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:55.615047 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-058382c8-ecc4-4fb5-8c32-048c7cc9c17b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:55.615659 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-058382c8-ecc4-4fb5-8c32-048c7cc9c17b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:55.621698 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-058382c8-ecc4-4fb5-8c32-048c7cc9c17b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:55.622144 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-058382c8-ecc4-4fb5-8c32-048c7cc9c17b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:55.622907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-058382c8-ecc4-4fb5-8c32-048c7cc9c17b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:55.623340 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-058382c8-ecc4-4fb5-8c32-048c7cc9c17b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:55.682480 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ba0f4b1d-080b-4d2a-a362-8ecfc002b6aa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:55.690336 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ba0f4b1d-080b-4d2a-a362-8ecfc002b6aa tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.156371 Apr 05 12:12:55.695197 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1520/3062] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:55 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:55.763462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-058382c8-ecc4-4fb5-8c32-048c7cc9c17b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:55.776018 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-058382c8-ecc4-4fb5-8c32-048c7cc9c17b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:55.778200 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-058382c8-ecc4-4fb5-8c32-048c7cc9c17b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:55.779962 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-058382c8-ecc4-4fb5-8c32-048c7cc9c17b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.168605 Apr 05 12:12:55.780661 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1543/3063] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:55 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:56.553829 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-336a73ef-67c2-4993-aab7-1059e790c552 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:56.554837 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-336a73ef-67c2-4993-aab7-1059e790c552 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:56.565607 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-336a73ef-67c2-4993-aab7-1059e790c552 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:56.566361 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-336a73ef-67c2-4993-aab7-1059e790c552 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:56.567670 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-336a73ef-67c2-4993-aab7-1059e790c552 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:56.568114 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-336a73ef-67c2-4993-aab7-1059e790c552 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:56.572559 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-deafcec9-465a-440a-983b-3f42cffe8245 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:56.573177 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-deafcec9-465a-440a-983b-3f42cffe8245 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:56.579945 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-deafcec9-465a-440a-983b-3f42cffe8245 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:56.580430 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-deafcec9-465a-440a-983b-3f42cffe8245 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:56.581194 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-deafcec9-465a-440a-983b-3f42cffe8245 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:56.581627 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-deafcec9-465a-440a-983b-3f42cffe8245 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:56.701125 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-336a73ef-67c2-4993-aab7-1059e790c552 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:56.709283 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-336a73ef-67c2-4993-aab7-1059e790c552 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.161948 Apr 05 12:12:56.709996 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1521/3064] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:56 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:56.715008 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5b5e8046-c2c5-4a85-8964-099dd08340b6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:56.715699 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5b5e8046-c2c5-4a85-8964-099dd08340b6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:56.717098 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-deafcec9-465a-440a-983b-3f42cffe8245 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:56.721736 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5b5e8046-c2c5-4a85-8964-099dd08340b6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:56.722189 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5b5e8046-c2c5-4a85-8964-099dd08340b6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:56.722950 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5b5e8046-c2c5-4a85-8964-099dd08340b6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:56.723387 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5b5e8046-c2c5-4a85-8964-099dd08340b6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:56.725673 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-deafcec9-465a-440a-983b-3f42cffe8245 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.156945 Apr 05 12:12:56.726326 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1544/3065] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:56 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:12:56.803090 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-39137fc0-8c39-4f1a-a98b-2312019a0b8a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:56.803717 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-39137fc0-8c39-4f1a-a98b-2312019a0b8a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:56.810043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-39137fc0-8c39-4f1a-a98b-2312019a0b8a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:56.810585 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-39137fc0-8c39-4f1a-a98b-2312019a0b8a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:56.811404 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-39137fc0-8c39-4f1a-a98b-2312019a0b8a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:56.811919 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-39137fc0-8c39-4f1a-a98b-2312019a0b8a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:56.858017 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5b5e8046-c2c5-4a85-8964-099dd08340b6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:56.866454 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5b5e8046-c2c5-4a85-8964-099dd08340b6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.155253 Apr 05 12:12:56.867002 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1522/3066] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:56 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:56.942038 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-39137fc0-8c39-4f1a-a98b-2312019a0b8a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:56.950824 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-39137fc0-8c39-4f1a-a98b-2312019a0b8a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:56.952338 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-39137fc0-8c39-4f1a-a98b-2312019a0b8a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:56.953487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-39137fc0-8c39-4f1a-a98b-2312019a0b8a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.156599 Apr 05 12:12:56.954079 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1545/3067] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:56 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:57.117723 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:12:57.117995 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Tue Apr 5 12:12:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:12:57.730517 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-dc92b290-ed74-47f8-bf76-9328861b8315 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:57.731478 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-dc92b290-ed74-47f8-bf76-9328861b8315 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:57.741367 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dc92b290-ed74-47f8-bf76-9328861b8315 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:57.741947 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dc92b290-ed74-47f8-bf76-9328861b8315 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:57.742836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dc92b290-ed74-47f8-bf76-9328861b8315 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:57.743270 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dc92b290-ed74-47f8-bf76-9328861b8315 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:57.743953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-510224f1-5152-4c39-8bd1-645e5863c541 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:57.744779 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-510224f1-5152-4c39-8bd1-645e5863c541 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:57.751659 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-510224f1-5152-4c39-8bd1-645e5863c541 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:57.752021 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-510224f1-5152-4c39-8bd1-645e5863c541 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:57.752792 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-510224f1-5152-4c39-8bd1-645e5863c541 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:57.753542 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-510224f1-5152-4c39-8bd1-645e5863c541 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:57.880917 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-dc92b290-ed74-47f8-bf76-9328861b8315 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:57.885910 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-510224f1-5152-4c39-8bd1-645e5863c541 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:57.889044 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-dc92b290-ed74-47f8-bf76-9328861b8315 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.164954 Apr 05 12:12:57.889597 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1523/3068] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:57 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:57.894008 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-daa20dd0-6d77-4241-8af6-39cb058d4001 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:57.894158 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-510224f1-5152-4c39-8bd1-645e5863c541 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.153874 Apr 05 12:12:57.894738 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1546/3069] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:57 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:57.895154 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-daa20dd0-6d77-4241-8af6-39cb058d4001 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:57.900939 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-daa20dd0-6d77-4241-8af6-39cb058d4001 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:57.901383 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-daa20dd0-6d77-4241-8af6-39cb058d4001 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:57.902136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-daa20dd0-6d77-4241-8af6-39cb058d4001 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:57.902566 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-daa20dd0-6d77-4241-8af6-39cb058d4001 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:57.971927 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e35675f3-0b72-41db-95cb-e6f3e3ff7f1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:57.972559 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e35675f3-0b72-41db-95cb-e6f3e3ff7f1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:57.978445 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e35675f3-0b72-41db-95cb-e6f3e3ff7f1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:57.978884 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e35675f3-0b72-41db-95cb-e6f3e3ff7f1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:57.979684 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e35675f3-0b72-41db-95cb-e6f3e3ff7f1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:57.980117 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e35675f3-0b72-41db-95cb-e6f3e3ff7f1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:58.035019 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-daa20dd0-6d77-4241-8af6-39cb058d4001 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:58.042996 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-daa20dd0-6d77-4241-8af6-39cb058d4001 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.152457 Apr 05 12:12:58.043579 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1524/3070] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:57 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:58.121714 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e35675f3-0b72-41db-95cb-e6f3e3ff7f1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:58.130548 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e35675f3-0b72-41db-95cb-e6f3e3ff7f1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:58.132028 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e35675f3-0b72-41db-95cb-e6f3e3ff7f1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:58.133214 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e35675f3-0b72-41db-95cb-e6f3e3ff7f1e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.165206 Apr 05 12:12:58.133765 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1547/3071] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:57 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:12:58.910669 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-276848a8-671d-4a62-acee-a110806501d7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:58.911604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-276848a8-671d-4a62-acee-a110806501d7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:58.913307 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-def0415b-cb00-4862-b1af-46b29f43718b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:58.913917 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-def0415b-cb00-4862-b1af-46b29f43718b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:58.918215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-276848a8-671d-4a62-acee-a110806501d7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:58.918671 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-276848a8-671d-4a62-acee-a110806501d7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:58.919439 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-276848a8-671d-4a62-acee-a110806501d7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:58.919874 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-276848a8-671d-4a62-acee-a110806501d7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:58.920462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-def0415b-cb00-4862-b1af-46b29f43718b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:58.921019 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-def0415b-cb00-4862-b1af-46b29f43718b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:58.921774 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-def0415b-cb00-4862-b1af-46b29f43718b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:58.922202 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-def0415b-cb00-4862-b1af-46b29f43718b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:59.055265 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-def0415b-cb00-4862-b1af-46b29f43718b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:59.055444 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-276848a8-671d-4a62-acee-a110806501d7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:59.063339 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-276848a8-671d-4a62-acee-a110806501d7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.159539 Apr 05 12:12:59.063557 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-def0415b-cb00-4862-b1af-46b29f43718b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.155528 Apr 05 12:12:59.063908 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1525/3072] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:58 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:59.067990 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1548/3073] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:58 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:59.068482 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-661a3022-7df5-4bf8-8f27-1ea0e66b70db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:59.068951 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-661a3022-7df5-4bf8-8f27-1ea0e66b70db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:59.074598 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-661a3022-7df5-4bf8-8f27-1ea0e66b70db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:59.075045 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-661a3022-7df5-4bf8-8f27-1ea0e66b70db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:59.075798 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-661a3022-7df5-4bf8-8f27-1ea0e66b70db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:59.076254 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-661a3022-7df5-4bf8-8f27-1ea0e66b70db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:59.152904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5f046c53-9c59-4583-883e-b301b55f3db5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:12:59.153352 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5f046c53-9c59-4583-883e-b301b55f3db5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:12:59.159180 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5f046c53-9c59-4583-883e-b301b55f3db5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:59.159630 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5f046c53-9c59-4583-883e-b301b55f3db5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:59.168673 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5f046c53-9c59-4583-883e-b301b55f3db5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:12:59.168673 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5f046c53-9c59-4583-883e-b301b55f3db5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:12:59.210368 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-661a3022-7df5-4bf8-8f27-1ea0e66b70db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:59.218034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-661a3022-7df5-4bf8-8f27-1ea0e66b70db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.153190 Apr 05 12:12:59.218594 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1526/3074] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:12:59 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:59.299207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5f046c53-9c59-4583-883e-b301b55f3db5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:59.312836 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5f046c53-9c59-4583-883e-b301b55f3db5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:59.315218 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5f046c53-9c59-4583-883e-b301b55f3db5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:12:59.317129 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5f046c53-9c59-4583-883e-b301b55f3db5 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.169855 Apr 05 12:12:59.317912 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1549/3075] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:12:59 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:13:00.084853 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-89c99c6c-427a-4a14-88e0-33d63c2848f0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:00.085940 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8a52e5af-0808-454b-9072-7cd9436582c9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:00.085940 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8a52e5af-0808-454b-9072-7cd9436582c9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:00.086662 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-89c99c6c-427a-4a14-88e0-33d63c2848f0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:00.096467 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-89c99c6c-427a-4a14-88e0-33d63c2848f0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:00.096776 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8a52e5af-0808-454b-9072-7cd9436582c9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:00.097205 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-89c99c6c-427a-4a14-88e0-33d63c2848f0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:00.097470 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8a52e5af-0808-454b-9072-7cd9436582c9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:00.098443 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-89c99c6c-427a-4a14-88e0-33d63c2848f0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:00.098792 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8a52e5af-0808-454b-9072-7cd9436582c9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:00.099082 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-89c99c6c-427a-4a14-88e0-33d63c2848f0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:00.099251 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8a52e5af-0808-454b-9072-7cd9436582c9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:00.233082 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-89c99c6c-427a-4a14-88e0-33d63c2848f0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:00.237763 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8a52e5af-0808-454b-9072-7cd9436582c9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:00.240860 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-89c99c6c-427a-4a14-88e0-33d63c2848f0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.162406 Apr 05 12:13:00.241437 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1550/3076] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:00 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:00.245897 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4a067144-fe07-4e60-bd81-b95d8a2511fe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:00.246492 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4a067144-fe07-4e60-bd81-b95d8a2511fe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:00.246934 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8a52e5af-0808-454b-9072-7cd9436582c9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.168468 Apr 05 12:13:00.247648 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1527/3077] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:00 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:00.252498 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a067144-fe07-4e60-bd81-b95d8a2511fe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:00.252942 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a067144-fe07-4e60-bd81-b95d8a2511fe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:00.254064 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a067144-fe07-4e60-bd81-b95d8a2511fe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:00.254493 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a067144-fe07-4e60-bd81-b95d8a2511fe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:00.335833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-27c3ff5b-30b1-4c5b-815d-b99daa3dbfbb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:00.336474 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-27c3ff5b-30b1-4c5b-815d-b99daa3dbfbb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:00.344572 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-27c3ff5b-30b1-4c5b-815d-b99daa3dbfbb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:00.345021 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-27c3ff5b-30b1-4c5b-815d-b99daa3dbfbb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:00.345782 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-27c3ff5b-30b1-4c5b-815d-b99daa3dbfbb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:00.346220 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-27c3ff5b-30b1-4c5b-815d-b99daa3dbfbb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:00.388231 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4a067144-fe07-4e60-bd81-b95d8a2511fe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:00.396514 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4a067144-fe07-4e60-bd81-b95d8a2511fe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.154107 Apr 05 12:13:00.397087 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1551/3078] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:00 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:00.477936 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-27c3ff5b-30b1-4c5b-815d-b99daa3dbfbb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:00.486246 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-27c3ff5b-30b1-4c5b-815d-b99daa3dbfbb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:00.487789 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-27c3ff5b-30b1-4c5b-815d-b99daa3dbfbb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:00.488988 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-27c3ff5b-30b1-4c5b-815d-b99daa3dbfbb tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.157115 Apr 05 12:13:00.489667 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1528/3079] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:00 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:01.259462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0940aef9-d8a5-42b5-b221-af46eb707cf0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:01.259462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0940aef9-d8a5-42b5-b221-af46eb707cf0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:01.264830 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-86cf3c9e-be00-456f-945c-02e462308954 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:01.265430 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-86cf3c9e-be00-456f-945c-02e462308954 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:01.265563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0940aef9-d8a5-42b5-b221-af46eb707cf0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:01.265977 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0940aef9-d8a5-42b5-b221-af46eb707cf0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:01.266737 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0940aef9-d8a5-42b5-b221-af46eb707cf0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:01.267328 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0940aef9-d8a5-42b5-b221-af46eb707cf0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:01.272059 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86cf3c9e-be00-456f-945c-02e462308954 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:01.272533 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86cf3c9e-be00-456f-945c-02e462308954 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:01.273297 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86cf3c9e-be00-456f-945c-02e462308954 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:01.282061 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86cf3c9e-be00-456f-945c-02e462308954 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:01.405213 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0940aef9-d8a5-42b5-b221-af46eb707cf0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:01.406132 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-86cf3c9e-be00-456f-945c-02e462308954 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:01.413312 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0940aef9-d8a5-42b5-b221-af46eb707cf0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.158931 Apr 05 12:13:01.413923 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1552/3080] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:01 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:01.414088 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-86cf3c9e-be00-456f-945c-02e462308954 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.153169 Apr 05 12:13:01.414710 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1529/3081] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:01 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:01.418649 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f7c1dcf3-55d5-456c-be7a-e7c926fd7be0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:01.419245 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f7c1dcf3-55d5-456c-be7a-e7c926fd7be0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:01.425133 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f7c1dcf3-55d5-456c-be7a-e7c926fd7be0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:01.425582 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f7c1dcf3-55d5-456c-be7a-e7c926fd7be0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:01.426331 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f7c1dcf3-55d5-456c-be7a-e7c926fd7be0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:01.426756 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f7c1dcf3-55d5-456c-be7a-e7c926fd7be0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:01.507331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-36e5efa0-22a8-45a7-837d-6a8315fb7794 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:01.507949 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-36e5efa0-22a8-45a7-837d-6a8315fb7794 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:01.514271 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-36e5efa0-22a8-45a7-837d-6a8315fb7794 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:01.514732 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-36e5efa0-22a8-45a7-837d-6a8315fb7794 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:01.515501 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-36e5efa0-22a8-45a7-837d-6a8315fb7794 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:01.515941 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-36e5efa0-22a8-45a7-837d-6a8315fb7794 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:01.555989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f7c1dcf3-55d5-456c-be7a-e7c926fd7be0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:01.564183 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f7c1dcf3-55d5-456c-be7a-e7c926fd7be0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.149190 Apr 05 12:13:01.564763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1553/3082] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:01 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:01.652677 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-36e5efa0-22a8-45a7-837d-6a8315fb7794 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:01.661663 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-36e5efa0-22a8-45a7-837d-6a8315fb7794 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:01.663160 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-36e5efa0-22a8-45a7-837d-6a8315fb7794 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:01.664353 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-36e5efa0-22a8-45a7-837d-6a8315fb7794 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.161329 Apr 05 12:13:01.664915 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1530/3083] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:01 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:02.432790 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4396ead0-e0c1-4184-a9bd-90093b90f749 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:02.433387 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f26467ef-23f1-4ceb-87ba-6e90709ece8f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:02.433767 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4396ead0-e0c1-4184-a9bd-90093b90f749 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:02.433877 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f26467ef-23f1-4ceb-87ba-6e90709ece8f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:02.440515 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4396ead0-e0c1-4184-a9bd-90093b90f749 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:02.440723 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f26467ef-23f1-4ceb-87ba-6e90709ece8f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:02.440991 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4396ead0-e0c1-4184-a9bd-90093b90f749 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:02.441126 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f26467ef-23f1-4ceb-87ba-6e90709ece8f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:02.441732 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f26467ef-23f1-4ceb-87ba-6e90709ece8f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:02.442187 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f26467ef-23f1-4ceb-87ba-6e90709ece8f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:02.442332 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4396ead0-e0c1-4184-a9bd-90093b90f749 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:02.442926 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4396ead0-e0c1-4184-a9bd-90093b90f749 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:02.578870 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4396ead0-e0c1-4184-a9bd-90093b90f749 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:02.579658 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f26467ef-23f1-4ceb-87ba-6e90709ece8f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:02.587144 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4396ead0-e0c1-4184-a9bd-90093b90f749 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.160541 Apr 05 12:13:02.587719 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1554/3084] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:02 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:02.587922 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f26467ef-23f1-4ceb-87ba-6e90709ece8f tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.160826 Apr 05 12:13:02.597415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1531/3085] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:02 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:02.597602 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8eea34c9-ddd0-4216-ab89-a9f693517ad4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:02.597602 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8eea34c9-ddd0-4216-ab89-a9f693517ad4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:02.598249 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8eea34c9-ddd0-4216-ab89-a9f693517ad4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:02.598693 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8eea34c9-ddd0-4216-ab89-a9f693517ad4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:02.599542 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8eea34c9-ddd0-4216-ab89-a9f693517ad4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:02.599971 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8eea34c9-ddd0-4216-ab89-a9f693517ad4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:02.692515 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5b950569-10a8-4d50-b07d-6bf16bc2bfe1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:02.693602 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5b950569-10a8-4d50-b07d-6bf16bc2bfe1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:02.699945 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5b950569-10a8-4d50-b07d-6bf16bc2bfe1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:02.700869 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5b950569-10a8-4d50-b07d-6bf16bc2bfe1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:02.701667 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5b950569-10a8-4d50-b07d-6bf16bc2bfe1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:02.702098 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5b950569-10a8-4d50-b07d-6bf16bc2bfe1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:02.761583 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8eea34c9-ddd0-4216-ab89-a9f693517ad4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:02.771633 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8eea34c9-ddd0-4216-ab89-a9f693517ad4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.182668 Apr 05 12:13:02.772639 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1555/3086] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:02 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:02.849948 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5b950569-10a8-4d50-b07d-6bf16bc2bfe1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:02.858922 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5b950569-10a8-4d50-b07d-6bf16bc2bfe1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:02.860490 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5b950569-10a8-4d50-b07d-6bf16bc2bfe1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:02.861650 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5b950569-10a8-4d50-b07d-6bf16bc2bfe1 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.176061 Apr 05 12:13:02.862208 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1532/3087] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:02 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:13:03.604949 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c34f4a50-f64f-4174-bd77-48cc7567f225 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:03.605462 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c1dc6624-063d-452b-802b-6cf440f4c01d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:03.605831 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c34f4a50-f64f-4174-bd77-48cc7567f225 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:03.605931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c1dc6624-063d-452b-802b-6cf440f4c01d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:03.612108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1dc6624-063d-452b-802b-6cf440f4c01d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:03.612305 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c34f4a50-f64f-4174-bd77-48cc7567f225 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:03.612554 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1dc6624-063d-452b-802b-6cf440f4c01d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:03.612678 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c34f4a50-f64f-4174-bd77-48cc7567f225 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:03.613327 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1dc6624-063d-452b-802b-6cf440f4c01d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:03.613472 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c34f4a50-f64f-4174-bd77-48cc7567f225 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:03.613759 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1dc6624-063d-452b-802b-6cf440f4c01d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:03.613918 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c34f4a50-f64f-4174-bd77-48cc7567f225 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:03.747261 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c1dc6624-063d-452b-802b-6cf440f4c01d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:03.755475 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c1dc6624-063d-452b-802b-6cf440f4c01d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.154369 Apr 05 12:13:03.756168 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1533/3088] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:03 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:03.792157 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-68d7cbbe-659c-48c6-a7da-973b8ef7b8fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:03.792792 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-68d7cbbe-659c-48c6-a7da-973b8ef7b8fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:03.799032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-68d7cbbe-659c-48c6-a7da-973b8ef7b8fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:03.799481 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-68d7cbbe-659c-48c6-a7da-973b8ef7b8fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:03.800327 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-68d7cbbe-659c-48c6-a7da-973b8ef7b8fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:03.800767 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-68d7cbbe-659c-48c6-a7da-973b8ef7b8fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:03.830193 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c34f4a50-f64f-4174-bd77-48cc7567f225 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:03.838865 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c34f4a50-f64f-4174-bd77-48cc7567f225 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.237632 Apr 05 12:13:03.839731 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1556/3089] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:03 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:03.880771 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7c5456b5-da9b-4422-a52f-0dc2b14326d4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:03.881379 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7c5456b5-da9b-4422-a52f-0dc2b14326d4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:03.887790 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7c5456b5-da9b-4422-a52f-0dc2b14326d4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:03.888337 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7c5456b5-da9b-4422-a52f-0dc2b14326d4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:03.889163 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7c5456b5-da9b-4422-a52f-0dc2b14326d4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:03.889811 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7c5456b5-da9b-4422-a52f-0dc2b14326d4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:03.937742 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-68d7cbbe-659c-48c6-a7da-973b8ef7b8fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:03.945813 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-68d7cbbe-659c-48c6-a7da-973b8ef7b8fc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.157532 Apr 05 12:13:03.946329 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1534/3090] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:03 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:04.094848 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7c5456b5-da9b-4422-a52f-0dc2b14326d4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:04.103409 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7c5456b5-da9b-4422-a52f-0dc2b14326d4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:04.105328 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7c5456b5-da9b-4422-a52f-0dc2b14326d4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:04.106494 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7c5456b5-da9b-4422-a52f-0dc2b14326d4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.230136 Apr 05 12:13:04.107102 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1557/3091] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:03 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:13:04.298879 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:13:04.299228 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Tue Apr 5 12:13:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:13:04.776950 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8e230fd5-17e8-4290-9348-1ba908af9c26 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:04.777961 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8e230fd5-17e8-4290-9348-1ba908af9c26 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:04.787782 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8e230fd5-17e8-4290-9348-1ba908af9c26 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:04.788257 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8e230fd5-17e8-4290-9348-1ba908af9c26 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:04.789010 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8e230fd5-17e8-4290-9348-1ba908af9c26 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:04.789439 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8e230fd5-17e8-4290-9348-1ba908af9c26 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:04.855975 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-61eb089b-24a0-479a-8281-1e80eced9e58 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:04.856626 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-61eb089b-24a0-479a-8281-1e80eced9e58 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:04.863012 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-61eb089b-24a0-479a-8281-1e80eced9e58 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:04.863455 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-61eb089b-24a0-479a-8281-1e80eced9e58 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:04.864234 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-61eb089b-24a0-479a-8281-1e80eced9e58 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:04.864692 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-61eb089b-24a0-479a-8281-1e80eced9e58 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:04.929051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8e230fd5-17e8-4290-9348-1ba908af9c26 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:04.937049 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8e230fd5-17e8-4290-9348-1ba908af9c26 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.166549 Apr 05 12:13:04.937828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1535/3092] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:04 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:04.963352 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-54f659d7-4218-4550-a04b-4aa35068346c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:04.964028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-54f659d7-4218-4550-a04b-4aa35068346c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:04.970010 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54f659d7-4218-4550-a04b-4aa35068346c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:04.970462 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54f659d7-4218-4550-a04b-4aa35068346c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:04.971227 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54f659d7-4218-4550-a04b-4aa35068346c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:04.971694 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54f659d7-4218-4550-a04b-4aa35068346c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:05.000108 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-61eb089b-24a0-479a-8281-1e80eced9e58 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:05.008738 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-61eb089b-24a0-479a-8281-1e80eced9e58 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.156672 Apr 05 12:13:05.009320 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1558/3093] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:04 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:13:05.104108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-54f659d7-4218-4550-a04b-4aa35068346c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:05.111924 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-54f659d7-4218-4550-a04b-4aa35068346c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.152622 Apr 05 12:13:05.112524 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1536/3094] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:04 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:05.127437 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-093b3f20-e864-4bd2-bb8c-2764d0588bc2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:05.128576 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-093b3f20-e864-4bd2-bb8c-2764d0588bc2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:05.137327 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-093b3f20-e864-4bd2-bb8c-2764d0588bc2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:05.137960 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-093b3f20-e864-4bd2-bb8c-2764d0588bc2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:05.139057 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-093b3f20-e864-4bd2-bb8c-2764d0588bc2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:05.139645 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-093b3f20-e864-4bd2-bb8c-2764d0588bc2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:05.276505 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-093b3f20-e864-4bd2-bb8c-2764d0588bc2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:05.288281 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-093b3f20-e864-4bd2-bb8c-2764d0588bc2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:05.289764 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-093b3f20-e864-4bd2-bb8c-2764d0588bc2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:05.290909 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-093b3f20-e864-4bd2-bb8c-2764d0588bc2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.169393 Apr 05 12:13:05.291464 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1559/3095] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:05 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:05.955089 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-13a16801-60a7-442a-9cff-f854aac2261c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:05.955700 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-13a16801-60a7-442a-9cff-f854aac2261c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:05.962544 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13a16801-60a7-442a-9cff-f854aac2261c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:05.963007 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13a16801-60a7-442a-9cff-f854aac2261c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:05.963791 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13a16801-60a7-442a-9cff-f854aac2261c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:05.964267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-13a16801-60a7-442a-9cff-f854aac2261c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:06.026370 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9aa05fd3-4f23-452b-9959-778cf5fc74f4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:06.026961 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9aa05fd3-4f23-452b-9959-778cf5fc74f4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:06.033482 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9aa05fd3-4f23-452b-9959-778cf5fc74f4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:06.033933 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9aa05fd3-4f23-452b-9959-778cf5fc74f4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:06.034720 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9aa05fd3-4f23-452b-9959-778cf5fc74f4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:06.035149 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9aa05fd3-4f23-452b-9959-778cf5fc74f4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:06.101943 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-13a16801-60a7-442a-9cff-f854aac2261c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:06.110244 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-13a16801-60a7-442a-9cff-f854aac2261c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.159133 Apr 05 12:13:06.110828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1537/3096] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:05 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:06.129293 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-64753a56-7b25-44b6-bdd6-d48fcbd688b1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:06.129893 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-64753a56-7b25-44b6-bdd6-d48fcbd688b1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:06.138036 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64753a56-7b25-44b6-bdd6-d48fcbd688b1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:06.138663 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64753a56-7b25-44b6-bdd6-d48fcbd688b1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:06.139879 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64753a56-7b25-44b6-bdd6-d48fcbd688b1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:06.140543 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-64753a56-7b25-44b6-bdd6-d48fcbd688b1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:06.169074 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9aa05fd3-4f23-452b-9959-778cf5fc74f4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:06.178601 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9aa05fd3-4f23-452b-9959-778cf5fc74f4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.156101 Apr 05 12:13:06.179217 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1560/3097] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:06 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:13:06.284793 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-64753a56-7b25-44b6-bdd6-d48fcbd688b1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:06.292598 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-64753a56-7b25-44b6-bdd6-d48fcbd688b1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.167295 Apr 05 12:13:06.293157 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1538/3098] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:06 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:13:06.309208 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9067e334-3457-4ac4-b4e5-e691bf115757 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:06.309819 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9067e334-3457-4ac4-b4e5-e691bf115757 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:06.315866 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9067e334-3457-4ac4-b4e5-e691bf115757 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:06.316348 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9067e334-3457-4ac4-b4e5-e691bf115757 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:06.317110 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9067e334-3457-4ac4-b4e5-e691bf115757 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:06.317538 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9067e334-3457-4ac4-b4e5-e691bf115757 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:06.460479 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9067e334-3457-4ac4-b4e5-e691bf115757 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:06.468976 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9067e334-3457-4ac4-b4e5-e691bf115757 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:06.470494 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9067e334-3457-4ac4-b4e5-e691bf115757 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:06.471677 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9067e334-3457-4ac4-b4e5-e691bf115757 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.166391 Apr 05 12:13:06.472765 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1561/3099] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:06 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:07.131945 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c9c35504-a22a-49f6-b319-86a6ddafed7b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:07.133022 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c9c35504-a22a-49f6-b319-86a6ddafed7b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:07.143620 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c9c35504-a22a-49f6-b319-86a6ddafed7b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:07.144531 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c9c35504-a22a-49f6-b319-86a6ddafed7b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:07.145853 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c9c35504-a22a-49f6-b319-86a6ddafed7b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:07.146299 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c9c35504-a22a-49f6-b319-86a6ddafed7b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:07.197065 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7a362da4-461a-4938-93b7-ad1cd056b83d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:07.197771 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7a362da4-461a-4938-93b7-ad1cd056b83d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:07.204417 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a362da4-461a-4938-93b7-ad1cd056b83d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:07.204845 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a362da4-461a-4938-93b7-ad1cd056b83d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:07.205617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a362da4-461a-4938-93b7-ad1cd056b83d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:07.206044 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a362da4-461a-4938-93b7-ad1cd056b83d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:07.289255 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c9c35504-a22a-49f6-b319-86a6ddafed7b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:07.297082 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c9c35504-a22a-49f6-b319-86a6ddafed7b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.172042 Apr 05 12:13:07.297651 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1539/3100] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:07 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:07.309471 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-53ecbc97-d895-4804-bf47-6cf414c676db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:07.310194 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-53ecbc97-d895-4804-bf47-6cf414c676db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:07.316095 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-53ecbc97-d895-4804-bf47-6cf414c676db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:07.316567 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-53ecbc97-d895-4804-bf47-6cf414c676db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:07.317324 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-53ecbc97-d895-4804-bf47-6cf414c676db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:07.317758 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-53ecbc97-d895-4804-bf47-6cf414c676db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:07.338203 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7a362da4-461a-4938-93b7-ad1cd056b83d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:07.346043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7a362da4-461a-4938-93b7-ad1cd056b83d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.153320 Apr 05 12:13:07.346604 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1562/3101] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:07 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:07.453215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-53ecbc97-d895-4804-bf47-6cf414c676db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:07.462927 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-53ecbc97-d895-4804-bf47-6cf414c676db tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.157119 Apr 05 12:13:07.463481 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1540/3102] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:07 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:07.490391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ee2eb687-babd-45d4-9e12-16bfda311039 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:07.490989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ee2eb687-babd-45d4-9e12-16bfda311039 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:07.496984 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ee2eb687-babd-45d4-9e12-16bfda311039 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:07.497429 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ee2eb687-babd-45d4-9e12-16bfda311039 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:07.498181 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ee2eb687-babd-45d4-9e12-16bfda311039 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:07.498586 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ee2eb687-babd-45d4-9e12-16bfda311039 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:07.882160 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ee2eb687-babd-45d4-9e12-16bfda311039 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:07.890799 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ee2eb687-babd-45d4-9e12-16bfda311039 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:07.892893 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ee2eb687-babd-45d4-9e12-16bfda311039 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:07.894237 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ee2eb687-babd-45d4-9e12-16bfda311039 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.408048 Apr 05 12:13:07.895014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1563/3103] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:07 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:08.318650 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-00459d95-c8df-49bb-bb36-b0bf9fff2f8d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:08.319429 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-00459d95-c8df-49bb-bb36-b0bf9fff2f8d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:08.328106 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00459d95-c8df-49bb-bb36-b0bf9fff2f8d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:08.328710 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00459d95-c8df-49bb-bb36-b0bf9fff2f8d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:08.329719 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00459d95-c8df-49bb-bb36-b0bf9fff2f8d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:08.330298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00459d95-c8df-49bb-bb36-b0bf9fff2f8d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:08.362789 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9b6d760c-5ef7-4fdd-b094-959718f6bf9b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:08.363438 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9b6d760c-5ef7-4fdd-b094-959718f6bf9b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:08.370225 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9b6d760c-5ef7-4fdd-b094-959718f6bf9b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:08.370675 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9b6d760c-5ef7-4fdd-b094-959718f6bf9b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:08.371439 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9b6d760c-5ef7-4fdd-b094-959718f6bf9b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:08.371870 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9b6d760c-5ef7-4fdd-b094-959718f6bf9b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:08.469980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-00459d95-c8df-49bb-bb36-b0bf9fff2f8d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:08.479653 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-00459d95-c8df-49bb-bb36-b0bf9fff2f8d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.167544 Apr 05 12:13:08.480254 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1541/3104] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:08 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:08.484682 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-503accb8-06b3-4eb5-b7d9-1f29ad38a7b3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:08.485285 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-503accb8-06b3-4eb5-b7d9-1f29ad38a7b3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:08.491284 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-503accb8-06b3-4eb5-b7d9-1f29ad38a7b3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:08.491700 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-503accb8-06b3-4eb5-b7d9-1f29ad38a7b3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:08.492548 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-503accb8-06b3-4eb5-b7d9-1f29ad38a7b3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:08.492957 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-503accb8-06b3-4eb5-b7d9-1f29ad38a7b3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:08.506639 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9b6d760c-5ef7-4fdd-b094-959718f6bf9b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:08.514505 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9b6d760c-5ef7-4fdd-b094-959718f6bf9b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.155605 Apr 05 12:13:08.515071 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1564/3105] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:08 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:08.627578 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-503accb8-06b3-4eb5-b7d9-1f29ad38a7b3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:08.636268 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-503accb8-06b3-4eb5-b7d9-1f29ad38a7b3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.155013 Apr 05 12:13:08.636844 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1542/3106] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:08 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:08.916919 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8000bd3e-65a7-4074-a290-1419c5f156bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:08.917784 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8000bd3e-65a7-4074-a290-1419c5f156bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:08.927702 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8000bd3e-65a7-4074-a290-1419c5f156bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:08.928172 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8000bd3e-65a7-4074-a290-1419c5f156bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:08.928896 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8000bd3e-65a7-4074-a290-1419c5f156bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:08.929345 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8000bd3e-65a7-4074-a290-1419c5f156bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:09.068104 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8000bd3e-65a7-4074-a290-1419c5f156bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:09.076488 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8000bd3e-65a7-4074-a290-1419c5f156bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:09.077990 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8000bd3e-65a7-4074-a290-1419c5f156bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:09.079143 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8000bd3e-65a7-4074-a290-1419c5f156bf tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.168907 Apr 05 12:13:09.079709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1565/3107] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:08 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:09.501023 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3fcde863-d9ac-4a69-9e0c-a410ecb6d58b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:09.502034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3fcde863-d9ac-4a69-9e0c-a410ecb6d58b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:09.517694 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3fcde863-d9ac-4a69-9e0c-a410ecb6d58b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:09.517694 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3fcde863-d9ac-4a69-9e0c-a410ecb6d58b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:09.519184 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3fcde863-d9ac-4a69-9e0c-a410ecb6d58b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:09.519928 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3fcde863-d9ac-4a69-9e0c-a410ecb6d58b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:09.530783 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fa5cf492-755a-4bf1-8ca2-64020ecc99dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:09.531348 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fa5cf492-755a-4bf1-8ca2-64020ecc99dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:09.537998 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fa5cf492-755a-4bf1-8ca2-64020ecc99dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:09.538440 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fa5cf492-755a-4bf1-8ca2-64020ecc99dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:09.539304 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fa5cf492-755a-4bf1-8ca2-64020ecc99dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:09.539734 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fa5cf492-755a-4bf1-8ca2-64020ecc99dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:09.651827 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3fcde863-d9ac-4a69-9e0c-a410ecb6d58b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:09.659812 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3fcde863-d9ac-4a69-9e0c-a410ecb6d58b tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.165281 Apr 05 12:13:09.671068 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1543/3108] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:09 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:09.677511 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fa5cf492-755a-4bf1-8ca2-64020ecc99dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:09.679010 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0137036f-8aba-4943-91d4-3d7a7e1c2e92 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:09.679618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0137036f-8aba-4943-91d4-3d7a7e1c2e92 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:09.685353 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fa5cf492-755a-4bf1-8ca2-64020ecc99dd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.158393 Apr 05 12:13:09.685915 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0137036f-8aba-4943-91d4-3d7a7e1c2e92 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:09.686368 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1566/3109] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:09 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:09.687097 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0137036f-8aba-4943-91d4-3d7a7e1c2e92 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:09.688058 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0137036f-8aba-4943-91d4-3d7a7e1c2e92 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:09.688521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0137036f-8aba-4943-91d4-3d7a7e1c2e92 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:09.826148 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0137036f-8aba-4943-91d4-3d7a7e1c2e92 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:09.834473 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0137036f-8aba-4943-91d4-3d7a7e1c2e92 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.159300 Apr 05 12:13:09.842516 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1544/3110] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:09 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:10.101594 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c06393e4-484a-4cfd-9264-83b04255b12e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:10.102486 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c06393e4-484a-4cfd-9264-83b04255b12e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:10.113026 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c06393e4-484a-4cfd-9264-83b04255b12e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:10.113796 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c06393e4-484a-4cfd-9264-83b04255b12e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:10.115067 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c06393e4-484a-4cfd-9264-83b04255b12e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:10.115803 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c06393e4-484a-4cfd-9264-83b04255b12e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:10.252528 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c06393e4-484a-4cfd-9264-83b04255b12e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:10.261122 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c06393e4-484a-4cfd-9264-83b04255b12e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:10.262616 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c06393e4-484a-4cfd-9264-83b04255b12e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:10.263855 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c06393e4-484a-4cfd-9264-83b04255b12e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.169040 Apr 05 12:13:10.264443 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1567/3111] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:10 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:10.685330 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-966e75df-6ea8-4de5-ad89-ae150897d77e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:10.686372 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-966e75df-6ea8-4de5-ad89-ae150897d77e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:10.695694 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-966e75df-6ea8-4de5-ad89-ae150897d77e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:10.696246 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-966e75df-6ea8-4de5-ad89-ae150897d77e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:10.697130 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-966e75df-6ea8-4de5-ad89-ae150897d77e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:10.697554 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-966e75df-6ea8-4de5-ad89-ae150897d77e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:10.701875 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0c8fac3e-795d-466e-90fb-d36f2d86783e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:10.702484 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0c8fac3e-795d-466e-90fb-d36f2d86783e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:10.708425 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0c8fac3e-795d-466e-90fb-d36f2d86783e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:10.708883 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0c8fac3e-795d-466e-90fb-d36f2d86783e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:10.709639 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0c8fac3e-795d-466e-90fb-d36f2d86783e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:10.710071 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0c8fac3e-795d-466e-90fb-d36f2d86783e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:10.830232 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-966e75df-6ea8-4de5-ad89-ae150897d77e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:10.837883 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-966e75df-6ea8-4de5-ad89-ae150897d77e tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.158992 Apr 05 12:13:10.838451 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1545/3112] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:10 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:10.844287 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0c8fac3e-795d-466e-90fb-d36f2d86783e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:10.850437 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-488921e0-5ac5-475a-a004-cc9df75deb18 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:10.851045 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-488921e0-5ac5-475a-a004-cc9df75deb18 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:10.852232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0c8fac3e-795d-466e-90fb-d36f2d86783e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.154122 Apr 05 12:13:10.852806 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1568/3113] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:10 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:10.856938 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-488921e0-5ac5-475a-a004-cc9df75deb18 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:10.857383 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-488921e0-5ac5-475a-a004-cc9df75deb18 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:10.858147 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-488921e0-5ac5-475a-a004-cc9df75deb18 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:10.858580 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-488921e0-5ac5-475a-a004-cc9df75deb18 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:11.001189 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-488921e0-5ac5-475a-a004-cc9df75deb18 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:11.013518 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-488921e0-5ac5-475a-a004-cc9df75deb18 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.166630 Apr 05 12:13:11.014326 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1546/3114] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:10 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:13:11.286631 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e86c28cb-113c-41d9-9b43-5a0419204c55 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:11.287163 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e86c28cb-113c-41d9-9b43-5a0419204c55 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:11.293854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e86c28cb-113c-41d9-9b43-5a0419204c55 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:11.294300 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e86c28cb-113c-41d9-9b43-5a0419204c55 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:11.295055 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e86c28cb-113c-41d9-9b43-5a0419204c55 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:11.295483 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e86c28cb-113c-41d9-9b43-5a0419204c55 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:11.436292 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e86c28cb-113c-41d9-9b43-5a0419204c55 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:11.445252 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e86c28cb-113c-41d9-9b43-5a0419204c55 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:11.446734 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e86c28cb-113c-41d9-9b43-5a0419204c55 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:11.447897 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e86c28cb-113c-41d9-9b43-5a0419204c55 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.167975 Apr 05 12:13:11.448460 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1569/3115] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:11 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:11.854999 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7fba4866-8de2-41ac-bae4-f3da299858e7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:11.855663 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7fba4866-8de2-41ac-bae4-f3da299858e7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:11.862352 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7fba4866-8de2-41ac-bae4-f3da299858e7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:11.862790 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7fba4866-8de2-41ac-bae4-f3da299858e7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:11.863716 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7fba4866-8de2-41ac-bae4-f3da299858e7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:11.864997 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7fba4866-8de2-41ac-bae4-f3da299858e7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:11.869287 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bc572ed0-44e1-48f9-96d9-ea1ddf4495cb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:11.869880 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bc572ed0-44e1-48f9-96d9-ea1ddf4495cb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:11.876087 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bc572ed0-44e1-48f9-96d9-ea1ddf4495cb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:11.876538 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bc572ed0-44e1-48f9-96d9-ea1ddf4495cb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:11.877326 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bc572ed0-44e1-48f9-96d9-ea1ddf4495cb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:11.877752 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bc572ed0-44e1-48f9-96d9-ea1ddf4495cb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:12.001046 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7fba4866-8de2-41ac-bae4-f3da299858e7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:12.009219 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7fba4866-8de2-41ac-bae4-f3da299858e7 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.158152 Apr 05 12:13:12.009796 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1547/3116] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:11 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:12.011617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bc572ed0-44e1-48f9-96d9-ea1ddf4495cb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:12.019949 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bc572ed0-44e1-48f9-96d9-ea1ddf4495cb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.154407 Apr 05 12:13:12.020517 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1570/3117] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:11 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:12.033270 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-62867263-8011-4656-a9b7-7aeaa22113ef tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:12.033875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-62867263-8011-4656-a9b7-7aeaa22113ef tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:12.039758 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-62867263-8011-4656-a9b7-7aeaa22113ef tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:12.040250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-62867263-8011-4656-a9b7-7aeaa22113ef tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:12.040999 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-62867263-8011-4656-a9b7-7aeaa22113ef tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:12.041432 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-62867263-8011-4656-a9b7-7aeaa22113ef tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:12.180950 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-62867263-8011-4656-a9b7-7aeaa22113ef tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:12.189089 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-62867263-8011-4656-a9b7-7aeaa22113ef tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.159606 Apr 05 12:13:12.189628 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1548/3118] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:12 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:12.467127 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2e6f540f-70de-4f65-aee7-8e711c2e270c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:12.467787 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2e6f540f-70de-4f65-aee7-8e711c2e270c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:12.475212 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2e6f540f-70de-4f65-aee7-8e711c2e270c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:12.475697 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2e6f540f-70de-4f65-aee7-8e711c2e270c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:12.476587 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2e6f540f-70de-4f65-aee7-8e711c2e270c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:12.477035 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2e6f540f-70de-4f65-aee7-8e711c2e270c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:12.628774 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2e6f540f-70de-4f65-aee7-8e711c2e270c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:12.641853 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2e6f540f-70de-4f65-aee7-8e711c2e270c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:12.644308 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2e6f540f-70de-4f65-aee7-8e711c2e270c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:12.646016 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2e6f540f-70de-4f65-aee7-8e711c2e270c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.183169 Apr 05 12:13:12.646584 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1571/3119] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:12 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:13.026456 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-805f49ab-b8ea-489e-9f42-f086425ed2f0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:13.027111 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-805f49ab-b8ea-489e-9f42-f086425ed2f0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:13.034153 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-805f49ab-b8ea-489e-9f42-f086425ed2f0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:13.034603 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-805f49ab-b8ea-489e-9f42-f086425ed2f0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:13.035370 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-805f49ab-b8ea-489e-9f42-f086425ed2f0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:13.035850 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-805f49ab-b8ea-489e-9f42-f086425ed2f0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:13.037254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2fa9b9eb-1cfd-4f72-95f9-bfc3da4d9e1a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:13.037876 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2fa9b9eb-1cfd-4f72-95f9-bfc3da4d9e1a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:13.043916 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2fa9b9eb-1cfd-4f72-95f9-bfc3da4d9e1a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:13.044400 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2fa9b9eb-1cfd-4f72-95f9-bfc3da4d9e1a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:13.045174 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2fa9b9eb-1cfd-4f72-95f9-bfc3da4d9e1a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:13.045612 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2fa9b9eb-1cfd-4f72-95f9-bfc3da4d9e1a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:13.176107 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-805f49ab-b8ea-489e-9f42-f086425ed2f0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:13.184159 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-805f49ab-b8ea-489e-9f42-f086425ed2f0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.161618 Apr 05 12:13:13.184556 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2fa9b9eb-1cfd-4f72-95f9-bfc3da4d9e1a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:13.185362 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1549/3120] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:13 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:13.192521 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2fa9b9eb-1cfd-4f72-95f9-bfc3da4d9e1a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.159114 Apr 05 12:13:13.193081 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1572/3121] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:13 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:13.206030 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-631e873f-1dac-4b23-8318-906e155de4d6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:13.206631 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-631e873f-1dac-4b23-8318-906e155de4d6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:13.212580 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-631e873f-1dac-4b23-8318-906e155de4d6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:13.213022 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-631e873f-1dac-4b23-8318-906e155de4d6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:13.213778 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-631e873f-1dac-4b23-8318-906e155de4d6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:13.214206 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-631e873f-1dac-4b23-8318-906e155de4d6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:13.352026 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-631e873f-1dac-4b23-8318-906e155de4d6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:13.360131 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-631e873f-1dac-4b23-8318-906e155de4d6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.157829 Apr 05 12:13:13.360699 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1550/3122] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:13 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:13:13.668656 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e0df54fc-dd46-4dd5-81ae-293985f94423 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:13.669637 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e0df54fc-dd46-4dd5-81ae-293985f94423 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:13.680202 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0df54fc-dd46-4dd5-81ae-293985f94423 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:13.680946 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0df54fc-dd46-4dd5-81ae-293985f94423 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:13.682169 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0df54fc-dd46-4dd5-81ae-293985f94423 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:13.682874 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e0df54fc-dd46-4dd5-81ae-293985f94423 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:13.824610 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e0df54fc-dd46-4dd5-81ae-293985f94423 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:13.838047 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e0df54fc-dd46-4dd5-81ae-293985f94423 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:13.839530 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e0df54fc-dd46-4dd5-81ae-293985f94423 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:13.840693 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e0df54fc-dd46-4dd5-81ae-293985f94423 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.178764 Apr 05 12:13:13.841248 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1573/3123] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:13 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:14.205525 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ec1f45dc-042b-4651-a013-3663973cd229 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:14.206405 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ec1f45dc-042b-4651-a013-3663973cd229 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:14.211506 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-86ca4592-487e-46d0-aeb3-a8986906e43e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:14.212107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-86ca4592-487e-46d0-aeb3-a8986906e43e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:14.213659 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec1f45dc-042b-4651-a013-3663973cd229 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:14.214139 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec1f45dc-042b-4651-a013-3663973cd229 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:14.214896 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec1f45dc-042b-4651-a013-3663973cd229 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:14.215324 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec1f45dc-042b-4651-a013-3663973cd229 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:14.218794 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-86ca4592-487e-46d0-aeb3-a8986906e43e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:14.219243 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-86ca4592-487e-46d0-aeb3-a8986906e43e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:14.220047 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-86ca4592-487e-46d0-aeb3-a8986906e43e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:14.220518 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-86ca4592-487e-46d0-aeb3-a8986906e43e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:14.356663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-86ca4592-487e-46d0-aeb3-a8986906e43e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:14.356877 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ec1f45dc-042b-4651-a013-3663973cd229 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:14.364670 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-86ca4592-487e-46d0-aeb3-a8986906e43e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.157758 Apr 05 12:13:14.364851 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ec1f45dc-042b-4651-a013-3663973cd229 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.165959 Apr 05 12:13:14.365235 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1574/3124] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:14 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:14.365358 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1551/3125] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:14 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:14.376526 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9a545fd9-f74f-4122-b475-53f39bcd98f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:14.377135 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9a545fd9-f74f-4122-b475-53f39bcd98f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:14.383371 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9a545fd9-f74f-4122-b475-53f39bcd98f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:14.383817 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9a545fd9-f74f-4122-b475-53f39bcd98f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:14.384607 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9a545fd9-f74f-4122-b475-53f39bcd98f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:14.385043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9a545fd9-f74f-4122-b475-53f39bcd98f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:14.520798 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9a545fd9-f74f-4122-b475-53f39bcd98f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:14.528838 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9a545fd9-f74f-4122-b475-53f39bcd98f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.156024 Apr 05 12:13:14.529393 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1575/3126] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:14 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:14.863064 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1b4f6149-ef15-4d43-94b1-6ac739db853b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:14.864009 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1b4f6149-ef15-4d43-94b1-6ac739db853b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:14.870757 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1b4f6149-ef15-4d43-94b1-6ac739db853b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:14.871208 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1b4f6149-ef15-4d43-94b1-6ac739db853b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:14.871970 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1b4f6149-ef15-4d43-94b1-6ac739db853b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:14.872433 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1b4f6149-ef15-4d43-94b1-6ac739db853b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:15.016009 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1b4f6149-ef15-4d43-94b1-6ac739db853b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:15.024952 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1b4f6149-ef15-4d43-94b1-6ac739db853b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:15.026492 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1b4f6149-ef15-4d43-94b1-6ac739db853b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:15.027659 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1b4f6149-ef15-4d43-94b1-6ac739db853b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.171309 Apr 05 12:13:15.028423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1552/3127] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:14 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:15.386493 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bc9a7223-929e-4186-b499-c9a01de50c5d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:15.387361 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b2b9057e-54d2-48fb-9d97-cfdef1af5251 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:15.388029 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bc9a7223-929e-4186-b499-c9a01de50c5d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:15.388239 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b2b9057e-54d2-48fb-9d97-cfdef1af5251 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:15.397273 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bc9a7223-929e-4186-b499-c9a01de50c5d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:15.397463 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b2b9057e-54d2-48fb-9d97-cfdef1af5251 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:15.397714 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bc9a7223-929e-4186-b499-c9a01de50c5d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:15.397878 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b2b9057e-54d2-48fb-9d97-cfdef1af5251 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:15.398460 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bc9a7223-929e-4186-b499-c9a01de50c5d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:15.398633 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b2b9057e-54d2-48fb-9d97-cfdef1af5251 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:15.398887 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bc9a7223-929e-4186-b499-c9a01de50c5d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:15.399046 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b2b9057e-54d2-48fb-9d97-cfdef1af5251 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:15.531009 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b2b9057e-54d2-48fb-9d97-cfdef1af5251 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:15.532456 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bc9a7223-929e-4186-b499-c9a01de50c5d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:15.539076 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b2b9057e-54d2-48fb-9d97-cfdef1af5251 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.158127 Apr 05 12:13:15.539655 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1553/3128] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:15 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:15.540144 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bc9a7223-929e-4186-b499-c9a01de50c5d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.160043 Apr 05 12:13:15.540788 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1576/3129] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:15 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:15.549207 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1aa506a4-521c-4b1a-a423-067316b61054 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:15.549811 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1aa506a4-521c-4b1a-a423-067316b61054 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:15.555803 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1aa506a4-521c-4b1a-a423-067316b61054 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:15.556298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1aa506a4-521c-4b1a-a423-067316b61054 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:15.557051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1aa506a4-521c-4b1a-a423-067316b61054 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:15.557484 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1aa506a4-521c-4b1a-a423-067316b61054 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:15.701010 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1aa506a4-521c-4b1a-a423-067316b61054 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:15.709505 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1aa506a4-521c-4b1a-a423-067316b61054 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.163985 Apr 05 12:13:15.710075 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1554/3130] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:15 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:13:16.048851 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ecdad1e4-ca17-4cc0-8ad5-56aa09d4d925 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:16.049842 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ecdad1e4-ca17-4cc0-8ad5-56aa09d4d925 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:16.060044 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ecdad1e4-ca17-4cc0-8ad5-56aa09d4d925 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:16.060853 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ecdad1e4-ca17-4cc0-8ad5-56aa09d4d925 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:16.062155 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ecdad1e4-ca17-4cc0-8ad5-56aa09d4d925 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:16.062875 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ecdad1e4-ca17-4cc0-8ad5-56aa09d4d925 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:16.198532 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ecdad1e4-ca17-4cc0-8ad5-56aa09d4d925 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:16.207191 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ecdad1e4-ca17-4cc0-8ad5-56aa09d4d925 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:16.208772 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ecdad1e4-ca17-4cc0-8ad5-56aa09d4d925 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:16.209954 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ecdad1e4-ca17-4cc0-8ad5-56aa09d4d925 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.167593 Apr 05 12:13:16.210518 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1577/3131] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:16 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:16.560754 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-199c49f5-0406-431e-a93b-96bf2c4a4ee2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:16.561669 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d22606ac-4941-408e-bd23-14e628cfad6d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:16.562322 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-199c49f5-0406-431e-a93b-96bf2c4a4ee2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:16.562505 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d22606ac-4941-408e-bd23-14e628cfad6d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:16.570936 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-199c49f5-0406-431e-a93b-96bf2c4a4ee2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:16.571146 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d22606ac-4941-408e-bd23-14e628cfad6d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:16.571388 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d22606ac-4941-408e-bd23-14e628cfad6d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:16.571549 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-199c49f5-0406-431e-a93b-96bf2c4a4ee2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:16.572175 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d22606ac-4941-408e-bd23-14e628cfad6d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:16.572329 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-199c49f5-0406-431e-a93b-96bf2c4a4ee2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:16.572690 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d22606ac-4941-408e-bd23-14e628cfad6d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:16.572920 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-199c49f5-0406-431e-a93b-96bf2c4a4ee2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:16.708490 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-199c49f5-0406-431e-a93b-96bf2c4a4ee2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:16.710459 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d22606ac-4941-408e-bd23-14e628cfad6d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:16.716893 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-199c49f5-0406-431e-a93b-96bf2c4a4ee2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.162789 Apr 05 12:13:16.717446 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1555/3132] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:16 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:16.718639 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d22606ac-4941-408e-bd23-14e628cfad6d tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.163797 Apr 05 12:13:16.719204 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1578/3133] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:16 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:16.728257 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-29a6c23b-257c-4d7f-ac2d-73340121fc71 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:16.728923 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-29a6c23b-257c-4d7f-ac2d-73340121fc71 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:16.734929 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-29a6c23b-257c-4d7f-ac2d-73340121fc71 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:16.735367 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-29a6c23b-257c-4d7f-ac2d-73340121fc71 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:16.736128 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-29a6c23b-257c-4d7f-ac2d-73340121fc71 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:16.736584 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-29a6c23b-257c-4d7f-ac2d-73340121fc71 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:16.881802 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-29a6c23b-257c-4d7f-ac2d-73340121fc71 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:16.889878 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-29a6c23b-257c-4d7f-ac2d-73340121fc71 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.165470 Apr 05 12:13:16.890441 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1556/3134] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:16 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:13:17.232468 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c4c32da4-b1dd-4dc8-8676-fbaecc04c3b9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:17.233473 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c4c32da4-b1dd-4dc8-8676-fbaecc04c3b9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:17.241614 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c4c32da4-b1dd-4dc8-8676-fbaecc04c3b9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:17.242063 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c4c32da4-b1dd-4dc8-8676-fbaecc04c3b9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:17.242813 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c4c32da4-b1dd-4dc8-8676-fbaecc04c3b9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:17.243244 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c4c32da4-b1dd-4dc8-8676-fbaecc04c3b9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:17.385742 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c4c32da4-b1dd-4dc8-8676-fbaecc04c3b9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:17.394213 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c4c32da4-b1dd-4dc8-8676-fbaecc04c3b9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:17.395686 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c4c32da4-b1dd-4dc8-8676-fbaecc04c3b9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:17.396861 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c4c32da4-b1dd-4dc8-8676-fbaecc04c3b9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.170913 Apr 05 12:13:17.397421 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1579/3135] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:17 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:17.738081 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2353a918-575b-4c32-be7c-2aae764e10ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:17.739925 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2353a918-575b-4c32-be7c-2aae764e10ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:17.740269 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8524ceac-5369-4fb2-9975-fb656fa489be tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:17.740887 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8524ceac-5369-4fb2-9975-fb656fa489be tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:17.747160 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2353a918-575b-4c32-be7c-2aae764e10ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:17.747390 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8524ceac-5369-4fb2-9975-fb656fa489be tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:17.747645 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2353a918-575b-4c32-be7c-2aae764e10ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:17.747929 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8524ceac-5369-4fb2-9975-fb656fa489be tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:17.748526 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2353a918-575b-4c32-be7c-2aae764e10ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:17.748778 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8524ceac-5369-4fb2-9975-fb656fa489be tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:17.749079 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2353a918-575b-4c32-be7c-2aae764e10ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:17.749319 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8524ceac-5369-4fb2-9975-fb656fa489be tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:17.882342 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2353a918-575b-4c32-be7c-2aae764e10ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:17.884156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8524ceac-5369-4fb2-9975-fb656fa489be tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:17.891999 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8524ceac-5369-4fb2-9975-fb656fa489be tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.158440 Apr 05 12:13:17.892601 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1580/3136] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:17 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:17.894096 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2353a918-575b-4c32-be7c-2aae764e10ad tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.162103 Apr 05 12:13:17.895063 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1557/3137] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:17 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:17.909462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e7757456-7eb2-4343-8101-d410310155df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:17.910376 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e7757456-7eb2-4343-8101-d410310155df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:17.917826 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e7757456-7eb2-4343-8101-d410310155df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:17.918452 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e7757456-7eb2-4343-8101-d410310155df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:17.919583 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e7757456-7eb2-4343-8101-d410310155df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:17.920136 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e7757456-7eb2-4343-8101-d410310155df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:18.065527 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e7757456-7eb2-4343-8101-d410310155df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:18.074319 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e7757456-7eb2-4343-8101-d410310155df tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.169368 Apr 05 12:13:18.074905 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1581/3138] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:17 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:18.421962 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f8136743-efc6-4a6b-a044-b4179ada8399 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:18.422637 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f8136743-efc6-4a6b-a044-b4179ada8399 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:18.430580 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f8136743-efc6-4a6b-a044-b4179ada8399 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:18.431035 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f8136743-efc6-4a6b-a044-b4179ada8399 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:18.431807 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f8136743-efc6-4a6b-a044-b4179ada8399 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:18.432282 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f8136743-efc6-4a6b-a044-b4179ada8399 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:18.568725 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f8136743-efc6-4a6b-a044-b4179ada8399 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:18.582325 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f8136743-efc6-4a6b-a044-b4179ada8399 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:18.584253 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f8136743-efc6-4a6b-a044-b4179ada8399 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:18.585408 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f8136743-efc6-4a6b-a044-b4179ada8399 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.169047 Apr 05 12:13:18.585968 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1558/3139] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:18 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:18.913656 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8f31c549-db07-4c7e-877e-c62751b68761 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:18.914471 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e00d4a45-6a20-495c-8131-4aa9c467bc20 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:18.914959 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8f31c549-db07-4c7e-877e-c62751b68761 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:18.915098 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e00d4a45-6a20-495c-8131-4aa9c467bc20 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:18.921913 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f31c549-db07-4c7e-877e-c62751b68761 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:18.922402 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e00d4a45-6a20-495c-8131-4aa9c467bc20 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:18.922606 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f31c549-db07-4c7e-877e-c62751b68761 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:18.922930 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e00d4a45-6a20-495c-8131-4aa9c467bc20 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:18.923236 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f31c549-db07-4c7e-877e-c62751b68761 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:18.923709 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f31c549-db07-4c7e-877e-c62751b68761 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:18.923889 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e00d4a45-6a20-495c-8131-4aa9c467bc20 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:18.924263 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e00d4a45-6a20-495c-8131-4aa9c467bc20 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:19.064430 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8f31c549-db07-4c7e-877e-c62751b68761 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:19.066502 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e00d4a45-6a20-495c-8131-4aa9c467bc20 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:19.072606 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8f31c549-db07-4c7e-877e-c62751b68761 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.164569 Apr 05 12:13:19.073148 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1559/3140] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:18 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:19.074420 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e00d4a45-6a20-495c-8131-4aa9c467bc20 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.166402 Apr 05 12:13:19.075019 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1582/3141] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:18 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:19.095648 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-88a723e3-4069-417b-8953-1d9c83930638 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:19.096292 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-88a723e3-4069-417b-8953-1d9c83930638 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:19.102344 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-88a723e3-4069-417b-8953-1d9c83930638 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:19.102788 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-88a723e3-4069-417b-8953-1d9c83930638 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:19.103536 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-88a723e3-4069-417b-8953-1d9c83930638 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:19.103963 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-88a723e3-4069-417b-8953-1d9c83930638 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:19.252715 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-88a723e3-4069-417b-8953-1d9c83930638 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:19.261320 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-88a723e3-4069-417b-8953-1d9c83930638 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.169261 Apr 05 12:13:19.261886 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1560/3142] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:19 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:19.604269 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-067b648d-a8a1-4e36-a003-ca7ff925ef7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:19.604880 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-067b648d-a8a1-4e36-a003-ca7ff925ef7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:19.611046 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-067b648d-a8a1-4e36-a003-ca7ff925ef7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:19.611500 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-067b648d-a8a1-4e36-a003-ca7ff925ef7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:19.612302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-067b648d-a8a1-4e36-a003-ca7ff925ef7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:19.612740 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-067b648d-a8a1-4e36-a003-ca7ff925ef7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:19.746116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-067b648d-a8a1-4e36-a003-ca7ff925ef7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:19.754897 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-067b648d-a8a1-4e36-a003-ca7ff925ef7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:19.756570 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-067b648d-a8a1-4e36-a003-ca7ff925ef7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:19.757729 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-067b648d-a8a1-4e36-a003-ca7ff925ef7e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.157628 Apr 05 12:13:19.758269 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1583/3143] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:19 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:20.094246 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7d7b012e-699d-4323-b4b7-193f661da76c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:20.095129 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7d7b012e-699d-4323-b4b7-193f661da76c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:20.095343 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a00ec8dd-a3ab-4394-b8d7-d0e48ef847e0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:20.096398 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a00ec8dd-a3ab-4394-b8d7-d0e48ef847e0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:20.105732 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7d7b012e-699d-4323-b4b7-193f661da76c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:20.106471 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7d7b012e-699d-4323-b4b7-193f661da76c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:20.106736 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a00ec8dd-a3ab-4394-b8d7-d0e48ef847e0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:20.107398 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a00ec8dd-a3ab-4394-b8d7-d0e48ef847e0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:20.107672 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7d7b012e-699d-4323-b4b7-193f661da76c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:20.108506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7d7b012e-699d-4323-b4b7-193f661da76c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:20.108832 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a00ec8dd-a3ab-4394-b8d7-d0e48ef847e0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:20.109412 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a00ec8dd-a3ab-4394-b8d7-d0e48ef847e0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:20.246326 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7d7b012e-699d-4323-b4b7-193f661da76c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:20.246727 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a00ec8dd-a3ab-4394-b8d7-d0e48ef847e0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:20.254898 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7d7b012e-699d-4323-b4b7-193f661da76c tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.167394 Apr 05 12:13:20.255108 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a00ec8dd-a3ab-4394-b8d7-d0e48ef847e0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.165991 Apr 05 12:13:20.255442 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1561/3144] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:20 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:20.257820 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1584/3145] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:20 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:20.278711 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-03d117b6-c24e-40fb-8979-8c3e29778552 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:20.279471 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-03d117b6-c24e-40fb-8979-8c3e29778552 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:20.285609 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03d117b6-c24e-40fb-8979-8c3e29778552 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:20.286055 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03d117b6-c24e-40fb-8979-8c3e29778552 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:20.286850 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03d117b6-c24e-40fb-8979-8c3e29778552 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:20.287281 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03d117b6-c24e-40fb-8979-8c3e29778552 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:20.423344 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-03d117b6-c24e-40fb-8979-8c3e29778552 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:20.435667 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-03d117b6-c24e-40fb-8979-8c3e29778552 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.160357 Apr 05 12:13:20.436308 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1562/3146] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:20 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:20.781944 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-96c7e506-8185-47eb-ae52-13d625a3f422 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:20.782949 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-96c7e506-8185-47eb-ae52-13d625a3f422 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:20.791486 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-96c7e506-8185-47eb-ae52-13d625a3f422 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:20.792064 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-96c7e506-8185-47eb-ae52-13d625a3f422 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:20.793204 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-96c7e506-8185-47eb-ae52-13d625a3f422 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:20.793766 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-96c7e506-8185-47eb-ae52-13d625a3f422 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:20.936667 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-96c7e506-8185-47eb-ae52-13d625a3f422 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:20.945313 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-96c7e506-8185-47eb-ae52-13d625a3f422 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:20.946823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-96c7e506-8185-47eb-ae52-13d625a3f422 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:20.947982 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-96c7e506-8185-47eb-ae52-13d625a3f422 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.171373 Apr 05 12:13:20.948584 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1585/3147] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:20 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:21.276067 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3d8b47b4-094f-4082-a8c3-a168fdf4f3db tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:21.276997 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-eaabb9ae-ac7b-4584-b2ac-e36c9fae1fde tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:21.277608 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3d8b47b4-094f-4082-a8c3-a168fdf4f3db tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:21.277796 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-eaabb9ae-ac7b-4584-b2ac-e36c9fae1fde tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:21.286914 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3d8b47b4-094f-4082-a8c3-a168fdf4f3db tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:21.287142 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eaabb9ae-ac7b-4584-b2ac-e36c9fae1fde tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:21.287362 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3d8b47b4-094f-4082-a8c3-a168fdf4f3db tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:21.287614 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eaabb9ae-ac7b-4584-b2ac-e36c9fae1fde tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:21.288162 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3d8b47b4-094f-4082-a8c3-a168fdf4f3db tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:21.288513 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eaabb9ae-ac7b-4584-b2ac-e36c9fae1fde tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:21.288666 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3d8b47b4-094f-4082-a8c3-a168fdf4f3db tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:21.288943 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eaabb9ae-ac7b-4584-b2ac-e36c9fae1fde tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:21.423153 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-eaabb9ae-ac7b-4584-b2ac-e36c9fae1fde tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:21.425139 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3d8b47b4-094f-4082-a8c3-a168fdf4f3db tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:21.431239 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-eaabb9ae-ac7b-4584-b2ac-e36c9fae1fde tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.161439 Apr 05 12:13:21.431817 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1586/3148] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:21 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:21.432784 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3d8b47b4-094f-4082-a8c3-a168fdf4f3db tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.163164 Apr 05 12:13:21.433350 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1563/3149] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:21 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:21.452823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1048adfb-cb20-4e60-b390-78c422f07906 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:21.453454 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1048adfb-cb20-4e60-b390-78c422f07906 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:21.459421 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1048adfb-cb20-4e60-b390-78c422f07906 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:21.459873 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1048adfb-cb20-4e60-b390-78c422f07906 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:21.460654 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1048adfb-cb20-4e60-b390-78c422f07906 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:21.461094 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1048adfb-cb20-4e60-b390-78c422f07906 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:21.607792 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1048adfb-cb20-4e60-b390-78c422f07906 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:21.616478 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1048adfb-cb20-4e60-b390-78c422f07906 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.167384 Apr 05 12:13:21.617025 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1587/3150] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:21 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:21.970457 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c1783ca2-d8d1-43f1-88ce-ca78c31e6d46 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:21.971457 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c1783ca2-d8d1-43f1-88ce-ca78c31e6d46 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:21.978722 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1783ca2-d8d1-43f1-88ce-ca78c31e6d46 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:21.979239 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1783ca2-d8d1-43f1-88ce-ca78c31e6d46 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:21.980037 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1783ca2-d8d1-43f1-88ce-ca78c31e6d46 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:21.980497 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1783ca2-d8d1-43f1-88ce-ca78c31e6d46 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:22.117444 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c1783ca2-d8d1-43f1-88ce-ca78c31e6d46 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:22.130563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c1783ca2-d8d1-43f1-88ce-ca78c31e6d46 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:22.132043 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c1783ca2-d8d1-43f1-88ce-ca78c31e6d46 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:22.133207 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c1783ca2-d8d1-43f1-88ce-ca78c31e6d46 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.170067 Apr 05 12:13:22.133765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1564/3151] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:21 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:22.448862 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-364cecb7-338c-4502-9b3f-00fe4bee2293 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:22.449470 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-364cecb7-338c-4502-9b3f-00fe4bee2293 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:22.450295 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bfd10109-7384-4837-ba4c-cb93ea13baf5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:22.450913 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bfd10109-7384-4837-ba4c-cb93ea13baf5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:22.456398 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-364cecb7-338c-4502-9b3f-00fe4bee2293 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:22.456846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-364cecb7-338c-4502-9b3f-00fe4bee2293 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:22.457611 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-364cecb7-338c-4502-9b3f-00fe4bee2293 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:22.457762 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bfd10109-7384-4837-ba4c-cb93ea13baf5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:22.458041 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-364cecb7-338c-4502-9b3f-00fe4bee2293 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:22.458246 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bfd10109-7384-4837-ba4c-cb93ea13baf5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:22.458931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bfd10109-7384-4837-ba4c-cb93ea13baf5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:22.459364 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bfd10109-7384-4837-ba4c-cb93ea13baf5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:22.589483 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-bfd10109-7384-4837-ba4c-cb93ea13baf5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:22.591644 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-364cecb7-338c-4502-9b3f-00fe4bee2293 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:22.597709 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bfd10109-7384-4837-ba4c-cb93ea13baf5 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.151816 Apr 05 12:13:22.598329 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1565/3152] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:22 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:22.600106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-364cecb7-338c-4502-9b3f-00fe4bee2293 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.155085 Apr 05 12:13:22.600641 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1588/3153] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:22 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:22.634044 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-36bd1a85-55e5-4442-93e0-582905d7e885 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:22.634642 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-36bd1a85-55e5-4442-93e0-582905d7e885 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:22.640905 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-36bd1a85-55e5-4442-93e0-582905d7e885 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:22.641290 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-36bd1a85-55e5-4442-93e0-582905d7e885 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:22.642046 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-36bd1a85-55e5-4442-93e0-582905d7e885 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:22.642477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-36bd1a85-55e5-4442-93e0-582905d7e885 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:22.787638 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-36bd1a85-55e5-4442-93e0-582905d7e885 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:22.795619 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-36bd1a85-55e5-4442-93e0-582905d7e885 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.165378 Apr 05 12:13:22.796213 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1566/3154] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:22 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:23.156031 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-72b77f90-d774-49ba-a597-55cb28b6f6ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:23.157053 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-72b77f90-d774-49ba-a597-55cb28b6f6ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:23.167854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-72b77f90-d774-49ba-a597-55cb28b6f6ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:23.167854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-72b77f90-d774-49ba-a597-55cb28b6f6ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:23.169027 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-72b77f90-d774-49ba-a597-55cb28b6f6ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:23.169893 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-72b77f90-d774-49ba-a597-55cb28b6f6ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:23.313558 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-72b77f90-d774-49ba-a597-55cb28b6f6ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:23.323735 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-72b77f90-d774-49ba-a597-55cb28b6f6ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:23.325259 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-72b77f90-d774-49ba-a597-55cb28b6f6ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:23.326412 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-72b77f90-d774-49ba-a597-55cb28b6f6ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.176965 Apr 05 12:13:23.326984 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1589/3155] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:23 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:23.619053 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-82c190b9-42d5-4473-9179-968b4a225bd6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:23.620029 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-82c190b9-42d5-4473-9179-968b4a225bd6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:23.620709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bdf6010d-02f3-4e7b-8b78-d4820df969be tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:23.621709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bdf6010d-02f3-4e7b-8b78-d4820df969be tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:23.630557 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-82c190b9-42d5-4473-9179-968b4a225bd6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:23.631000 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-82c190b9-42d5-4473-9179-968b4a225bd6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:23.631768 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-82c190b9-42d5-4473-9179-968b4a225bd6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:23.631920 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bdf6010d-02f3-4e7b-8b78-d4820df969be tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:23.632233 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-82c190b9-42d5-4473-9179-968b4a225bd6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:23.632410 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bdf6010d-02f3-4e7b-8b78-d4820df969be tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:23.633014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bdf6010d-02f3-4e7b-8b78-d4820df969be tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:23.633444 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bdf6010d-02f3-4e7b-8b78-d4820df969be tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:23.764698 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bdf6010d-02f3-4e7b-8b78-d4820df969be tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:23.766085 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-82c190b9-42d5-4473-9179-968b4a225bd6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:23.772749 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bdf6010d-02f3-4e7b-8b78-d4820df969be tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.158420 Apr 05 12:13:23.773325 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1590/3156] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:23 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:23.774202 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-82c190b9-42d5-4473-9179-968b4a225bd6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.161749 Apr 05 12:13:23.774840 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1567/3157] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:23 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:23.813475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5f3124ca-a712-48fc-be14-e3a9342401a0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:23.814198 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5f3124ca-a712-48fc-be14-e3a9342401a0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:23.820660 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5f3124ca-a712-48fc-be14-e3a9342401a0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:23.821100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5f3124ca-a712-48fc-be14-e3a9342401a0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:23.821869 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5f3124ca-a712-48fc-be14-e3a9342401a0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:23.822292 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5f3124ca-a712-48fc-be14-e3a9342401a0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:23.966202 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5f3124ca-a712-48fc-be14-e3a9342401a0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:23.978572 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5f3124ca-a712-48fc-be14-e3a9342401a0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.169028 Apr 05 12:13:23.979332 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1591/3158] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:23 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:24.349285 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-55cfbc3c-10e2-4fdf-a941-f1736e511b65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:24.349964 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-55cfbc3c-10e2-4fdf-a941-f1736e511b65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:24.357100 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-55cfbc3c-10e2-4fdf-a941-f1736e511b65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:24.357601 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-55cfbc3c-10e2-4fdf-a941-f1736e511b65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:24.358457 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-55cfbc3c-10e2-4fdf-a941-f1736e511b65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:24.358944 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-55cfbc3c-10e2-4fdf-a941-f1736e511b65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:24.498180 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-55cfbc3c-10e2-4fdf-a941-f1736e511b65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:24.507178 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-55cfbc3c-10e2-4fdf-a941-f1736e511b65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:24.508699 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-55cfbc3c-10e2-4fdf-a941-f1736e511b65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:24.509882 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-55cfbc3c-10e2-4fdf-a941-f1736e511b65 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.167333 Apr 05 12:13:24.510463 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1568/3159] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:24 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:24.794302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-27461621-e465-4a30-8aa2-36972a4611c0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:24.795214 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a55fb2ff-e94b-4a26-86c5-5041d492ffbb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:24.795925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-27461621-e465-4a30-8aa2-36972a4611c0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:24.796167 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a55fb2ff-e94b-4a26-86c5-5041d492ffbb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:24.805741 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a55fb2ff-e94b-4a26-86c5-5041d492ffbb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:24.806042 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-27461621-e465-4a30-8aa2-36972a4611c0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:24.806474 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a55fb2ff-e94b-4a26-86c5-5041d492ffbb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:24.806792 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-27461621-e465-4a30-8aa2-36972a4611c0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:24.807715 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a55fb2ff-e94b-4a26-86c5-5041d492ffbb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:24.807975 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-27461621-e465-4a30-8aa2-36972a4611c0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:24.808509 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-27461621-e465-4a30-8aa2-36972a4611c0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:24.808762 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a55fb2ff-e94b-4a26-86c5-5041d492ffbb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:24.947553 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a55fb2ff-e94b-4a26-86c5-5041d492ffbb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:24.948710 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-27461621-e465-4a30-8aa2-36972a4611c0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:24.955987 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a55fb2ff-e94b-4a26-86c5-5041d492ffbb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.167989 Apr 05 12:13:24.956507 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-27461621-e465-4a30-8aa2-36972a4611c0 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.168757 Apr 05 12:13:24.956669 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1569/3160] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:24 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:24.957072 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1592/3161] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:24 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:13:24.999500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ab3c88bb-1207-4077-af1a-1b4cee4fcc27 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:25.000212 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ab3c88bb-1207-4077-af1a-1b4cee4fcc27 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:25.006415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab3c88bb-1207-4077-af1a-1b4cee4fcc27 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:25.006865 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab3c88bb-1207-4077-af1a-1b4cee4fcc27 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:25.007633 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab3c88bb-1207-4077-af1a-1b4cee4fcc27 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:25.008095 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab3c88bb-1207-4077-af1a-1b4cee4fcc27 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:25.150259 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ab3c88bb-1207-4077-af1a-1b4cee4fcc27 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:25.158830 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ab3c88bb-1207-4077-af1a-1b4cee4fcc27 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.163101 Apr 05 12:13:25.159409 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1570/3162] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:24 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:25.529915 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-43478a2c-f866-4dfd-8d5c-75f0fa6016e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:25.530726 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-43478a2c-f866-4dfd-8d5c-75f0fa6016e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:25.538449 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-43478a2c-f866-4dfd-8d5c-75f0fa6016e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:25.538901 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-43478a2c-f866-4dfd-8d5c-75f0fa6016e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:25.539662 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-43478a2c-f866-4dfd-8d5c-75f0fa6016e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:25.540109 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-43478a2c-f866-4dfd-8d5c-75f0fa6016e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:25.622108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8307c1f4-aaba-43ff-9fb4-9f33f527d3da tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:25.622610 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8307c1f4-aaba-43ff-9fb4-9f33f527d3da tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:25.629438 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8307c1f4-aaba-43ff-9fb4-9f33f527d3da tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:25.629893 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8307c1f4-aaba-43ff-9fb4-9f33f527d3da tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:25.630778 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8307c1f4-aaba-43ff-9fb4-9f33f527d3da tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:25.631214 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8307c1f4-aaba-43ff-9fb4-9f33f527d3da tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:25.655044 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8307c1f4-aaba-43ff-9fb4-9f33f527d3da tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Going to try to terminate instance {{(pid=123357) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 12:13:25.671610 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-43478a2c-f866-4dfd-8d5c-75f0fa6016e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:25.680018 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-43478a2c-f866-4dfd-8d5c-75f0fa6016e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:25.681527 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-43478a2c-f866-4dfd-8d5c-75f0fa6016e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:25.682677 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-43478a2c-f866-4dfd-8d5c-75f0fa6016e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.157994 Apr 05 12:13:25.683243 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1593/3163] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:25 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:25.733882 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8307c1f4-aaba-43ff-9fb4-9f33f527d3da tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 204 len: 0 microversion: 2.1 time: 0.115107 Apr 05 12:13:25.734441 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1571/3164] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 12:13:25 2022] DELETE /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:13:25.743714 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-437d0794-3a21-4abb-9d4e-7b4f470d5a48 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:25.744379 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-437d0794-3a21-4abb-9d4e-7b4f470d5a48 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:25.750514 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-437d0794-3a21-4abb-9d4e-7b4f470d5a48 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:25.750904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-437d0794-3a21-4abb-9d4e-7b4f470d5a48 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:25.751649 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-437d0794-3a21-4abb-9d4e-7b4f470d5a48 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:25.752128 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-437d0794-3a21-4abb-9d4e-7b4f470d5a48 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:25.894624 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-437d0794-3a21-4abb-9d4e-7b4f470d5a48 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:25.902814 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-437d0794-3a21-4abb-9d4e-7b4f470d5a48 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1720 microversion: 2.1 time: 0.164113 Apr 05 12:13:25.903385 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1594/3165] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:25 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:25.977266 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-58a701b4-0506-4b27-b879-534e583a3daa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:25.978097 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-69701413-9dcb-45d5-8c6c-e831b0cfcda5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:25.978867 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-58a701b4-0506-4b27-b879-534e583a3daa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:25.979341 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-69701413-9dcb-45d5-8c6c-e831b0cfcda5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:25.988814 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-58a701b4-0506-4b27-b879-534e583a3daa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:25.989467 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-69701413-9dcb-45d5-8c6c-e831b0cfcda5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:25.989657 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-58a701b4-0506-4b27-b879-534e583a3daa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:25.990000 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-69701413-9dcb-45d5-8c6c-e831b0cfcda5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:25.990410 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-58a701b4-0506-4b27-b879-534e583a3daa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:25.990810 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-69701413-9dcb-45d5-8c6c-e831b0cfcda5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:25.990935 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-58a701b4-0506-4b27-b879-534e583a3daa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:25.991240 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-69701413-9dcb-45d5-8c6c-e831b0cfcda5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:26.126506 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-58a701b4-0506-4b27-b879-534e583a3daa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:26.127576 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-69701413-9dcb-45d5-8c6c-e831b0cfcda5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:26.134887 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-58a701b4-0506-4b27-b879-534e583a3daa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.164561 Apr 05 12:13:26.135502 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1595/3166] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:25 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:26.135771 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-69701413-9dcb-45d5-8c6c-e831b0cfcda5 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.165056 Apr 05 12:13:26.136356 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1572/3167] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:25 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:26.176064 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d5b51138-9bfe-4f84-b658-37414f39c3c4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:26.176690 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d5b51138-9bfe-4f84-b658-37414f39c3c4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:26.182968 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d5b51138-9bfe-4f84-b658-37414f39c3c4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:26.183412 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d5b51138-9bfe-4f84-b658-37414f39c3c4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:26.184206 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d5b51138-9bfe-4f84-b658-37414f39c3c4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:26.184632 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d5b51138-9bfe-4f84-b658-37414f39c3c4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:26.331766 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d5b51138-9bfe-4f84-b658-37414f39c3c4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:26.341239 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d5b51138-9bfe-4f84-b658-37414f39c3c4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.168956 Apr 05 12:13:26.341809 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1596/3168] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:26 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:26.701873 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6b73ce94-a066-4feb-b270-33ab5f1af372 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:26.702499 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6b73ce94-a066-4feb-b270-33ab5f1af372 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:26.709378 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6b73ce94-a066-4feb-b270-33ab5f1af372 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:26.709820 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6b73ce94-a066-4feb-b270-33ab5f1af372 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:26.710575 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6b73ce94-a066-4feb-b270-33ab5f1af372 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:26.710999 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6b73ce94-a066-4feb-b270-33ab5f1af372 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:26.841571 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6b73ce94-a066-4feb-b270-33ab5f1af372 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:26.849825 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6b73ce94-a066-4feb-b270-33ab5f1af372 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:26.851310 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6b73ce94-a066-4feb-b270-33ab5f1af372 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:26.852499 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6b73ce94-a066-4feb-b270-33ab5f1af372 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.154553 Apr 05 12:13:26.862917 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1573/3169] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:26 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:26.926067 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6f38d3c2-539d-460d-9c22-7fc888033863 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:26.926835 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6f38d3c2-539d-460d-9c22-7fc888033863 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:26.933562 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f38d3c2-539d-460d-9c22-7fc888033863 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:26.934414 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f38d3c2-539d-460d-9c22-7fc888033863 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:26.935109 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f38d3c2-539d-460d-9c22-7fc888033863 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:26.935547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f38d3c2-539d-460d-9c22-7fc888033863 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:27.152909 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e0e1321d-ca85-4ce1-90e6-b3ce8bb68e6d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:27.153545 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e0e1321d-ca85-4ce1-90e6-b3ce8bb68e6d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:27.159698 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0e1321d-ca85-4ce1-90e6-b3ce8bb68e6d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:27.160181 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0e1321d-ca85-4ce1-90e6-b3ce8bb68e6d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:27.160951 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0e1321d-ca85-4ce1-90e6-b3ce8bb68e6d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:27.161433 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e0e1321d-ca85-4ce1-90e6-b3ce8bb68e6d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:27.192809 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6f38d3c2-539d-460d-9c22-7fc888033863 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:27.203915 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6f38d3c2-539d-460d-9c22-7fc888033863 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1720 microversion: 2.1 time: 0.281696 Apr 05 12:13:27.204657 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1597/3170] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:26 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1720 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:27.218339 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-de1d5329-28f5-4595-ab4e-ed2dcf2f2d14 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:27.219030 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-de1d5329-28f5-4595-ab4e-ed2dcf2f2d14 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:27.225916 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-de1d5329-28f5-4595-ab4e-ed2dcf2f2d14 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:27.227713 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-de1d5329-28f5-4595-ab4e-ed2dcf2f2d14 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:27.228864 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-de1d5329-28f5-4595-ab4e-ed2dcf2f2d14 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:27.229542 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-de1d5329-28f5-4595-ab4e-ed2dcf2f2d14 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:27.474242 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-de1d5329-28f5-4595-ab4e-ed2dcf2f2d14 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:27.489755 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-de1d5329-28f5-4595-ab4e-ed2dcf2f2d14 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.280344 Apr 05 12:13:27.490378 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1598/3171] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:27 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:27.497122 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1b94958c-3966-4f98-b811-27f54678abff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:27.497768 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1b94958c-3966-4f98-b811-27f54678abff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:27.505919 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1b94958c-3966-4f98-b811-27f54678abff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:27.506367 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1b94958c-3966-4f98-b811-27f54678abff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:27.507144 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1b94958c-3966-4f98-b811-27f54678abff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:27.507578 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1b94958c-3966-4f98-b811-27f54678abff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:27.580505 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e0e1321d-ca85-4ce1-90e6-b3ce8bb68e6d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:27.588728 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e0e1321d-ca85-4ce1-90e6-b3ce8bb68e6d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.439984 Apr 05 12:13:27.599645 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1574/3172] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:27 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:27.668159 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1b94958c-3966-4f98-b811-27f54678abff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:27.671397 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-84618394-fdf3-46e1-80a3-e6fad4c57fb0 req-814821f4-48e3-4352-88cd-22ec57d43ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48b77eb-b654-43e4-9551-735bac89d0de", "name": "network-vif-deleted", "tag": "e6dd88bf-e528-41ea-ac09-941f2df0ad3c"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:27.676151 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1b94958c-3966-4f98-b811-27f54678abff tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.183388 Apr 05 12:13:27.676959 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1599/3173] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:27 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:27.680014 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-84618394-fdf3-46e1-80a3-e6fad4c57fb0 req-814821f4-48e3-4352-88cd-22ec57d43ce4 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:27.680663 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-84618394-fdf3-46e1-80a3-e6fad4c57fb0 req-814821f4-48e3-4352-88cd-22ec57d43ce4 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:27.691665 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-84618394-fdf3-46e1-80a3-e6fad4c57fb0 req-814821f4-48e3-4352-88cd-22ec57d43ce4 service nova] Creating event network-vif-deleted:e6dd88bf-e528-41ea-ac09-941f2df0ad3c for instance c48b77eb-b654-43e4-9551-735bac89d0de on hv-cinder-82956 Apr 05 12:13:27.696619 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-84618394-fdf3-46e1-80a3-e6fad4c57fb0 req-814821f4-48e3-4352-88cd-22ec57d43ce4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095342 Apr 05 12:13:27.697213 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1575/3174] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:13:27.870424 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f022ca73-8b8e-40c0-b8d6-5a21c0651a2f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:27.871182 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f022ca73-8b8e-40c0-b8d6-5a21c0651a2f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:27.877151 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f022ca73-8b8e-40c0-b8d6-5a21c0651a2f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:27.877671 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f022ca73-8b8e-40c0-b8d6-5a21c0651a2f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:27.878829 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f022ca73-8b8e-40c0-b8d6-5a21c0651a2f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:27.879320 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f022ca73-8b8e-40c0-b8d6-5a21c0651a2f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:28.016728 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f022ca73-8b8e-40c0-b8d6-5a21c0651a2f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:28.031355 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f022ca73-8b8e-40c0-b8d6-5a21c0651a2f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:28.033125 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f022ca73-8b8e-40c0-b8d6-5a21c0651a2f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:28.034588 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f022ca73-8b8e-40c0-b8d6-5a21c0651a2f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.168012 Apr 05 12:13:28.035153 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1600/3175] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:27 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:28.222100 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ec62f592-56a2-4463-b59d-6d2c907f6f34 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:28.222832 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ec62f592-56a2-4463-b59d-6d2c907f6f34 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:28.230035 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec62f592-56a2-4463-b59d-6d2c907f6f34 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:28.230492 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec62f592-56a2-4463-b59d-6d2c907f6f34 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:28.231266 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec62f592-56a2-4463-b59d-6d2c907f6f34 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:28.231697 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec62f592-56a2-4463-b59d-6d2c907f6f34 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:28.294307 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ec62f592-56a2-4463-b59d-6d2c907f6f34 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:28.302474 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ec62f592-56a2-4463-b59d-6d2c907f6f34 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.084535 Apr 05 12:13:28.303034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1576/3176] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:28 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:28.507226 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-48f64570-58b0-4943-972f-b60090afb4e3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:28.507839 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-48f64570-58b0-4943-972f-b60090afb4e3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:28.514249 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-48f64570-58b0-4943-972f-b60090afb4e3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:28.514695 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-48f64570-58b0-4943-972f-b60090afb4e3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:28.515455 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-48f64570-58b0-4943-972f-b60090afb4e3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:28.515883 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-48f64570-58b0-4943-972f-b60090afb4e3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:28.606516 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8f9020fb-4930-4c97-88ec-62c41e6e753e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:28.607140 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8f9020fb-4930-4c97-88ec-62c41e6e753e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:28.613417 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f9020fb-4930-4c97-88ec-62c41e6e753e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:28.613868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f9020fb-4930-4c97-88ec-62c41e6e753e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:28.614674 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f9020fb-4930-4c97-88ec-62c41e6e753e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:28.615109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8f9020fb-4930-4c97-88ec-62c41e6e753e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:28.655306 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-48f64570-58b0-4943-972f-b60090afb4e3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:28.663334 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-48f64570-58b0-4943-972f-b60090afb4e3 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.160310 Apr 05 12:13:28.663909 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1601/3177] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:28 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:28.693253 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-81cf84fd-47ca-42f9-b724-3ac5f4f7615b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:28.693856 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-81cf84fd-47ca-42f9-b724-3ac5f4f7615b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:28.699840 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-81cf84fd-47ca-42f9-b724-3ac5f4f7615b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:28.700418 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-81cf84fd-47ca-42f9-b724-3ac5f4f7615b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:28.701219 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-81cf84fd-47ca-42f9-b724-3ac5f4f7615b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:28.701663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-81cf84fd-47ca-42f9-b724-3ac5f4f7615b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:28.744996 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8f9020fb-4930-4c97-88ec-62c41e6e753e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:28.753415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8f9020fb-4930-4c97-88ec-62c41e6e753e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.150649 Apr 05 12:13:28.753987 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1577/3178] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:28 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:13:28.834014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-81cf84fd-47ca-42f9-b724-3ac5f4f7615b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:28.846118 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-81cf84fd-47ca-42f9-b724-3ac5f4f7615b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.156456 Apr 05 12:13:28.846864 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1602/3179] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:28 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:13:29.057051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fe1b3f52-bd81-4f0f-b1c4-8e25beec81e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:29.057929 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fe1b3f52-bd81-4f0f-b1c4-8e25beec81e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:29.067917 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe1b3f52-bd81-4f0f-b1c4-8e25beec81e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:29.068709 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe1b3f52-bd81-4f0f-b1c4-8e25beec81e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:29.069949 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe1b3f52-bd81-4f0f-b1c4-8e25beec81e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:29.070666 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe1b3f52-bd81-4f0f-b1c4-8e25beec81e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:29.208784 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fe1b3f52-bd81-4f0f-b1c4-8e25beec81e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:29.219310 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fe1b3f52-bd81-4f0f-b1c4-8e25beec81e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:29.221812 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fe1b3f52-bd81-4f0f-b1c4-8e25beec81e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:29.223663 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fe1b3f52-bd81-4f0f-b1c4-8e25beec81e3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.173105 Apr 05 12:13:29.224581 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1578/3180] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:29 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:29.323837 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-24f4a7b4-7c32-491e-b637-9df3934f8714 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:29.324737 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-24f4a7b4-7c32-491e-b637-9df3934f8714 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:29.334594 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24f4a7b4-7c32-491e-b637-9df3934f8714 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:29.335425 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24f4a7b4-7c32-491e-b637-9df3934f8714 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:29.336736 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24f4a7b4-7c32-491e-b637-9df3934f8714 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:29.337442 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24f4a7b4-7c32-491e-b637-9df3934f8714 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:29.401431 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-24f4a7b4-7c32-491e-b637-9df3934f8714 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:29.409532 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-24f4a7b4-7c32-491e-b637-9df3934f8714 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.092651 Apr 05 12:13:29.410133 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1603/3181] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:29 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:29.685017 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-98b5dae4-d30f-4b6b-9c41-7423b46e0cc9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:29.685985 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-98b5dae4-d30f-4b6b-9c41-7423b46e0cc9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:29.696907 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-98b5dae4-d30f-4b6b-9c41-7423b46e0cc9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:29.697644 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-98b5dae4-d30f-4b6b-9c41-7423b46e0cc9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:29.698948 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-98b5dae4-d30f-4b6b-9c41-7423b46e0cc9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:29.699657 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-98b5dae4-d30f-4b6b-9c41-7423b46e0cc9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:29.770904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b1edc7dc-5491-468f-bb48-9ec172456eff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:29.771538 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b1edc7dc-5491-468f-bb48-9ec172456eff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:29.778777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b1edc7dc-5491-468f-bb48-9ec172456eff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:29.779224 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b1edc7dc-5491-468f-bb48-9ec172456eff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:29.779996 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b1edc7dc-5491-468f-bb48-9ec172456eff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:29.780437 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b1edc7dc-5491-468f-bb48-9ec172456eff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:29.856286 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-98b5dae4-d30f-4b6b-9c41-7423b46e0cc9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:29.864285 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-98b5dae4-d30f-4b6b-9c41-7423b46e0cc9 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.185916 Apr 05 12:13:29.865038 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1579/3182] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:29 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:29.869471 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6be836c9-0ce5-4cd9-8fbd-a7b1a3a957d0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:29.870229 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6be836c9-0ce5-4cd9-8fbd-a7b1a3a957d0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:29.876288 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6be836c9-0ce5-4cd9-8fbd-a7b1a3a957d0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:29.876741 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6be836c9-0ce5-4cd9-8fbd-a7b1a3a957d0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:29.877501 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6be836c9-0ce5-4cd9-8fbd-a7b1a3a957d0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:29.878254 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6be836c9-0ce5-4cd9-8fbd-a7b1a3a957d0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:29.922224 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b1edc7dc-5491-468f-bb48-9ec172456eff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:29.930193 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b1edc7dc-5491-468f-bb48-9ec172456eff tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.163441 Apr 05 12:13:29.930763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1604/3183] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:29 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:30.008933 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6be836c9-0ce5-4cd9-8fbd-a7b1a3a957d0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:30.017117 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6be836c9-0ce5-4cd9-8fbd-a7b1a3a957d0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.151215 Apr 05 12:13:30.017687 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1580/3184] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:29 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:30.252436 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d96f7d99-0b42-452b-bd0c-0959cee8f04d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:30.253636 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d96f7d99-0b42-452b-bd0c-0959cee8f04d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:30.262779 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d96f7d99-0b42-452b-bd0c-0959cee8f04d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:30.263463 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d96f7d99-0b42-452b-bd0c-0959cee8f04d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:30.264602 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d96f7d99-0b42-452b-bd0c-0959cee8f04d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:30.265195 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d96f7d99-0b42-452b-bd0c-0959cee8f04d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:30.407592 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d96f7d99-0b42-452b-bd0c-0959cee8f04d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:30.420361 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d96f7d99-0b42-452b-bd0c-0959cee8f04d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:30.421869 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d96f7d99-0b42-452b-bd0c-0959cee8f04d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:30.423537 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d96f7d99-0b42-452b-bd0c-0959cee8f04d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.177693 Apr 05 12:13:30.424337 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1605/3185] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:30 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:30.427780 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5469edb0-acd0-4f7f-9356-81cf7155a779 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:30.428420 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5469edb0-acd0-4f7f-9356-81cf7155a779 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:30.434667 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5469edb0-acd0-4f7f-9356-81cf7155a779 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:30.435115 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5469edb0-acd0-4f7f-9356-81cf7155a779 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:30.435869 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5469edb0-acd0-4f7f-9356-81cf7155a779 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:30.436334 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5469edb0-acd0-4f7f-9356-81cf7155a779 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:30.502319 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5469edb0-acd0-4f7f-9356-81cf7155a779 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:30.510837 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5469edb0-acd0-4f7f-9356-81cf7155a779 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.087717 Apr 05 12:13:30.511340 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1581/3186] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:30 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:30.886361 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9305e872-e85f-4816-837b-3f8bb6d89ee4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:30.887318 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9305e872-e85f-4816-837b-3f8bb6d89ee4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:30.897453 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9305e872-e85f-4816-837b-3f8bb6d89ee4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:30.898172 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9305e872-e85f-4816-837b-3f8bb6d89ee4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:30.899406 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9305e872-e85f-4816-837b-3f8bb6d89ee4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:30.900141 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9305e872-e85f-4816-837b-3f8bb6d89ee4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:30.947257 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-553697f0-b935-41ef-9239-9d63c14523fa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:30.947967 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-553697f0-b935-41ef-9239-9d63c14523fa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:30.954623 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-553697f0-b935-41ef-9239-9d63c14523fa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:30.955073 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-553697f0-b935-41ef-9239-9d63c14523fa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:30.955823 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-553697f0-b935-41ef-9239-9d63c14523fa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:30.956292 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-553697f0-b935-41ef-9239-9d63c14523fa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:31.039935 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9305e872-e85f-4816-837b-3f8bb6d89ee4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:31.047760 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9305e872-e85f-4816-837b-3f8bb6d89ee4 tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.168387 Apr 05 12:13:31.048365 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1606/3187] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:30 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:31.052723 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ea5c6a10-902a-4fdc-9dde-0537a5183c18 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:31.053347 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ea5c6a10-902a-4fdc-9dde-0537a5183c18 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:31.059211 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea5c6a10-902a-4fdc-9dde-0537a5183c18 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:31.059709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea5c6a10-902a-4fdc-9dde-0537a5183c18 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:31.060494 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea5c6a10-902a-4fdc-9dde-0537a5183c18 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:31.060924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea5c6a10-902a-4fdc-9dde-0537a5183c18 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:31.088308 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-553697f0-b935-41ef-9239-9d63c14523fa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:31.096414 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-553697f0-b935-41ef-9239-9d63c14523fa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.153040 Apr 05 12:13:31.096990 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1582/3188] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:30 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:31.193165 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ea5c6a10-902a-4fdc-9dde-0537a5183c18 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:31.200972 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ea5c6a10-902a-4fdc-9dde-0537a5183c18 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.151683 Apr 05 12:13:31.201541 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1607/3189] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:31 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:31.446261 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8dc834b8-da20-4a8b-8695-0cdb7af432bd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:31.447146 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8dc834b8-da20-4a8b-8695-0cdb7af432bd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:31.457291 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8dc834b8-da20-4a8b-8695-0cdb7af432bd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:31.458161 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8dc834b8-da20-4a8b-8695-0cdb7af432bd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:31.458937 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8dc834b8-da20-4a8b-8695-0cdb7af432bd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:31.459367 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8dc834b8-da20-4a8b-8695-0cdb7af432bd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:31.528062 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-06a5f71a-c6e6-436f-996d-e63dfdd96e85 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:31.528745 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-06a5f71a-c6e6-436f-996d-e63dfdd96e85 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:31.535255 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-06a5f71a-c6e6-436f-996d-e63dfdd96e85 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:31.535669 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-06a5f71a-c6e6-436f-996d-e63dfdd96e85 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:31.536794 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-06a5f71a-c6e6-436f-996d-e63dfdd96e85 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:31.537226 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-06a5f71a-c6e6-436f-996d-e63dfdd96e85 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:31.597931 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-06a5f71a-c6e6-436f-996d-e63dfdd96e85 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:31.606254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-06a5f71a-c6e6-436f-996d-e63dfdd96e85 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.082060 Apr 05 12:13:31.608724 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1608/3190] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:31 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:31.609845 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8dc834b8-da20-4a8b-8695-0cdb7af432bd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:31.618103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8dc834b8-da20-4a8b-8695-0cdb7af432bd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:31.619588 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8dc834b8-da20-4a8b-8695-0cdb7af432bd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:31.620756 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8dc834b8-da20-4a8b-8695-0cdb7af432bd tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.181278 Apr 05 12:13:31.621344 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1583/3191] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:31 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:32.069665 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d75f0a2f-680f-4462-8849-76cbe9a4832a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:32.070671 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d75f0a2f-680f-4462-8849-76cbe9a4832a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] [instance: 2874529b-88ea-4b6d-b42a-a242dc948ccf] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:32.080972 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d75f0a2f-680f-4462-8849-76cbe9a4832a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:32.081716 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d75f0a2f-680f-4462-8849-76cbe9a4832a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:32.083069 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d75f0a2f-680f-4462-8849-76cbe9a4832a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:32.083534 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d75f0a2f-680f-4462-8849-76cbe9a4832a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:32.113780 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c89e91cc-bea3-4ea6-985b-9c765204789f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:32.114787 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c89e91cc-bea3-4ea6-985b-9c765204789f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:32.121266 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c89e91cc-bea3-4ea6-985b-9c765204789f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:32.121795 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c89e91cc-bea3-4ea6-985b-9c765204789f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:32.122640 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c89e91cc-bea3-4ea6-985b-9c765204789f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:32.123072 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c89e91cc-bea3-4ea6-985b-9c765204789f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:32.218887 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d75f0a2f-680f-4462-8849-76cbe9a4832a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8653b849b6413283176a098faebb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400dd74b011a4bbabde6ed53ce0250d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:32.227040 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d75f0a2f-680f-4462-8849-76cbe9a4832a tempest-VolumesSnapshotTestJSON-1903352265 tempest-VolumesSnapshotTestJSON-1903352265-project] 10.222.0.61 "GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf" status: 200 len: 1560 microversion: 2.1 time: 0.163927 Apr 05 12:13:32.227832 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1609/3192] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:32 2022] GET /compute/v2.1/servers/2874529b-88ea-4b6d-b42a-a242dc948ccf => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:32.232385 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-99865a30-aab7-4cdd-a387-16f30b788060 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:32.232865 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-99865a30-aab7-4cdd-a387-16f30b788060 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:32.238565 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-99865a30-aab7-4cdd-a387-16f30b788060 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:32.239028 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-99865a30-aab7-4cdd-a387-16f30b788060 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:32.239849 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-99865a30-aab7-4cdd-a387-16f30b788060 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:32.240314 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-99865a30-aab7-4cdd-a387-16f30b788060 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:32.255480 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c89e91cc-bea3-4ea6-985b-9c765204789f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:32.265750 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c89e91cc-bea3-4ea6-985b-9c765204789f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.155926 Apr 05 12:13:32.266386 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1584/3193] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:32 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:32.371213 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-99865a30-aab7-4cdd-a387-16f30b788060 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:32.379518 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-99865a30-aab7-4cdd-a387-16f30b788060 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.150730 Apr 05 12:13:32.380188 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1610/3194] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:32 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:32.627630 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5555bc78-9d3d-44d9-bfd4-f565cbbe202c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:32.628846 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5555bc78-9d3d-44d9-bfd4-f565cbbe202c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:32.635679 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5555bc78-9d3d-44d9-bfd4-f565cbbe202c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:32.636135 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5555bc78-9d3d-44d9-bfd4-f565cbbe202c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:32.636910 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5555bc78-9d3d-44d9-bfd4-f565cbbe202c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:32.637340 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5555bc78-9d3d-44d9-bfd4-f565cbbe202c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:32.638831 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4161254a-3f5a-496b-a64f-5ae8ce077e1b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:32.639447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4161254a-3f5a-496b-a64f-5ae8ce077e1b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:32.646101 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4161254a-3f5a-496b-a64f-5ae8ce077e1b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:32.646545 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4161254a-3f5a-496b-a64f-5ae8ce077e1b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:32.647306 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4161254a-3f5a-496b-a64f-5ae8ce077e1b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:32.647737 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4161254a-3f5a-496b-a64f-5ae8ce077e1b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:32.696267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5555bc78-9d3d-44d9-bfd4-f565cbbe202c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:32.704321 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5555bc78-9d3d-44d9-bfd4-f565cbbe202c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.083374 Apr 05 12:13:32.704882 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1585/3195] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:32 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:32.779264 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4161254a-3f5a-496b-a64f-5ae8ce077e1b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:32.788101 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4161254a-3f5a-496b-a64f-5ae8ce077e1b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:32.789622 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4161254a-3f5a-496b-a64f-5ae8ce077e1b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:32.790904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4161254a-3f5a-496b-a64f-5ae8ce077e1b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.155915 Apr 05 12:13:32.791475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1611/3196] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:32 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:33.288278 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f8df0ea4-7845-45ca-b266-435b1573fedd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:33.289251 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f8df0ea4-7845-45ca-b266-435b1573fedd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:33.299851 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f8df0ea4-7845-45ca-b266-435b1573fedd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:33.300666 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f8df0ea4-7845-45ca-b266-435b1573fedd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:33.301918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f8df0ea4-7845-45ca-b266-435b1573fedd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:33.302637 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f8df0ea4-7845-45ca-b266-435b1573fedd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:33.397911 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e66336a1-22b6-48b4-9fc0-2671ebad9965 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:33.398497 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e66336a1-22b6-48b4-9fc0-2671ebad9965 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:33.404868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e66336a1-22b6-48b4-9fc0-2671ebad9965 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:33.405315 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e66336a1-22b6-48b4-9fc0-2671ebad9965 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:33.406082 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e66336a1-22b6-48b4-9fc0-2671ebad9965 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:33.406513 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e66336a1-22b6-48b4-9fc0-2671ebad9965 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:33.442657 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f8df0ea4-7845-45ca-b266-435b1573fedd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:33.451355 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f8df0ea4-7845-45ca-b266-435b1573fedd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.169703 Apr 05 12:13:33.451970 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1586/3197] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:33 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:33.540576 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e66336a1-22b6-48b4-9fc0-2671ebad9965 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:33.548545 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e66336a1-22b6-48b4-9fc0-2671ebad9965 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.154543 Apr 05 12:13:33.549153 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1612/3198] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:33 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:33.725688 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-76be3e13-6ae8-49fa-8b08-a695218c24e6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:33.726727 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-76be3e13-6ae8-49fa-8b08-a695218c24e6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:33.737064 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-76be3e13-6ae8-49fa-8b08-a695218c24e6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:33.737815 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-76be3e13-6ae8-49fa-8b08-a695218c24e6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:33.739074 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-76be3e13-6ae8-49fa-8b08-a695218c24e6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:33.739763 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-76be3e13-6ae8-49fa-8b08-a695218c24e6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:33.800622 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-76be3e13-6ae8-49fa-8b08-a695218c24e6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:33.809602 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-76be3e13-6ae8-49fa-8b08-a695218c24e6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.090345 Apr 05 12:13:33.810556 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1587/3199] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:33 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:33.811768 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-078c9359-7bd3-47f1-b8e8-235c8fdda905 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:33.812789 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-078c9359-7bd3-47f1-b8e8-235c8fdda905 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:33.822663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-078c9359-7bd3-47f1-b8e8-235c8fdda905 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:33.823108 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-078c9359-7bd3-47f1-b8e8-235c8fdda905 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:33.823870 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-078c9359-7bd3-47f1-b8e8-235c8fdda905 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:33.824336 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-078c9359-7bd3-47f1-b8e8-235c8fdda905 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:33.969099 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-078c9359-7bd3-47f1-b8e8-235c8fdda905 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:33.978084 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-078c9359-7bd3-47f1-b8e8-235c8fdda905 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:33.979493 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-078c9359-7bd3-47f1-b8e8-235c8fdda905 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:33.980668 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-078c9359-7bd3-47f1-b8e8-235c8fdda905 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.174945 Apr 05 12:13:33.981229 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1613/3200] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:33 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:34.469965 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4a82b78d-8f17-4945-9e7c-f81123e2c03b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:34.470651 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4a82b78d-8f17-4945-9e7c-f81123e2c03b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:34.478214 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4a82b78d-8f17-4945-9e7c-f81123e2c03b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:34.478714 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4a82b78d-8f17-4945-9e7c-f81123e2c03b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:34.479555 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4a82b78d-8f17-4945-9e7c-f81123e2c03b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:34.480032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4a82b78d-8f17-4945-9e7c-f81123e2c03b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:34.566250 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-52f3a6cb-d03b-4c0c-b395-82c6c4500710 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:34.566854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-52f3a6cb-d03b-4c0c-b395-82c6c4500710 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:34.573109 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-52f3a6cb-d03b-4c0c-b395-82c6c4500710 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:34.573584 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-52f3a6cb-d03b-4c0c-b395-82c6c4500710 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:34.574351 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-52f3a6cb-d03b-4c0c-b395-82c6c4500710 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:34.574813 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-52f3a6cb-d03b-4c0c-b395-82c6c4500710 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:34.626380 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4a82b78d-8f17-4945-9e7c-f81123e2c03b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:34.634547 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4a82b78d-8f17-4945-9e7c-f81123e2c03b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.168889 Apr 05 12:13:34.635123 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1588/3201] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:34 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:34.721777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-52f3a6cb-d03b-4c0c-b395-82c6c4500710 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:34.732305 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-52f3a6cb-d03b-4c0c-b395-82c6c4500710 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.169928 Apr 05 12:13:34.732989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1614/3202] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:34 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:34.830737 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-76e7fd1b-faa4-4203-b864-2b97ebbba38f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:34.831743 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-76e7fd1b-faa4-4203-b864-2b97ebbba38f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:34.842408 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-76e7fd1b-faa4-4203-b864-2b97ebbba38f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:34.844831 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-76e7fd1b-faa4-4203-b864-2b97ebbba38f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:34.844831 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-76e7fd1b-faa4-4203-b864-2b97ebbba38f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:34.845225 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-76e7fd1b-faa4-4203-b864-2b97ebbba38f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:34.916768 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-76e7fd1b-faa4-4203-b864-2b97ebbba38f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:34.924767 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-76e7fd1b-faa4-4203-b864-2b97ebbba38f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.100526 Apr 05 12:13:34.925336 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1589/3203] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:34 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:35.001338 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bb6ad472-55d3-45fd-a636-f8831eac9102 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:35.001990 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bb6ad472-55d3-45fd-a636-f8831eac9102 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:35.011996 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bb6ad472-55d3-45fd-a636-f8831eac9102 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:35.012704 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bb6ad472-55d3-45fd-a636-f8831eac9102 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:35.013845 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bb6ad472-55d3-45fd-a636-f8831eac9102 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:35.014447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bb6ad472-55d3-45fd-a636-f8831eac9102 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:35.152276 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bb6ad472-55d3-45fd-a636-f8831eac9102 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:35.165562 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bb6ad472-55d3-45fd-a636-f8831eac9102 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:35.167763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bb6ad472-55d3-45fd-a636-f8831eac9102 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:35.169644 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bb6ad472-55d3-45fd-a636-f8831eac9102 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.174179 Apr 05 12:13:35.170431 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1615/3204] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:34 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:35.655754 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b0fd9e31-f202-4905-a489-f431dfd06769 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:35.656949 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b0fd9e31-f202-4905-a489-f431dfd06769 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:35.667514 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b0fd9e31-f202-4905-a489-f431dfd06769 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:35.668330 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b0fd9e31-f202-4905-a489-f431dfd06769 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:35.669610 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b0fd9e31-f202-4905-a489-f431dfd06769 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:35.670330 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b0fd9e31-f202-4905-a489-f431dfd06769 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:35.754932 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1863b940-f8f1-4aec-81af-8c0d95cb116c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:35.755488 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1863b940-f8f1-4aec-81af-8c0d95cb116c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:35.761883 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1863b940-f8f1-4aec-81af-8c0d95cb116c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:35.762325 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1863b940-f8f1-4aec-81af-8c0d95cb116c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:35.763076 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1863b940-f8f1-4aec-81af-8c0d95cb116c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:35.763503 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1863b940-f8f1-4aec-81af-8c0d95cb116c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:35.809793 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b0fd9e31-f202-4905-a489-f431dfd06769 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:35.817898 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b0fd9e31-f202-4905-a489-f431dfd06769 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.168578 Apr 05 12:13:35.818476 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1590/3205] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:35 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:35.906051 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1863b940-f8f1-4aec-81af-8c0d95cb116c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:35.914020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1863b940-f8f1-4aec-81af-8c0d95cb116c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.163423 Apr 05 12:13:35.914611 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1616/3206] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:35 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:35.941815 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fd717afd-2b46-4183-92e8-70649152d537 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:35.942398 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fd717afd-2b46-4183-92e8-70649152d537 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:35.948833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd717afd-2b46-4183-92e8-70649152d537 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:35.949318 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd717afd-2b46-4183-92e8-70649152d537 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:35.950084 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd717afd-2b46-4183-92e8-70649152d537 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:35.950513 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fd717afd-2b46-4183-92e8-70649152d537 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:36.009999 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fd717afd-2b46-4183-92e8-70649152d537 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:36.018276 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fd717afd-2b46-4183-92e8-70649152d537 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.080366 Apr 05 12:13:36.018853 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1591/3207] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:35 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:36.193200 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-74dbcb46-3d54-44fe-a7cb-c157229fc39f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:36.193925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-74dbcb46-3d54-44fe-a7cb-c157229fc39f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:36.202181 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-74dbcb46-3d54-44fe-a7cb-c157229fc39f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:36.202748 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-74dbcb46-3d54-44fe-a7cb-c157229fc39f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:36.203694 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-74dbcb46-3d54-44fe-a7cb-c157229fc39f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:36.204271 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-74dbcb46-3d54-44fe-a7cb-c157229fc39f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:36.348845 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-74dbcb46-3d54-44fe-a7cb-c157229fc39f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:36.357969 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-74dbcb46-3d54-44fe-a7cb-c157229fc39f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:36.359478 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-74dbcb46-3d54-44fe-a7cb-c157229fc39f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:36.360688 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-74dbcb46-3d54-44fe-a7cb-c157229fc39f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.173995 Apr 05 12:13:36.361227 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1617/3208] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:36 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:36.839052 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fe9ecacb-3724-4398-95e4-75e5a15c1daf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:36.840060 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fe9ecacb-3724-4398-95e4-75e5a15c1daf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:36.849999 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe9ecacb-3724-4398-95e4-75e5a15c1daf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:36.850447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe9ecacb-3724-4398-95e4-75e5a15c1daf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:36.851199 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe9ecacb-3724-4398-95e4-75e5a15c1daf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:36.851626 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fe9ecacb-3724-4398-95e4-75e5a15c1daf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:36.931422 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6088c7f9-790f-44b0-a696-b2144299a155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:36.932031 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6088c7f9-790f-44b0-a696-b2144299a155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:36.938331 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6088c7f9-790f-44b0-a696-b2144299a155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:36.938783 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6088c7f9-790f-44b0-a696-b2144299a155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:36.939547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6088c7f9-790f-44b0-a696-b2144299a155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:36.939985 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6088c7f9-790f-44b0-a696-b2144299a155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:36.988816 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fe9ecacb-3724-4398-95e4-75e5a15c1daf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:36.996843 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fe9ecacb-3724-4398-95e4-75e5a15c1daf tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.164418 Apr 05 12:13:36.997522 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1592/3209] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:36 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:37.034705 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a300c25d-823c-4da6-ae3f-afb946feadfc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:37.035318 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a300c25d-823c-4da6-ae3f-afb946feadfc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:37.041364 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a300c25d-823c-4da6-ae3f-afb946feadfc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:37.041818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a300c25d-823c-4da6-ae3f-afb946feadfc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:37.042576 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a300c25d-823c-4da6-ae3f-afb946feadfc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:37.043209 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a300c25d-823c-4da6-ae3f-afb946feadfc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:37.069961 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6088c7f9-790f-44b0-a696-b2144299a155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:37.078302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6088c7f9-790f-44b0-a696-b2144299a155 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.151309 Apr 05 12:13:37.078883 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1618/3210] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:36 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:37.101952 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a300c25d-823c-4da6-ae3f-afb946feadfc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:37.110190 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a300c25d-823c-4da6-ae3f-afb946feadfc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.079399 Apr 05 12:13:37.110725 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1593/3211] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:37 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:37.383645 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a3b9f98f-545d-4312-9320-68cf41e04a68 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:37.384616 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a3b9f98f-545d-4312-9320-68cf41e04a68 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:37.395007 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a3b9f98f-545d-4312-9320-68cf41e04a68 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:37.395775 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a3b9f98f-545d-4312-9320-68cf41e04a68 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:37.396573 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a3b9f98f-545d-4312-9320-68cf41e04a68 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:37.396996 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a3b9f98f-545d-4312-9320-68cf41e04a68 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:37.535473 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a3b9f98f-545d-4312-9320-68cf41e04a68 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:37.544660 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a3b9f98f-545d-4312-9320-68cf41e04a68 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:37.546149 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a3b9f98f-545d-4312-9320-68cf41e04a68 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:37.547297 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a3b9f98f-545d-4312-9320-68cf41e04a68 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.170669 Apr 05 12:13:37.547855 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1619/3212] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:37 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:38.018905 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6bd17818-5113-4e3c-b737-96f2f470d889 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:38.019499 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6bd17818-5113-4e3c-b737-96f2f470d889 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:38.026582 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6bd17818-5113-4e3c-b737-96f2f470d889 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:38.027118 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6bd17818-5113-4e3c-b737-96f2f470d889 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:38.028048 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6bd17818-5113-4e3c-b737-96f2f470d889 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:38.028586 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6bd17818-5113-4e3c-b737-96f2f470d889 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:38.095010 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4c5167c9-f7e4-4ed4-afa9-736a0b74583d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:38.095656 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4c5167c9-f7e4-4ed4-afa9-736a0b74583d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:38.101705 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4c5167c9-f7e4-4ed4-afa9-736a0b74583d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:38.102147 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4c5167c9-f7e4-4ed4-afa9-736a0b74583d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:38.102905 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4c5167c9-f7e4-4ed4-afa9-736a0b74583d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:38.103338 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4c5167c9-f7e4-4ed4-afa9-736a0b74583d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:38.164857 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6bd17818-5113-4e3c-b737-96f2f470d889 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:38.172786 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6bd17818-5113-4e3c-b737-96f2f470d889 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.160432 Apr 05 12:13:38.173368 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1594/3213] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:38 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:38.177877 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4f0b29b2-f23a-482d-9cb6-83e5205e263e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:38.178477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4f0b29b2-f23a-482d-9cb6-83e5205e263e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:38.184343 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4f0b29b2-f23a-482d-9cb6-83e5205e263e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:38.184802 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4f0b29b2-f23a-482d-9cb6-83e5205e263e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:38.185599 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4f0b29b2-f23a-482d-9cb6-83e5205e263e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:38.186047 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4f0b29b2-f23a-482d-9cb6-83e5205e263e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:38.244429 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4f0b29b2-f23a-482d-9cb6-83e5205e263e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:38.244651 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4c5167c9-f7e4-4ed4-afa9-736a0b74583d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:38.252404 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4f0b29b2-f23a-482d-9cb6-83e5205e263e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.078066 Apr 05 12:13:38.252590 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4c5167c9-f7e4-4ed4-afa9-736a0b74583d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.161417 Apr 05 12:13:38.253528 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1620/3215] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:38 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:38.253675 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1595/3215] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:38 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:38.569575 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-977c3b0d-479b-4ada-8441-5c3637e9266b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:38.570573 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-977c3b0d-479b-4ada-8441-5c3637e9266b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:38.580871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-977c3b0d-479b-4ada-8441-5c3637e9266b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:38.581618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-977c3b0d-479b-4ada-8441-5c3637e9266b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:38.582869 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-977c3b0d-479b-4ada-8441-5c3637e9266b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:38.583544 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-977c3b0d-479b-4ada-8441-5c3637e9266b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:38.729200 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-977c3b0d-479b-4ada-8441-5c3637e9266b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:38.737868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-977c3b0d-479b-4ada-8441-5c3637e9266b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:38.739440 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-977c3b0d-479b-4ada-8441-5c3637e9266b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:38.740618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-977c3b0d-479b-4ada-8441-5c3637e9266b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.177808 Apr 05 12:13:38.741174 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1596/3216] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:38 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:39.193615 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7ad65b35-859a-4160-b541-370f7de90f18 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:39.194234 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7ad65b35-859a-4160-b541-370f7de90f18 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:39.200737 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7ad65b35-859a-4160-b541-370f7de90f18 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:39.201186 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7ad65b35-859a-4160-b541-370f7de90f18 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:39.201937 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7ad65b35-859a-4160-b541-370f7de90f18 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:39.202371 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7ad65b35-859a-4160-b541-370f7de90f18 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:39.270187 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c2c58419-4736-4557-9c2a-d7656c9806ee tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:39.270891 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c2c58419-4736-4557-9c2a-d7656c9806ee tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:39.277541 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c2c58419-4736-4557-9c2a-d7656c9806ee tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:39.277979 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c2c58419-4736-4557-9c2a-d7656c9806ee tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:39.278733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c2c58419-4736-4557-9c2a-d7656c9806ee tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:39.279180 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c2c58419-4736-4557-9c2a-d7656c9806ee tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:39.343511 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7ad65b35-859a-4160-b541-370f7de90f18 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:39.351607 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7ad65b35-859a-4160-b541-370f7de90f18 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.163884 Apr 05 12:13:39.352209 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1621/3217] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:39 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:39.356668 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ca05a4cb-1ff2-4536-b8a4-e0560dc13c29 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:39.357276 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ca05a4cb-1ff2-4536-b8a4-e0560dc13c29 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:39.363158 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ca05a4cb-1ff2-4536-b8a4-e0560dc13c29 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:39.363611 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ca05a4cb-1ff2-4536-b8a4-e0560dc13c29 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:39.364404 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ca05a4cb-1ff2-4536-b8a4-e0560dc13c29 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:39.364835 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ca05a4cb-1ff2-4536-b8a4-e0560dc13c29 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:39.411056 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c2c58419-4736-4557-9c2a-d7656c9806ee tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:39.419079 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c2c58419-4736-4557-9c2a-d7656c9806ee tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.152872 Apr 05 12:13:39.419648 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1597/3218] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:39 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:39.428790 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ca05a4cb-1ff2-4536-b8a4-e0560dc13c29 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:39.432264 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ca05a4cb-1ff2-4536-b8a4-e0560dc13c29 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.079092 Apr 05 12:13:39.432821 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1622/3219] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:39 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:39.763442 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e304d8cb-b734-4967-888e-f21096c75367 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:39.764506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e304d8cb-b734-4967-888e-f21096c75367 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:39.773265 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e304d8cb-b734-4967-888e-f21096c75367 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:39.773711 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e304d8cb-b734-4967-888e-f21096c75367 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:39.774471 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e304d8cb-b734-4967-888e-f21096c75367 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:39.774902 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e304d8cb-b734-4967-888e-f21096c75367 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:39.909501 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e304d8cb-b734-4967-888e-f21096c75367 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:39.921927 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e304d8cb-b734-4967-888e-f21096c75367 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:39.924663 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e304d8cb-b734-4967-888e-f21096c75367 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:39.926713 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e304d8cb-b734-4967-888e-f21096c75367 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.169608 Apr 05 12:13:39.927678 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1598/3220] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:39 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:40.373324 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a8aedc13-983f-4b4b-8985-f36a5d5195aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:40.374309 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a8aedc13-983f-4b4b-8985-f36a5d5195aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:40.385369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a8aedc13-983f-4b4b-8985-f36a5d5195aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:40.386124 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a8aedc13-983f-4b4b-8985-f36a5d5195aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:40.387419 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a8aedc13-983f-4b4b-8985-f36a5d5195aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:40.388191 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a8aedc13-983f-4b4b-8985-f36a5d5195aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:40.436579 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1ea28852-cce1-492b-8a92-50e31ec15488 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:40.437198 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1ea28852-cce1-492b-8a92-50e31ec15488 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:40.443633 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ea28852-cce1-492b-8a92-50e31ec15488 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:40.444337 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ea28852-cce1-492b-8a92-50e31ec15488 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:40.445106 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ea28852-cce1-492b-8a92-50e31ec15488 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:40.445534 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ea28852-cce1-492b-8a92-50e31ec15488 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:40.527270 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a8aedc13-983f-4b4b-8985-f36a5d5195aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:40.534993 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a8aedc13-983f-4b4b-8985-f36a5d5195aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.168537 Apr 05 12:13:40.535563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1623/3221] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:40 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:40.539978 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a0958ff8-894d-479a-8654-82e400ee21b3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:40.540603 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a0958ff8-894d-479a-8654-82e400ee21b3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:40.546272 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a0958ff8-894d-479a-8654-82e400ee21b3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:40.546712 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a0958ff8-894d-479a-8654-82e400ee21b3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:40.547459 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a0958ff8-894d-479a-8654-82e400ee21b3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:40.547881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a0958ff8-894d-479a-8654-82e400ee21b3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:40.579604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1ea28852-cce1-492b-8a92-50e31ec15488 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:40.587354 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1ea28852-cce1-492b-8a92-50e31ec15488 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.154540 Apr 05 12:13:40.587927 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1599/3222] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:40 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:40.609022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a0958ff8-894d-479a-8654-82e400ee21b3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:40.617369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a0958ff8-894d-479a-8654-82e400ee21b3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.080769 Apr 05 12:13:40.617901 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1624/3223] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:40 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:40.954878 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0322da55-b6c4-472b-bdce-61bbafbcc146 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:40.955868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0322da55-b6c4-472b-bdce-61bbafbcc146 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:40.963287 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0322da55-b6c4-472b-bdce-61bbafbcc146 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:40.963748 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0322da55-b6c4-472b-bdce-61bbafbcc146 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:40.964575 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0322da55-b6c4-472b-bdce-61bbafbcc146 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:40.965025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0322da55-b6c4-472b-bdce-61bbafbcc146 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:41.102896 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0322da55-b6c4-472b-bdce-61bbafbcc146 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:41.112013 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0322da55-b6c4-472b-bdce-61bbafbcc146 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:41.113538 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0322da55-b6c4-472b-bdce-61bbafbcc146 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:41.114880 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0322da55-b6c4-472b-bdce-61bbafbcc146 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.166577 Apr 05 12:13:41.115438 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1600/3224] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:40 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:41.556462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4a94a352-09bb-4d57-bdfe-38d8aa21d25f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:41.557492 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4a94a352-09bb-4d57-bdfe-38d8aa21d25f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:41.567890 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a94a352-09bb-4d57-bdfe-38d8aa21d25f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:41.568375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a94a352-09bb-4d57-bdfe-38d8aa21d25f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:41.569119 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a94a352-09bb-4d57-bdfe-38d8aa21d25f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:41.569559 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a94a352-09bb-4d57-bdfe-38d8aa21d25f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:41.604560 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-56ed91a2-b7e9-4c3e-b306-1309f2e39c63 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:41.605256 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-56ed91a2-b7e9-4c3e-b306-1309f2e39c63 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:41.612060 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56ed91a2-b7e9-4c3e-b306-1309f2e39c63 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:41.612535 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56ed91a2-b7e9-4c3e-b306-1309f2e39c63 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:41.613300 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56ed91a2-b7e9-4c3e-b306-1309f2e39c63 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:41.613729 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56ed91a2-b7e9-4c3e-b306-1309f2e39c63 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:41.702638 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4a94a352-09bb-4d57-bdfe-38d8aa21d25f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:41.710695 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4a94a352-09bb-4d57-bdfe-38d8aa21d25f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.160752 Apr 05 12:13:41.711272 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1625/3225] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:41 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:41.716859 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8833a8bb-9b45-46b8-b87d-3afbb4438cfd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:41.716859 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8833a8bb-9b45-46b8-b87d-3afbb4438cfd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:41.722631 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8833a8bb-9b45-46b8-b87d-3afbb4438cfd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:41.723084 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8833a8bb-9b45-46b8-b87d-3afbb4438cfd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:41.723868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8833a8bb-9b45-46b8-b87d-3afbb4438cfd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:41.724348 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8833a8bb-9b45-46b8-b87d-3afbb4438cfd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:41.748385 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-56ed91a2-b7e9-4c3e-b306-1309f2e39c63 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:41.756506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-56ed91a2-b7e9-4c3e-b306-1309f2e39c63 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.155787 Apr 05 12:13:41.757081 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1601/3226] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:41 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:41.783440 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8833a8bb-9b45-46b8-b87d-3afbb4438cfd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:41.791949 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8833a8bb-9b45-46b8-b87d-3afbb4438cfd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.079768 Apr 05 12:13:41.792601 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1626/3227] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:41 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:42.143100 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3a018d8a-3cba-47a6-899c-1c3718eceb55 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:42.143980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3a018d8a-3cba-47a6-899c-1c3718eceb55 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:42.154078 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3a018d8a-3cba-47a6-899c-1c3718eceb55 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:42.154826 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3a018d8a-3cba-47a6-899c-1c3718eceb55 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:42.156117 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3a018d8a-3cba-47a6-899c-1c3718eceb55 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:42.156857 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3a018d8a-3cba-47a6-899c-1c3718eceb55 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:42.293220 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3a018d8a-3cba-47a6-899c-1c3718eceb55 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:42.306580 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3a018d8a-3cba-47a6-899c-1c3718eceb55 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:42.308900 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3a018d8a-3cba-47a6-899c-1c3718eceb55 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:42.310583 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3a018d8a-3cba-47a6-899c-1c3718eceb55 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.174065 Apr 05 12:13:42.311344 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1602/3228] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:42 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:42.732420 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-50d991ba-0cfa-4e4a-981b-df18a2df37ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:42.733384 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-50d991ba-0cfa-4e4a-981b-df18a2df37ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:42.742480 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-50d991ba-0cfa-4e4a-981b-df18a2df37ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:42.742932 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-50d991ba-0cfa-4e4a-981b-df18a2df37ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:42.743718 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-50d991ba-0cfa-4e4a-981b-df18a2df37ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:42.744182 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-50d991ba-0cfa-4e4a-981b-df18a2df37ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:42.773743 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9d787d2d-09d3-4e61-8acb-f29a317f9b9f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:42.774317 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9d787d2d-09d3-4e61-8acb-f29a317f9b9f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:42.780954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9d787d2d-09d3-4e61-8acb-f29a317f9b9f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:42.781404 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9d787d2d-09d3-4e61-8acb-f29a317f9b9f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:42.782163 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9d787d2d-09d3-4e61-8acb-f29a317f9b9f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:42.782810 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9d787d2d-09d3-4e61-8acb-f29a317f9b9f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:42.881403 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-50d991ba-0cfa-4e4a-981b-df18a2df37ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:42.889829 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-50d991ba-0cfa-4e4a-981b-df18a2df37ec tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.163838 Apr 05 12:13:42.890624 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1627/3229] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:42 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:42.894919 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ed7e8b58-abc1-40f3-87ec-da8c6b478aaa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:42.895552 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ed7e8b58-abc1-40f3-87ec-da8c6b478aaa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:42.901871 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ed7e8b58-abc1-40f3-87ec-da8c6b478aaa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:42.901871 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ed7e8b58-abc1-40f3-87ec-da8c6b478aaa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:42.902641 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ed7e8b58-abc1-40f3-87ec-da8c6b478aaa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:42.903079 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ed7e8b58-abc1-40f3-87ec-da8c6b478aaa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:42.921789 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9d787d2d-09d3-4e61-8acb-f29a317f9b9f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:42.929619 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9d787d2d-09d3-4e61-8acb-f29a317f9b9f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.159836 Apr 05 12:13:42.930185 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1603/3230] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:42 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:42.961248 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ed7e8b58-abc1-40f3-87ec-da8c6b478aaa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:42.968952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ed7e8b58-abc1-40f3-87ec-da8c6b478aaa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.077584 Apr 05 12:13:42.969528 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1628/3231] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:42 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:43.334694 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-03e3db39-5660-4c0a-aff4-ecb2b3ee8d85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:43.335297 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-03e3db39-5660-4c0a-aff4-ecb2b3ee8d85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:43.341753 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03e3db39-5660-4c0a-aff4-ecb2b3ee8d85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:43.342351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03e3db39-5660-4c0a-aff4-ecb2b3ee8d85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:43.342922 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03e3db39-5660-4c0a-aff4-ecb2b3ee8d85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:43.343348 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03e3db39-5660-4c0a-aff4-ecb2b3ee8d85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:43.478606 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-03e3db39-5660-4c0a-aff4-ecb2b3ee8d85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:43.486875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-03e3db39-5660-4c0a-aff4-ecb2b3ee8d85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:43.488374 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-03e3db39-5660-4c0a-aff4-ecb2b3ee8d85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:43.489662 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-03e3db39-5660-4c0a-aff4-ecb2b3ee8d85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.160616 Apr 05 12:13:43.490221 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1604/3232] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:43 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:43.911271 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2a322cf7-14b6-4e7b-87a0-b94f4880b010 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:43.912593 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2a322cf7-14b6-4e7b-87a0-b94f4880b010 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:43.922347 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2a322cf7-14b6-4e7b-87a0-b94f4880b010 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:43.923140 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2a322cf7-14b6-4e7b-87a0-b94f4880b010 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:43.924479 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2a322cf7-14b6-4e7b-87a0-b94f4880b010 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:43.925189 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2a322cf7-14b6-4e7b-87a0-b94f4880b010 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:43.946768 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1a757a58-2776-4de6-af28-16c8dd0feeb4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:43.947348 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1a757a58-2776-4de6-af28-16c8dd0feeb4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:43.953617 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1a757a58-2776-4de6-af28-16c8dd0feeb4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:43.954061 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1a757a58-2776-4de6-af28-16c8dd0feeb4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:43.954813 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1a757a58-2776-4de6-af28-16c8dd0feeb4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:43.955885 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1a757a58-2776-4de6-af28-16c8dd0feeb4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:44.059998 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2a322cf7-14b6-4e7b-87a0-b94f4880b010 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:44.068156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2a322cf7-14b6-4e7b-87a0-b94f4880b010 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.163419 Apr 05 12:13:44.068734 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1629/3233] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:43 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:44.073132 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b983cf8f-adf2-428e-b291-3c7d27569dfa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:44.073816 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b983cf8f-adf2-428e-b291-3c7d27569dfa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:44.079647 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b983cf8f-adf2-428e-b291-3c7d27569dfa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:44.080112 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b983cf8f-adf2-428e-b291-3c7d27569dfa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:44.080864 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b983cf8f-adf2-428e-b291-3c7d27569dfa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:44.081291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b983cf8f-adf2-428e-b291-3c7d27569dfa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:44.092188 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1a757a58-2776-4de6-af28-16c8dd0feeb4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:44.099990 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1a757a58-2776-4de6-af28-16c8dd0feeb4 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.157105 Apr 05 12:13:44.100593 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1605/3234] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:43 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:44.139833 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b983cf8f-adf2-428e-b291-3c7d27569dfa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:44.147972 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b983cf8f-adf2-428e-b291-3c7d27569dfa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.078292 Apr 05 12:13:44.148569 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1630/3235] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:44 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:44.510014 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-eb3ab026-7155-472d-b1dd-06335dacd03e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:44.510657 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-eb3ab026-7155-472d-b1dd-06335dacd03e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:44.517490 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eb3ab026-7155-472d-b1dd-06335dacd03e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:44.517963 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eb3ab026-7155-472d-b1dd-06335dacd03e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:44.518762 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eb3ab026-7155-472d-b1dd-06335dacd03e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:44.519217 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eb3ab026-7155-472d-b1dd-06335dacd03e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:44.655949 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-eb3ab026-7155-472d-b1dd-06335dacd03e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:44.664714 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-eb3ab026-7155-472d-b1dd-06335dacd03e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:44.666218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-eb3ab026-7155-472d-b1dd-06335dacd03e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:44.667373 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-eb3ab026-7155-472d-b1dd-06335dacd03e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.161550 Apr 05 12:13:44.667963 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1606/3236] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:44 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:45.089245 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-083c7caf-cfe3-4820-a5b9-7e47db225101 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:45.090207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-083c7caf-cfe3-4820-a5b9-7e47db225101 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:45.100106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-083c7caf-cfe3-4820-a5b9-7e47db225101 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:45.100555 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-083c7caf-cfe3-4820-a5b9-7e47db225101 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:45.101310 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-083c7caf-cfe3-4820-a5b9-7e47db225101 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:45.101728 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-083c7caf-cfe3-4820-a5b9-7e47db225101 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:45.117297 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-674df1cd-8ff3-43ab-b222-8585f1d37af7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:45.117935 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-674df1cd-8ff3-43ab-b222-8585f1d37af7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:45.124564 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-674df1cd-8ff3-43ab-b222-8585f1d37af7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:45.125011 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-674df1cd-8ff3-43ab-b222-8585f1d37af7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:45.125783 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-674df1cd-8ff3-43ab-b222-8585f1d37af7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:45.126211 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-674df1cd-8ff3-43ab-b222-8585f1d37af7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:45.239610 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-083c7caf-cfe3-4820-a5b9-7e47db225101 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:45.247910 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-083c7caf-cfe3-4820-a5b9-7e47db225101 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.165149 Apr 05 12:13:45.248515 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1631/3237] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:45 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:45.253297 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f48851a1-accc-4af6-9e8c-d82cdd8bc06f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:45.253888 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f48851a1-accc-4af6-9e8c-d82cdd8bc06f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:45.257624 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-674df1cd-8ff3-43ab-b222-8585f1d37af7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:45.259621 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f48851a1-accc-4af6-9e8c-d82cdd8bc06f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:45.260109 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f48851a1-accc-4af6-9e8c-d82cdd8bc06f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:45.260860 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f48851a1-accc-4af6-9e8c-d82cdd8bc06f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:45.261295 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f48851a1-accc-4af6-9e8c-d82cdd8bc06f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:45.265722 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-674df1cd-8ff3-43ab-b222-8585f1d37af7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.152261 Apr 05 12:13:45.266385 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1607/3238] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:45 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:45.330131 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f48851a1-accc-4af6-9e8c-d82cdd8bc06f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:45.338231 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f48851a1-accc-4af6-9e8c-d82cdd8bc06f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.088766 Apr 05 12:13:45.338793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1632/3239] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:45 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:45.689839 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2523e5c3-021c-4f80-a635-caf76f3191ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:45.690852 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2523e5c3-021c-4f80-a635-caf76f3191ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:45.701143 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2523e5c3-021c-4f80-a635-caf76f3191ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:45.701850 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2523e5c3-021c-4f80-a635-caf76f3191ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:45.703115 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2523e5c3-021c-4f80-a635-caf76f3191ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:45.703831 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2523e5c3-021c-4f80-a635-caf76f3191ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:45.855088 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2523e5c3-021c-4f80-a635-caf76f3191ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:45.863975 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2523e5c3-021c-4f80-a635-caf76f3191ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:45.865536 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2523e5c3-021c-4f80-a635-caf76f3191ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:45.866667 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2523e5c3-021c-4f80-a635-caf76f3191ed tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.183471 Apr 05 12:13:45.867220 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1608/3240] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:45 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:46.269816 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1b2a5495-2326-494a-99be-f2ad6fe55153 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:46.270796 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1b2a5495-2326-494a-99be-f2ad6fe55153 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:46.279825 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1b2a5495-2326-494a-99be-f2ad6fe55153 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:46.280461 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1b2a5495-2326-494a-99be-f2ad6fe55153 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:46.281463 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1b2a5495-2326-494a-99be-f2ad6fe55153 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:46.282087 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1b2a5495-2326-494a-99be-f2ad6fe55153 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:46.284779 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4ae8c404-d146-4e4b-92cc-12a34058a607 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:46.285595 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4ae8c404-d146-4e4b-92cc-12a34058a607 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:46.293909 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4ae8c404-d146-4e4b-92cc-12a34058a607 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:46.294513 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4ae8c404-d146-4e4b-92cc-12a34058a607 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:46.295524 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4ae8c404-d146-4e4b-92cc-12a34058a607 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:46.296126 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4ae8c404-d146-4e4b-92cc-12a34058a607 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:46.420715 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1b2a5495-2326-494a-99be-f2ad6fe55153 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:46.429021 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1b2a5495-2326-494a-99be-f2ad6fe55153 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.165648 Apr 05 12:13:46.429565 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1633/3241] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:46 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:46.430161 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4ae8c404-d146-4e4b-92cc-12a34058a607 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:46.433941 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3c2a8cc5-538f-45b5-b042-6ebdfcb79184 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:46.434681 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3c2a8cc5-538f-45b5-b042-6ebdfcb79184 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:46.438283 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4ae8c404-d146-4e4b-92cc-12a34058a607 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.158885 Apr 05 12:13:46.439007 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1609/3242] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:46 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:46.444204 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3c2a8cc5-538f-45b5-b042-6ebdfcb79184 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:46.444661 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3c2a8cc5-538f-45b5-b042-6ebdfcb79184 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:46.445436 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3c2a8cc5-538f-45b5-b042-6ebdfcb79184 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:46.445876 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3c2a8cc5-538f-45b5-b042-6ebdfcb79184 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:46.504874 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3c2a8cc5-538f-45b5-b042-6ebdfcb79184 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:46.513357 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3c2a8cc5-538f-45b5-b042-6ebdfcb79184 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.082829 Apr 05 12:13:46.513930 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1634/3243] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:46 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:46.889543 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-89f11249-a386-4abd-adf2-a9a53053908f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:46.890502 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-89f11249-a386-4abd-adf2-a9a53053908f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:46.898699 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-89f11249-a386-4abd-adf2-a9a53053908f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:46.899149 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-89f11249-a386-4abd-adf2-a9a53053908f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:46.899913 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-89f11249-a386-4abd-adf2-a9a53053908f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:46.900388 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-89f11249-a386-4abd-adf2-a9a53053908f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:47.058397 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-89f11249-a386-4abd-adf2-a9a53053908f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:47.071110 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-89f11249-a386-4abd-adf2-a9a53053908f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:47.073570 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-89f11249-a386-4abd-adf2-a9a53053908f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:47.075420 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-89f11249-a386-4abd-adf2-a9a53053908f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.192295 Apr 05 12:13:47.076371 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1610/3244] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:46 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:47.447783 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ce628979-7548-4b1f-85ff-266011e63b3a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:47.448438 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ce628979-7548-4b1f-85ff-266011e63b3a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:47.455206 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cd187f37-5ea3-4b83-a997-8af24fe3c9d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:47.455753 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ce628979-7548-4b1f-85ff-266011e63b3a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:47.455917 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cd187f37-5ea3-4b83-a997-8af24fe3c9d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:47.456100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ce628979-7548-4b1f-85ff-266011e63b3a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:47.456981 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ce628979-7548-4b1f-85ff-266011e63b3a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:47.457461 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ce628979-7548-4b1f-85ff-266011e63b3a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:47.462847 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd187f37-5ea3-4b83-a997-8af24fe3c9d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:47.463366 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd187f37-5ea3-4b83-a997-8af24fe3c9d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:47.464235 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd187f37-5ea3-4b83-a997-8af24fe3c9d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:47.464712 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd187f37-5ea3-4b83-a997-8af24fe3c9d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:47.600030 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ce628979-7548-4b1f-85ff-266011e63b3a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:47.600735 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-cd187f37-5ea3-4b83-a997-8af24fe3c9d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:47.608965 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ce628979-7548-4b1f-85ff-266011e63b3a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.165518 Apr 05 12:13:47.609562 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1635/3245] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:47 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:47.613060 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cd187f37-5ea3-4b83-a997-8af24fe3c9d7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.161962 Apr 05 12:13:47.613781 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1611/3246] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:47 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:47.614094 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c1b6da97-e792-4c12-ad0e-9e0eb1e17498 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:47.614690 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c1b6da97-e792-4c12-ad0e-9e0eb1e17498 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:47.620413 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c1b6da97-e792-4c12-ad0e-9e0eb1e17498 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:47.620851 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c1b6da97-e792-4c12-ad0e-9e0eb1e17498 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:47.621594 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c1b6da97-e792-4c12-ad0e-9e0eb1e17498 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:47.622015 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c1b6da97-e792-4c12-ad0e-9e0eb1e17498 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:47.689867 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c1b6da97-e792-4c12-ad0e-9e0eb1e17498 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:47.698154 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c1b6da97-e792-4c12-ad0e-9e0eb1e17498 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.087564 Apr 05 12:13:47.698662 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1636/3247] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:47 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:48.094634 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7a5e577e-651d-473b-8462-2d814727f0e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:48.095241 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7a5e577e-651d-473b-8462-2d814727f0e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:48.101654 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7a5e577e-651d-473b-8462-2d814727f0e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:48.102107 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7a5e577e-651d-473b-8462-2d814727f0e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:48.102865 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7a5e577e-651d-473b-8462-2d814727f0e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:48.103292 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7a5e577e-651d-473b-8462-2d814727f0e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:48.240902 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7a5e577e-651d-473b-8462-2d814727f0e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:48.249611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7a5e577e-651d-473b-8462-2d814727f0e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:48.251107 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7a5e577e-651d-473b-8462-2d814727f0e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:48.252289 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7a5e577e-651d-473b-8462-2d814727f0e2 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.161669 Apr 05 12:13:48.253222 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1612/3248] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:48 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:48.637410 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-612e82e6-4f91-4fc3-8e3a-d986a8ef7347 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:48.638409 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-612e82e6-4f91-4fc3-8e3a-d986a8ef7347 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:48.639847 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ab9c82f7-cfba-48be-97ef-376dad97b0bc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:48.640838 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ab9c82f7-cfba-48be-97ef-376dad97b0bc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:48.647414 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-612e82e6-4f91-4fc3-8e3a-d986a8ef7347 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:48.647837 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-612e82e6-4f91-4fc3-8e3a-d986a8ef7347 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:48.648661 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-612e82e6-4f91-4fc3-8e3a-d986a8ef7347 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:48.649088 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-612e82e6-4f91-4fc3-8e3a-d986a8ef7347 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:48.649460 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab9c82f7-cfba-48be-97ef-376dad97b0bc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:48.649915 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab9c82f7-cfba-48be-97ef-376dad97b0bc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:48.650681 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab9c82f7-cfba-48be-97ef-376dad97b0bc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:48.651133 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab9c82f7-cfba-48be-97ef-376dad97b0bc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:48.781736 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-612e82e6-4f91-4fc3-8e3a-d986a8ef7347 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:48.783482 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ab9c82f7-cfba-48be-97ef-376dad97b0bc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:48.789991 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-612e82e6-4f91-4fc3-8e3a-d986a8ef7347 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.159172 Apr 05 12:13:48.790710 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1637/3249] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:48 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:48.791473 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ab9c82f7-cfba-48be-97ef-376dad97b0bc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.158401 Apr 05 12:13:48.792171 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1613/3250] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:48 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:48.795517 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cb03e84d-20f3-4a74-9f68-87bc922afcae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:48.796231 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cb03e84d-20f3-4a74-9f68-87bc922afcae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:48.802020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cb03e84d-20f3-4a74-9f68-87bc922afcae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:48.802487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cb03e84d-20f3-4a74-9f68-87bc922afcae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:48.803221 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cb03e84d-20f3-4a74-9f68-87bc922afcae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:48.803646 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cb03e84d-20f3-4a74-9f68-87bc922afcae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:48.860793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cb03e84d-20f3-4a74-9f68-87bc922afcae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:48.869161 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cb03e84d-20f3-4a74-9f68-87bc922afcae tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.077431 Apr 05 12:13:48.869728 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1638/3251] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:48 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:49.273404 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5594869d-6f11-409f-9873-db65fd9f1632 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:49.274008 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5594869d-6f11-409f-9873-db65fd9f1632 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:49.280365 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5594869d-6f11-409f-9873-db65fd9f1632 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:49.280882 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5594869d-6f11-409f-9873-db65fd9f1632 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:49.281714 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5594869d-6f11-409f-9873-db65fd9f1632 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:49.282140 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5594869d-6f11-409f-9873-db65fd9f1632 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:49.414074 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5594869d-6f11-409f-9873-db65fd9f1632 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:49.423240 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5594869d-6f11-409f-9873-db65fd9f1632 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:49.424755 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5594869d-6f11-409f-9873-db65fd9f1632 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:49.425937 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5594869d-6f11-409f-9873-db65fd9f1632 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.157532 Apr 05 12:13:49.426583 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1614/3252] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:49 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:49.808374 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7a37abc9-1e1f-4b4e-8959-811f02113ae9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:49.809060 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7a37abc9-1e1f-4b4e-8959-811f02113ae9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:49.809555 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b36f935e-013b-46ca-8f88-b7a0a8cfd719 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:49.810171 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b36f935e-013b-46ca-8f88-b7a0a8cfd719 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:49.815355 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7a37abc9-1e1f-4b4e-8959-811f02113ae9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:49.815810 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7a37abc9-1e1f-4b4e-8959-811f02113ae9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:49.816383 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b36f935e-013b-46ca-8f88-b7a0a8cfd719 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:49.816585 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7a37abc9-1e1f-4b4e-8959-811f02113ae9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:49.816833 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b36f935e-013b-46ca-8f88-b7a0a8cfd719 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:49.817023 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7a37abc9-1e1f-4b4e-8959-811f02113ae9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:49.817622 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b36f935e-013b-46ca-8f88-b7a0a8cfd719 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:49.818047 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b36f935e-013b-46ca-8f88-b7a0a8cfd719 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:49.952942 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b36f935e-013b-46ca-8f88-b7a0a8cfd719 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:49.961131 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b36f935e-013b-46ca-8f88-b7a0a8cfd719 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.156758 Apr 05 12:13:49.961725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1639/3253] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:49 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:49.962972 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7a37abc9-1e1f-4b4e-8959-811f02113ae9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:49.966398 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-598556cc-9f80-4770-b891-d814614e0d4f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:49.967006 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-598556cc-9f80-4770-b891-d814614e0d4f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:49.971617 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7a37abc9-1e1f-4b4e-8959-811f02113ae9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.167245 Apr 05 12:13:49.972210 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1615/3254] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:49 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:49.972773 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-598556cc-9f80-4770-b891-d814614e0d4f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:49.973312 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-598556cc-9f80-4770-b891-d814614e0d4f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:49.974090 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-598556cc-9f80-4770-b891-d814614e0d4f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:49.974548 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-598556cc-9f80-4770-b891-d814614e0d4f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:50.035475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-598556cc-9f80-4770-b891-d814614e0d4f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:50.043533 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-598556cc-9f80-4770-b891-d814614e0d4f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.080795 Apr 05 12:13:50.044104 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1640/3255] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:49 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:50.445534 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-56dfd831-995f-469f-8cb7-4d58938b3f4c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:50.446145 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-56dfd831-995f-469f-8cb7-4d58938b3f4c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:50.452590 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56dfd831-995f-469f-8cb7-4d58938b3f4c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:50.453033 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56dfd831-995f-469f-8cb7-4d58938b3f4c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:50.453792 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56dfd831-995f-469f-8cb7-4d58938b3f4c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:50.454220 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-56dfd831-995f-469f-8cb7-4d58938b3f4c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:50.595552 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-56dfd831-995f-469f-8cb7-4d58938b3f4c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:50.604625 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-56dfd831-995f-469f-8cb7-4d58938b3f4c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:50.606109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-56dfd831-995f-469f-8cb7-4d58938b3f4c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:50.607259 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-56dfd831-995f-469f-8cb7-4d58938b3f4c tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.166449 Apr 05 12:13:50.607826 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1616/3256] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:50 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:50.982333 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-72c5f887-63b6-41e6-9664-9e7305ef7661 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:50.983303 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-72c5f887-63b6-41e6-9664-9e7305ef7661 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:50.991376 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4531f847-9847-4e84-bd01-647ce40e50ba tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:50.991999 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4531f847-9847-4e84-bd01-647ce40e50ba tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:50.992328 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-72c5f887-63b6-41e6-9664-9e7305ef7661 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:50.992775 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-72c5f887-63b6-41e6-9664-9e7305ef7661 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:50.993544 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-72c5f887-63b6-41e6-9664-9e7305ef7661 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:50.993954 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-72c5f887-63b6-41e6-9664-9e7305ef7661 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:50.998572 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4531f847-9847-4e84-bd01-647ce40e50ba tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:50.999027 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4531f847-9847-4e84-bd01-647ce40e50ba tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:50.999759 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4531f847-9847-4e84-bd01-647ce40e50ba tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:51.000317 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4531f847-9847-4e84-bd01-647ce40e50ba tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:51.128550 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-72c5f887-63b6-41e6-9664-9e7305ef7661 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:51.134763 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4531f847-9847-4e84-bd01-647ce40e50ba tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:51.137016 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-72c5f887-63b6-41e6-9664-9e7305ef7661 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.161104 Apr 05 12:13:51.137858 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1641/3257] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:50 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:51.142077 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-700a9709-54c7-44f7-95d0-9f069f9442d6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:51.142663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-700a9709-54c7-44f7-95d0-9f069f9442d6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:51.148167 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-700a9709-54c7-44f7-95d0-9f069f9442d6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:51.148603 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-700a9709-54c7-44f7-95d0-9f069f9442d6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:51.149342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-700a9709-54c7-44f7-95d0-9f069f9442d6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:51.149768 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-700a9709-54c7-44f7-95d0-9f069f9442d6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:51.151434 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4531f847-9847-4e84-bd01-647ce40e50ba tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.165101 Apr 05 12:13:51.152014 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1617/3258] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:50 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:51.208256 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-700a9709-54c7-44f7-95d0-9f069f9442d6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:51.216271 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-700a9709-54c7-44f7-95d0-9f069f9442d6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.077754 Apr 05 12:13:51.216831 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1642/3259] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:51 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:51.630004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-86020bfc-5365-49d9-9f03-2347b10e72d9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:51.631076 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-86020bfc-5365-49d9-9f03-2347b10e72d9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:51.641310 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86020bfc-5365-49d9-9f03-2347b10e72d9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:51.642047 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86020bfc-5365-49d9-9f03-2347b10e72d9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:51.643327 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86020bfc-5365-49d9-9f03-2347b10e72d9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:51.644032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86020bfc-5365-49d9-9f03-2347b10e72d9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:51.782321 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-86020bfc-5365-49d9-9f03-2347b10e72d9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:51.791015 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-86020bfc-5365-49d9-9f03-2347b10e72d9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:51.792549 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-86020bfc-5365-49d9-9f03-2347b10e72d9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:51.793724 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-86020bfc-5365-49d9-9f03-2347b10e72d9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.170655 Apr 05 12:13:51.794291 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1618/3260] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:51 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:52.158390 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-30c037ce-176c-41b8-98f8-19ee18217b9b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:52.159335 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-30c037ce-176c-41b8-98f8-19ee18217b9b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:52.170100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-30c037ce-176c-41b8-98f8-19ee18217b9b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:52.170839 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-30c037ce-176c-41b8-98f8-19ee18217b9b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:52.172424 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6501a902-d8c5-4e3b-ad6b-573e5ad5eddb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:52.173222 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-30c037ce-176c-41b8-98f8-19ee18217b9b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:52.173407 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-30c037ce-176c-41b8-98f8-19ee18217b9b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:52.173572 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6501a902-d8c5-4e3b-ad6b-573e5ad5eddb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:52.181214 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6501a902-d8c5-4e3b-ad6b-573e5ad5eddb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:52.181667 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6501a902-d8c5-4e3b-ad6b-573e5ad5eddb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:52.182441 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6501a902-d8c5-4e3b-ad6b-573e5ad5eddb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:52.182875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6501a902-d8c5-4e3b-ad6b-573e5ad5eddb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:52.310662 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-30c037ce-176c-41b8-98f8-19ee18217b9b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:52.316179 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6501a902-d8c5-4e3b-ad6b-573e5ad5eddb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:52.318701 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-30c037ce-176c-41b8-98f8-19ee18217b9b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.166968 Apr 05 12:13:52.319315 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1643/3261] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:52 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:52.323851 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ad44ba25-67df-4931-b29b-3766f5432531 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:52.324485 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ad44ba25-67df-4931-b29b-3766f5432531 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:52.327213 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6501a902-d8c5-4e3b-ad6b-573e5ad5eddb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.161201 Apr 05 12:13:52.328129 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1619/3262] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:52 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:52.330525 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ad44ba25-67df-4931-b29b-3766f5432531 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:52.330974 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ad44ba25-67df-4931-b29b-3766f5432531 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:52.331724 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ad44ba25-67df-4931-b29b-3766f5432531 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:52.332178 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ad44ba25-67df-4931-b29b-3766f5432531 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:52.390445 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ad44ba25-67df-4931-b29b-3766f5432531 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:52.398291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ad44ba25-67df-4931-b29b-3766f5432531 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.078032 Apr 05 12:13:52.398829 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1644/3263] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:52 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:52.816498 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0f6638bc-f6e0-4aff-becb-dbec44c1e1da tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:52.817471 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0f6638bc-f6e0-4aff-becb-dbec44c1e1da tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:52.824469 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0f6638bc-f6e0-4aff-becb-dbec44c1e1da tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:52.824961 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0f6638bc-f6e0-4aff-becb-dbec44c1e1da tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:52.825790 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0f6638bc-f6e0-4aff-becb-dbec44c1e1da tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:52.826231 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0f6638bc-f6e0-4aff-becb-dbec44c1e1da tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:52.978922 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0f6638bc-f6e0-4aff-becb-dbec44c1e1da tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:52.987654 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0f6638bc-f6e0-4aff-becb-dbec44c1e1da tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:52.989282 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0f6638bc-f6e0-4aff-becb-dbec44c1e1da tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:52.990417 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0f6638bc-f6e0-4aff-becb-dbec44c1e1da tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 200 len: 1800 microversion: 2.20 time: 0.180777 Apr 05 12:13:52.990988 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1620/3264] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:52 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 1800 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:53.008923 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-05d6e06c-b36a-4732-bf60-854bac668944 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '.version_select at 0x7f161c5c1ca0>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:53.033473 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-05d6e06c-b36a-4732-bf60-854bac668944 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-228865684" status: 204 len: 0 microversion: 2.20 time: 0.028442 Apr 05 12:13:53.034031 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1645/3265] 10.222.0.61 () {60 vars in 1258 bytes} [Tue Apr 5 12:13:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-228865684 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 05 12:13:53.336643 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-86008575-cc03-4219-b177-10dbd5b79607 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:53.337284 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-86008575-cc03-4219-b177-10dbd5b79607 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:53.343763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1555ecf9-4ee2-4d80-ac28-624fa2fd986c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:53.344370 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86008575-cc03-4219-b177-10dbd5b79607 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:53.344484 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86008575-cc03-4219-b177-10dbd5b79607 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:53.344977 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1555ecf9-4ee2-4d80-ac28-624fa2fd986c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:53.345203 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86008575-cc03-4219-b177-10dbd5b79607 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:53.345737 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86008575-cc03-4219-b177-10dbd5b79607 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:53.352901 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1555ecf9-4ee2-4d80-ac28-624fa2fd986c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:53.353438 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1555ecf9-4ee2-4d80-ac28-624fa2fd986c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:53.354302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1555ecf9-4ee2-4d80-ac28-624fa2fd986c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:53.354967 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1555ecf9-4ee2-4d80-ac28-624fa2fd986c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:53.479447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-86008575-cc03-4219-b177-10dbd5b79607 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:53.487904 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-86008575-cc03-4219-b177-10dbd5b79607 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.155454 Apr 05 12:13:53.497645 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1621/3266] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:53 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:53.497645 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7abdeeca-bc2b-4ec1-91df-96a387defa1d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:53.497645 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7abdeeca-bc2b-4ec1-91df-96a387defa1d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:53.501747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7abdeeca-bc2b-4ec1-91df-96a387defa1d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:53.502193 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7abdeeca-bc2b-4ec1-91df-96a387defa1d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:53.503342 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7abdeeca-bc2b-4ec1-91df-96a387defa1d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:53.503814 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7abdeeca-bc2b-4ec1-91df-96a387defa1d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:53.566652 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7abdeeca-bc2b-4ec1-91df-96a387defa1d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:53.575177 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7abdeeca-bc2b-4ec1-91df-96a387defa1d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.085604 Apr 05 12:13:53.575736 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1622/3267] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:53 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:53.585352 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1555ecf9-4ee2-4d80-ac28-624fa2fd986c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:53.593363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1555ecf9-4ee2-4d80-ac28-624fa2fd986c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.253298 Apr 05 12:13:53.593835 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1646/3268] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:53 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:54.307826 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-032ea5ff-b199-4358-9e8b-c2196583ee46 req-57b135cd-b349-44b6-87cc-d8ea8f6aacfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a3437c-94c0-4133-a629-9386b4639a2d", "tag": "4b172ae7-f382-4bd9-8d9f-48fd8694b406"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:54.318719 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-032ea5ff-b199-4358-9e8b-c2196583ee46 req-57b135cd-b349-44b6-87cc-d8ea8f6aacfa service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:54.318719 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-032ea5ff-b199-4358-9e8b-c2196583ee46 req-57b135cd-b349-44b6-87cc-d8ea8f6aacfa service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:54.331803 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-032ea5ff-b199-4358-9e8b-c2196583ee46 req-57b135cd-b349-44b6-87cc-d8ea8f6aacfa service nova] Creating event network-changed:4b172ae7-f382-4bd9-8d9f-48fd8694b406 for instance 98a3437c-94c0-4133-a629-9386b4639a2d on hv-cinder-82956 Apr 05 12:13:54.337132 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-032ea5ff-b199-4358-9e8b-c2196583ee46 req-57b135cd-b349-44b6-87cc-d8ea8f6aacfa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034155 Apr 05 12:13:54.338121 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1623/3269] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:13:54.518248 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b16aba0e-4757-4e74-8ed5-e8909d8512cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:54.520514 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b16aba0e-4757-4e74-8ed5-e8909d8512cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:54.531585 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-01df3e6c-5a93-47d4-acc9-affd23adf955 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Action: 'create', calling method: .version_select at 0x7f161c3c7700>, body: {"keypair": {"name": "tempest-keypair-1701985553"}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:54.537462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b16aba0e-4757-4e74-8ed5-e8909d8512cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:54.542453 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b16aba0e-4757-4e74-8ed5-e8909d8512cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:54.543461 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b16aba0e-4757-4e74-8ed5-e8909d8512cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:54.545191 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b16aba0e-4757-4e74-8ed5-e8909d8512cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:54.547755 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-01df3e6c-5a93-47d4-acc9-affd23adf955 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Getting quotas for project e3713b85b0994fa58ad2bc1e17407387. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 12:13:54.554026 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-01df3e6c-5a93-47d4-acc9-affd23adf955 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Getting quotas for user 88cd8fe1bb69438bace9d89ee9b5e88c and project e3713b85b0994fa58ad2bc1e17407387. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 12:13:54.799867 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b16aba0e-4757-4e74-8ed5-e8909d8512cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:54.810372 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b16aba0e-4757-4e74-8ed5-e8909d8512cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.305649 Apr 05 12:13:54.811614 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1647/3270] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:54 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:54.817072 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a24b1f55-0b02-4711-b887-e72f96f90f0c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:54.817904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a24b1f55-0b02-4711-b887-e72f96f90f0c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:54.824713 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a24b1f55-0b02-4711-b887-e72f96f90f0c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:54.825580 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a24b1f55-0b02-4711-b887-e72f96f90f0c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:54.826504 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a24b1f55-0b02-4711-b887-e72f96f90f0c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:54.827090 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a24b1f55-0b02-4711-b887-e72f96f90f0c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:54.902719 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-01df3e6c-5a93-47d4-acc9-affd23adf955 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Getting quotas for project e3713b85b0994fa58ad2bc1e17407387. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 12:13:54.907447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-01df3e6c-5a93-47d4-acc9-affd23adf955 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Getting quotas for user 88cd8fe1bb69438bace9d89ee9b5e88c and project e3713b85b0994fa58ad2bc1e17407387. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 12:13:54.914230 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a24b1f55-0b02-4711-b887-e72f96f90f0c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:54.923075 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a24b1f55-0b02-4711-b887-e72f96f90f0c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.109871 Apr 05 12:13:54.933416 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1648/3271] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:54 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:54.936241 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-01df3e6c-5a93-47d4-acc9-affd23adf955 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.409409 Apr 05 12:13:54.937942 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1624/3272] 10.222.0.61 () {62 vars in 1198 bytes} [Tue Apr 5 12:13:54 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 413 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 05 12:13:54.938153 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0472d878-ab4f-4da1-95c7-4480d0b2eba2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:54.938707 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0472d878-ab4f-4da1-95c7-4480d0b2eba2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:54.944703 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0472d878-ab4f-4da1-95c7-4480d0b2eba2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:54.945147 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0472d878-ab4f-4da1-95c7-4480d0b2eba2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:54.945911 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0472d878-ab4f-4da1-95c7-4480d0b2eba2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:54.946335 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0472d878-ab4f-4da1-95c7-4480d0b2eba2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:55.123976 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0472d878-ab4f-4da1-95c7-4480d0b2eba2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:55.134511 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0472d878-ab4f-4da1-95c7-4480d0b2eba2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.199967 Apr 05 12:13:55.135377 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1649/3273] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:54 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:55.828820 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-86a1a067-2003-4d0d-90c1-79e4b8bcba10 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:55.829745 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-86a1a067-2003-4d0d-90c1-79e4b8bcba10 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:55.835958 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86a1a067-2003-4d0d-90c1-79e4b8bcba10 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:55.836516 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86a1a067-2003-4d0d-90c1-79e4b8bcba10 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:55.837354 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86a1a067-2003-4d0d-90c1-79e4b8bcba10 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:55.837859 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-86a1a067-2003-4d0d-90c1-79e4b8bcba10 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:55.939972 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-24395fda-651b-4867-bf6f-3ec6973917cf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:55.940739 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-24395fda-651b-4867-bf6f-3ec6973917cf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:55.947304 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24395fda-651b-4867-bf6f-3ec6973917cf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:55.947749 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24395fda-651b-4867-bf6f-3ec6973917cf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:55.948533 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24395fda-651b-4867-bf6f-3ec6973917cf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:55.949026 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24395fda-651b-4867-bf6f-3ec6973917cf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:56.012512 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-24395fda-651b-4867-bf6f-3ec6973917cf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:56.021363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-24395fda-651b-4867-bf6f-3ec6973917cf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.085292 Apr 05 12:13:56.021937 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1650/3274] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:55 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:56.074542 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-86a1a067-2003-4d0d-90c1-79e4b8bcba10 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:56.082805 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-86a1a067-2003-4d0d-90c1-79e4b8bcba10 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.258648 Apr 05 12:13:56.083372 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1625/3275] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:55 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:56.151717 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7b621ebe-b96d-4050-80a5-8a83484839aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:56.152360 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7b621ebe-b96d-4050-80a5-8a83484839aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:56.158264 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b621ebe-b96d-4050-80a5-8a83484839aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:56.158688 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b621ebe-b96d-4050-80a5-8a83484839aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:56.160016 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b621ebe-b96d-4050-80a5-8a83484839aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:56.160476 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b621ebe-b96d-4050-80a5-8a83484839aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:56.297464 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7b621ebe-b96d-4050-80a5-8a83484839aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:56.305386 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7b621ebe-b96d-4050-80a5-8a83484839aa tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.157612 Apr 05 12:13:56.305945 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1651/3276] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:56 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:56.326713 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d9516b4b-7658-47a0-945d-18a82e45bdf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1651828591", "imageRef": "2b657785-cb0b-43ba-956c-1564c27fd10a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98e4aa45-646e-4c26-89eb-8bdac048f25a"}], "security_groups": [{"name": "tempest-securitygroup--2012169500"}], "key_name": "tempest-keypair-1701985553", "user_data": "}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:56.424465 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.network.neutron [None req-d9516b4b-7658-47a0-945d-18a82e45bdf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] validate_networks() for [('98e4aa45-646e-4c26-89eb-8bdac048f25a', None, None, None, None, None)] {{(pid=123357) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 12:13:56.866610 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-d9516b4b-7658-47a0-945d-18a82e45bdf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Flavor limits 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 12:13:56.867212 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-d9516b4b-7658-47a0-945d-18a82e45bdf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Image limits 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:13:56.867489 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-d9516b4b-7658-47a0-945d-18a82e45bdf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Flavor pref 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 12:13:56.867893 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-d9516b4b-7658-47a0-945d-18a82e45bdf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Image pref 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:13:56.868326 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-d9516b4b-7658-47a0-945d-18a82e45bdf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 12:13:56.878916 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d9516b4b-7658-47a0-945d-18a82e45bdf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:56.879357 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d9516b4b-7658-47a0-945d-18a82e45bdf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:56.880171 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d9516b4b-7658-47a0-945d-18a82e45bdf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:56.880605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d9516b4b-7658-47a0-945d-18a82e45bdf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:56.896746 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-d9516b4b-7658-47a0-945d-18a82e45bdf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Getting quotas for project e3713b85b0994fa58ad2bc1e17407387. Resources: {'ram', 'instances', 'cores'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 12:13:56.900716 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-d9516b4b-7658-47a0-945d-18a82e45bdf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Getting quotas for user 88cd8fe1bb69438bace9d89ee9b5e88c and project e3713b85b0994fa58ad2bc1e17407387. Resources: {'ram', 'instances', 'cores'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 12:13:56.912984 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d9516b4b-7658-47a0-945d-18a82e45bdf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Going to run 1 instances... {{(pid=123357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 12:13:56.915242 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d9516b4b-7658-47a0-945d-18a82e45bdf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 64db0811-1092-48cb-b6aa-9018da662bfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b657785-cb0b-43ba-956c-1564c27fd10a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 12:13:56.960373 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d9516b4b-7658-47a0-945d-18a82e45bdf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [c6d785aa-f6b8-4fde-b72a-bcb28d6c2b18] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 05 12:13:57.039977 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0771e912-f49c-4168-925f-2cc5ff6aba37 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:57.040579 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0771e912-f49c-4168-925f-2cc5ff6aba37 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:57.047414 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0771e912-f49c-4168-925f-2cc5ff6aba37 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:57.047891 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0771e912-f49c-4168-925f-2cc5ff6aba37 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:57.048657 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0771e912-f49c-4168-925f-2cc5ff6aba37 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:57.049091 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0771e912-f49c-4168-925f-2cc5ff6aba37 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:57.115485 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0771e912-f49c-4168-925f-2cc5ff6aba37 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:57.123723 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0771e912-f49c-4168-925f-2cc5ff6aba37 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.087921 Apr 05 12:13:57.124329 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1652/3277] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:57 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:57.128998 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-25633d98-bbe1-47d7-a78a-9913d407e1c3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:57.129665 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-25633d98-bbe1-47d7-a78a-9913d407e1c3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:57.135565 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-25633d98-bbe1-47d7-a78a-9913d407e1c3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:57.136004 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-25633d98-bbe1-47d7-a78a-9913d407e1c3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:57.136801 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-25633d98-bbe1-47d7-a78a-9913d407e1c3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:57.137231 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-25633d98-bbe1-47d7-a78a-9913d407e1c3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:57.270370 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-25633d98-bbe1-47d7-a78a-9913d407e1c3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:57.278595 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-25633d98-bbe1-47d7-a78a-9913d407e1c3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.153355 Apr 05 12:13:57.279166 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1653/3278] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:57 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:57.325777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-79f3d323-21b1-446c-8b69-6e61548ee01a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:57.326935 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-79f3d323-21b1-446c-8b69-6e61548ee01a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:57.336422 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79f3d323-21b1-446c-8b69-6e61548ee01a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:57.337171 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79f3d323-21b1-446c-8b69-6e61548ee01a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:57.338435 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79f3d323-21b1-446c-8b69-6e61548ee01a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:57.339148 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79f3d323-21b1-446c-8b69-6e61548ee01a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:57.483811 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-79f3d323-21b1-446c-8b69-6e61548ee01a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:57.492255 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-79f3d323-21b1-446c-8b69-6e61548ee01a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.172496 Apr 05 12:13:57.492804 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1654/3279] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:57 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:57.972062 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [None req-d9516b4b-7658-47a0-945d-18a82e45bdf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [c6d785aa-f6b8-4fde-b72a-bcb28d6c2b18] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 56726. Apr 05 12:13:57.977327 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d9516b4b-7658-47a0-945d-18a82e45bdf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.654973 Apr 05 12:13:57.977982 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1626/3280] 10.222.0.61 () {62 vars in 1187 bytes} [Tue Apr 5 12:13:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 1656 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 05 12:13:57.988115 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c5c220a2-fb65-45f0-967b-45157c43f1a9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:57.988708 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c5c220a2-fb65-45f0-967b-45157c43f1a9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 64db0811-1092-48cb-b6aa-9018da662bfc] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:58.042862 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c5c220a2-fb65-45f0-967b-45157c43f1a9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:58.050520 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c5c220a2-fb65-45f0-967b-45157c43f1a9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:58.052685 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c5c220a2-fb65-45f0-967b-45157c43f1a9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:58.053813 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c5c220a2-fb65-45f0-967b-45157c43f1a9 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc" status: 200 len: 1282 microversion: 2.20 time: 0.069624 Apr 05 12:13:58.054355 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1655/3281] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:57 2022] GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:58.141561 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e640f4bf-a0ce-4c14-bc47-9c219bedf397 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:58.142171 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e640f4bf-a0ce-4c14-bc47-9c219bedf397 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:58.149267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e640f4bf-a0ce-4c14-bc47-9c219bedf397 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:58.149710 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e640f4bf-a0ce-4c14-bc47-9c219bedf397 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:58.150497 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e640f4bf-a0ce-4c14-bc47-9c219bedf397 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:58.151088 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e640f4bf-a0ce-4c14-bc47-9c219bedf397 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:58.211074 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e640f4bf-a0ce-4c14-bc47-9c219bedf397 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:58.218959 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e640f4bf-a0ce-4c14-bc47-9c219bedf397 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.081352 Apr 05 12:13:58.219598 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1627/3282] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:58 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:58.298369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2664b990-f286-4288-92eb-f39152cc52cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:58.299067 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2664b990-f286-4288-92eb-f39152cc52cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:58.305255 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2664b990-f286-4288-92eb-f39152cc52cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:58.305707 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2664b990-f286-4288-92eb-f39152cc52cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:58.306462 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2664b990-f286-4288-92eb-f39152cc52cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:58.306912 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2664b990-f286-4288-92eb-f39152cc52cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:58.445047 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2664b990-f286-4288-92eb-f39152cc52cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:58.453224 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2664b990-f286-4288-92eb-f39152cc52cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.159950 Apr 05 12:13:58.453793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1656/3283] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:58 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:58.509504 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c3925d32-9291-4ae3-b4d1-12e15bed5595 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:58.510117 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c3925d32-9291-4ae3-b4d1-12e15bed5595 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:58.516201 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3925d32-9291-4ae3-b4d1-12e15bed5595 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:58.516618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3925d32-9291-4ae3-b4d1-12e15bed5595 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:58.517422 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3925d32-9291-4ae3-b4d1-12e15bed5595 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:58.517829 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3925d32-9291-4ae3-b4d1-12e15bed5595 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:58.662852 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c3925d32-9291-4ae3-b4d1-12e15bed5595 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:58.670782 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c3925d32-9291-4ae3-b4d1-12e15bed5595 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.165199 Apr 05 12:13:58.671359 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1628/3284] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:58 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:59.071753 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ffca6b39-4be1-491a-b111-2b335b402b9d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:59.072451 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ffca6b39-4be1-491a-b111-2b335b402b9d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 64db0811-1092-48cb-b6aa-9018da662bfc] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:59.078630 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ffca6b39-4be1-491a-b111-2b335b402b9d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:59.079110 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ffca6b39-4be1-491a-b111-2b335b402b9d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:59.079906 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ffca6b39-4be1-491a-b111-2b335b402b9d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:59.080397 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ffca6b39-4be1-491a-b111-2b335b402b9d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:59.150631 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ffca6b39-4be1-491a-b111-2b335b402b9d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:59.158445 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ffca6b39-4be1-491a-b111-2b335b402b9d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:59.159927 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ffca6b39-4be1-491a-b111-2b335b402b9d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:59.161097 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ffca6b39-4be1-491a-b111-2b335b402b9d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc" status: 200 len: 1340 microversion: 2.20 time: 0.093293 Apr 05 12:13:59.161652 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1657/3285] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:13:59 2022] GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc => generated 1340 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:59.237806 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b72ebbde-4894-4b7a-bdc6-d666ad626283 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:59.238401 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b72ebbde-4894-4b7a-bdc6-d666ad626283 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:59.245391 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b72ebbde-4894-4b7a-bdc6-d666ad626283 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:59.245849 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b72ebbde-4894-4b7a-bdc6-d666ad626283 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:59.246623 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b72ebbde-4894-4b7a-bdc6-d666ad626283 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:59.247050 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b72ebbde-4894-4b7a-bdc6-d666ad626283 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:59.308889 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b72ebbde-4894-4b7a-bdc6-d666ad626283 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:59.317790 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b72ebbde-4894-4b7a-bdc6-d666ad626283 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.083700 Apr 05 12:13:59.318339 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1629/3286] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:59 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:59.470461 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4545360e-b897-499b-aad7-a87c2cd47dea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:59.471317 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4545360e-b897-499b-aad7-a87c2cd47dea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:59.477418 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4545360e-b897-499b-aad7-a87c2cd47dea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:59.478077 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4545360e-b897-499b-aad7-a87c2cd47dea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:59.478881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4545360e-b897-499b-aad7-a87c2cd47dea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:59.479310 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4545360e-b897-499b-aad7-a87c2cd47dea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:59.688422 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-66e26e4d-7ca5-46a3-8372-95e00646288e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:13:59.689022 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-66e26e4d-7ca5-46a3-8372-95e00646288e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:13:59.695902 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66e26e4d-7ca5-46a3-8372-95e00646288e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:59.696383 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66e26e4d-7ca5-46a3-8372-95e00646288e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:59.697185 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66e26e4d-7ca5-46a3-8372-95e00646288e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:13:59.697659 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66e26e4d-7ca5-46a3-8372-95e00646288e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:13:59.706612 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4545360e-b897-499b-aad7-a87c2cd47dea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:59.716546 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4545360e-b897-499b-aad7-a87c2cd47dea tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.250057 Apr 05 12:13:59.727058 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1658/3287] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:59 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:59.841326 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-66e26e4d-7ca5-46a3-8372-95e00646288e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:13:59.849548 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-66e26e4d-7ca5-46a3-8372-95e00646288e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.165289 Apr 05 12:13:59.850125 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1630/3288] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:13:59 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:00.179252 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fb3002c1-63d8-447b-95e6-f65811f9a076 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:00.180480 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fb3002c1-63d8-447b-95e6-f65811f9a076 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 64db0811-1092-48cb-b6aa-9018da662bfc] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:00.187645 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fb3002c1-63d8-447b-95e6-f65811f9a076 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:00.188386 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fb3002c1-63d8-447b-95e6-f65811f9a076 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:00.189170 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fb3002c1-63d8-447b-95e6-f65811f9a076 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:00.189677 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fb3002c1-63d8-447b-95e6-f65811f9a076 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:00.335143 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-54c68650-61de-47fa-b458-8c7d0186eda2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:00.335609 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-54c68650-61de-47fa-b458-8c7d0186eda2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:00.343752 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54c68650-61de-47fa-b458-8c7d0186eda2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:00.344264 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54c68650-61de-47fa-b458-8c7d0186eda2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:00.345022 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54c68650-61de-47fa-b458-8c7d0186eda2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:00.345461 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54c68650-61de-47fa-b458-8c7d0186eda2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:00.413558 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-54c68650-61de-47fa-b458-8c7d0186eda2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:00.416937 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fb3002c1-63d8-447b-95e6-f65811f9a076 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:00.421474 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-54c68650-61de-47fa-b458-8c7d0186eda2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.090373 Apr 05 12:14:00.421990 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1631/3289] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:00 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:14:00.433100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fb3002c1-63d8-447b-95e6-f65811f9a076 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:00.434644 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fb3002c1-63d8-447b-95e6-f65811f9a076 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:00.435779 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fb3002c1-63d8-447b-95e6-f65811f9a076 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc" status: 200 len: 1408 microversion: 2.20 time: 0.260523 Apr 05 12:14:00.436526 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1659/3290] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:14:00 2022] GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc => generated 1408 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:14:00.543910 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-8e8273b6-df19-4dd0-9962-21451d39c703 req-b0448d99-f82b-4f63-9ea4-50a8bfb258c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64db0811-1092-48cb-b6aa-9018da662bfc", "tag": "311b46f0-2b31-4866-8942-835f4de933e0"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:00.557247 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-8e8273b6-df19-4dd0-9962-21451d39c703 req-b0448d99-f82b-4f63-9ea4-50a8bfb258c6 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:00.557934 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-8e8273b6-df19-4dd0-9962-21451d39c703 req-b0448d99-f82b-4f63-9ea4-50a8bfb258c6 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:00.579188 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-8e8273b6-df19-4dd0-9962-21451d39c703 req-b0448d99-f82b-4f63-9ea4-50a8bfb258c6 service nova] Creating event network-changed:311b46f0-2b31-4866-8942-835f4de933e0 for instance 64db0811-1092-48cb-b6aa-9018da662bfc on hv-cinder-82956 Apr 05 12:14:00.584696 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-8e8273b6-df19-4dd0-9962-21451d39c703 req-b0448d99-f82b-4f63-9ea4-50a8bfb258c6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044799 Apr 05 12:14:00.585411 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1632/3291] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:14:00.734274 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-aaf8bb88-83f3-4bdb-baff-9aae71b83de6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:00.734907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-aaf8bb88-83f3-4bdb-baff-9aae71b83de6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:00.741100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aaf8bb88-83f3-4bdb-baff-9aae71b83de6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:00.741546 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aaf8bb88-83f3-4bdb-baff-9aae71b83de6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:00.742300 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aaf8bb88-83f3-4bdb-baff-9aae71b83de6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:00.742726 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-aaf8bb88-83f3-4bdb-baff-9aae71b83de6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:00.867731 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2aee3015-fecd-441f-8d1c-5f540f912232 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:00.868803 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2aee3015-fecd-441f-8d1c-5f540f912232 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:00.875290 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2aee3015-fecd-441f-8d1c-5f540f912232 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:00.875761 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2aee3015-fecd-441f-8d1c-5f540f912232 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:00.876538 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2aee3015-fecd-441f-8d1c-5f540f912232 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:00.876980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2aee3015-fecd-441f-8d1c-5f540f912232 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:00.998505 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-aaf8bb88-83f3-4bdb-baff-9aae71b83de6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:01.007133 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-aaf8bb88-83f3-4bdb-baff-9aae71b83de6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.276714 Apr 05 12:14:01.007719 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1660/3292] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:00 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:01.025893 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2aee3015-fecd-441f-8d1c-5f540f912232 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:01.033921 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2aee3015-fecd-441f-8d1c-5f540f912232 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.170686 Apr 05 12:14:01.034505 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1633/3293] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:00 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:01.442402 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a8039f12-1a70-4a7e-baf1-d7912338f674 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:01.443255 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a8039f12-1a70-4a7e-baf1-d7912338f674 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:01.454312 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a8039f12-1a70-4a7e-baf1-d7912338f674 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:01.455077 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a8039f12-1a70-4a7e-baf1-d7912338f674 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:01.456400 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a8039f12-1a70-4a7e-baf1-d7912338f674 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:01.457124 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a8039f12-1a70-4a7e-baf1-d7912338f674 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:01.458359 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-db623c6f-be25-404d-b55e-324bb2cae345 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:01.459057 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-db623c6f-be25-404d-b55e-324bb2cae345 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 64db0811-1092-48cb-b6aa-9018da662bfc] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:01.465694 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-db623c6f-be25-404d-b55e-324bb2cae345 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:01.466222 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-db623c6f-be25-404d-b55e-324bb2cae345 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:01.467053 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-db623c6f-be25-404d-b55e-324bb2cae345 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:01.467561 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-db623c6f-be25-404d-b55e-324bb2cae345 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:01.519845 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a8039f12-1a70-4a7e-baf1-d7912338f674 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:01.528014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a8039f12-1a70-4a7e-baf1-d7912338f674 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.092219 Apr 05 12:14:01.528630 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1661/3294] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:01 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:01.600764 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-db623c6f-be25-404d-b55e-324bb2cae345 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:01.612877 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-db623c6f-be25-404d-b55e-324bb2cae345 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:01.615179 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-db623c6f-be25-404d-b55e-324bb2cae345 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:01.616845 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-db623c6f-be25-404d-b55e-324bb2cae345 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc" status: 200 len: 1408 microversion: 2.20 time: 0.165204 Apr 05 12:14:01.617660 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1634/3295] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:14:01 2022] GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:14:02.024833 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-90c8411a-cc9d-46f4-8d52-16056693cc7b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:02.025447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-90c8411a-cc9d-46f4-8d52-16056693cc7b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:02.031820 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90c8411a-cc9d-46f4-8d52-16056693cc7b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:02.032313 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90c8411a-cc9d-46f4-8d52-16056693cc7b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:02.033110 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90c8411a-cc9d-46f4-8d52-16056693cc7b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:02.033547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90c8411a-cc9d-46f4-8d52-16056693cc7b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:02.052889 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7283200c-2de3-45d7-8db7-28c9d729e4ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:02.053731 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7283200c-2de3-45d7-8db7-28c9d729e4ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:02.060385 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7283200c-2de3-45d7-8db7-28c9d729e4ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:02.060932 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7283200c-2de3-45d7-8db7-28c9d729e4ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:02.061782 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7283200c-2de3-45d7-8db7-28c9d729e4ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:02.062298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7283200c-2de3-45d7-8db7-28c9d729e4ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:02.196828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7283200c-2de3-45d7-8db7-28c9d729e4ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:02.205215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7283200c-2de3-45d7-8db7-28c9d729e4ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.156330 Apr 05 12:14:02.205805 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1635/3296] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:02 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:02.492213 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-90c8411a-cc9d-46f4-8d52-16056693cc7b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:02.500764 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-90c8411a-cc9d-46f4-8d52-16056693cc7b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.479961 Apr 05 12:14:02.501344 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1662/3297] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:02 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:02.545489 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bbdae80c-cd31-4c53-88f8-7e1bb86f8ee1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:02.546069 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bbdae80c-cd31-4c53-88f8-7e1bb86f8ee1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:02.552734 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bbdae80c-cd31-4c53-88f8-7e1bb86f8ee1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:02.553185 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bbdae80c-cd31-4c53-88f8-7e1bb86f8ee1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:02.553950 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bbdae80c-cd31-4c53-88f8-7e1bb86f8ee1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:02.554379 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bbdae80c-cd31-4c53-88f8-7e1bb86f8ee1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:02.613600 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-bbdae80c-cd31-4c53-88f8-7e1bb86f8ee1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:02.621651 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bbdae80c-cd31-4c53-88f8-7e1bb86f8ee1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.080191 Apr 05 12:14:02.622194 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1636/3298] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:02 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:02.639208 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cb9cd5e8-26c5-461c-8f1f-24de815e4cf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:02.639828 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cb9cd5e8-26c5-461c-8f1f-24de815e4cf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 64db0811-1092-48cb-b6aa-9018da662bfc] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:02.645665 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cb9cd5e8-26c5-461c-8f1f-24de815e4cf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:02.646107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cb9cd5e8-26c5-461c-8f1f-24de815e4cf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:02.646898 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cb9cd5e8-26c5-461c-8f1f-24de815e4cf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:02.647326 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cb9cd5e8-26c5-461c-8f1f-24de815e4cf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:02.808165 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cb9cd5e8-26c5-461c-8f1f-24de815e4cf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:02.820721 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cb9cd5e8-26c5-461c-8f1f-24de815e4cf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:02.823053 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cb9cd5e8-26c5-461c-8f1f-24de815e4cf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:02.824785 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cb9cd5e8-26c5-461c-8f1f-24de815e4cf3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc" status: 200 len: 1408 microversion: 2.20 time: 0.189085 Apr 05 12:14:02.825641 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1663/3299] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:14:02 2022] GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc => generated 1408 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:14:03.225662 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e8bbb322-571e-4230-b9c0-71db0dcad380 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:03.226298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e8bbb322-571e-4230-b9c0-71db0dcad380 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:03.233017 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e8bbb322-571e-4230-b9c0-71db0dcad380 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:03.233486 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e8bbb322-571e-4230-b9c0-71db0dcad380 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:03.234278 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e8bbb322-571e-4230-b9c0-71db0dcad380 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:03.234723 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e8bbb322-571e-4230-b9c0-71db0dcad380 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:03.374567 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e8bbb322-571e-4230-b9c0-71db0dcad380 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:03.382961 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e8bbb322-571e-4230-b9c0-71db0dcad380 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.162779 Apr 05 12:14:03.383535 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1637/3300] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:03 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:03.521285 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4298adc4-370f-4818-932c-bce2d790691c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:03.521878 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4298adc4-370f-4818-932c-bce2d790691c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:03.528645 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4298adc4-370f-4818-932c-bce2d790691c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:03.529088 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4298adc4-370f-4818-932c-bce2d790691c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:03.529848 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4298adc4-370f-4818-932c-bce2d790691c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:03.530278 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4298adc4-370f-4818-932c-bce2d790691c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:03.638908 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0cf977fc-400e-4fb7-b701-012f7dcf0ce0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:03.639525 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0cf977fc-400e-4fb7-b701-012f7dcf0ce0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:03.646457 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0cf977fc-400e-4fb7-b701-012f7dcf0ce0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:03.646911 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0cf977fc-400e-4fb7-b701-012f7dcf0ce0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:03.647675 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0cf977fc-400e-4fb7-b701-012f7dcf0ce0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:03.648107 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0cf977fc-400e-4fb7-b701-012f7dcf0ce0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:03.664001 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4298adc4-370f-4818-932c-bce2d790691c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:03.672096 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4298adc4-370f-4818-932c-bce2d790691c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.156706 Apr 05 12:14:03.673006 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1664/3301] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:03 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:03.708537 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0cf977fc-400e-4fb7-b701-012f7dcf0ce0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:03.716512 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0cf977fc-400e-4fb7-b701-012f7dcf0ce0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.081518 Apr 05 12:14:03.717100 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1638/3302] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:03 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:03.845245 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-102707ba-60c7-4178-ae63-ffd16f9c349f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:03.845766 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-102707ba-60c7-4178-ae63-ffd16f9c349f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 64db0811-1092-48cb-b6aa-9018da662bfc] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:03.851891 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-102707ba-60c7-4178-ae63-ffd16f9c349f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:03.852366 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-102707ba-60c7-4178-ae63-ffd16f9c349f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:03.853146 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-102707ba-60c7-4178-ae63-ffd16f9c349f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:03.853567 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-102707ba-60c7-4178-ae63-ffd16f9c349f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:03.997952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-102707ba-60c7-4178-ae63-ffd16f9c349f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:04.006576 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-102707ba-60c7-4178-ae63-ffd16f9c349f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:04.008057 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-102707ba-60c7-4178-ae63-ffd16f9c349f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:04.009173 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-102707ba-60c7-4178-ae63-ffd16f9c349f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc" status: 200 len: 1408 microversion: 2.20 time: 0.167948 Apr 05 12:14:04.009712 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1665/3303] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:14:03 2022] GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:14:04.404466 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e48ced9b-d9c8-422c-8d4d-9fe407162002 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:04.405340 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e48ced9b-d9c8-422c-8d4d-9fe407162002 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:04.415404 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e48ced9b-d9c8-422c-8d4d-9fe407162002 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:04.416151 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e48ced9b-d9c8-422c-8d4d-9fe407162002 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:04.417430 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e48ced9b-d9c8-422c-8d4d-9fe407162002 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:04.418140 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e48ced9b-d9c8-422c-8d4d-9fe407162002 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:04.554044 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e48ced9b-d9c8-422c-8d4d-9fe407162002 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:04.562317 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e48ced9b-d9c8-422c-8d4d-9fe407162002 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.164526 Apr 05 12:14:04.563031 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1639/3304] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:04 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:04.693164 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f9d09db3-3130-41c3-873c-0e8faa9474e1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:04.693745 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f9d09db3-3130-41c3-873c-0e8faa9474e1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:04.700368 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9d09db3-3130-41c3-873c-0e8faa9474e1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:04.700788 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9d09db3-3130-41c3-873c-0e8faa9474e1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:04.701563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9d09db3-3130-41c3-873c-0e8faa9474e1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:04.701987 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f9d09db3-3130-41c3-873c-0e8faa9474e1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:04.734001 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4124fb01-055c-4b92-a551-b8e43a6ffa6b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:04.734611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4124fb01-055c-4b92-a551-b8e43a6ffa6b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:04.741179 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4124fb01-055c-4b92-a551-b8e43a6ffa6b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:04.741759 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4124fb01-055c-4b92-a551-b8e43a6ffa6b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:04.742490 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4124fb01-055c-4b92-a551-b8e43a6ffa6b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:04.743001 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4124fb01-055c-4b92-a551-b8e43a6ffa6b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:04.802662 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4124fb01-055c-4b92-a551-b8e43a6ffa6b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:04.811103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4124fb01-055c-4b92-a551-b8e43a6ffa6b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.081349 Apr 05 12:14:04.811879 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1640/3305] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:04 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:04.888003 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f9d09db3-3130-41c3-873c-0e8faa9474e1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:04.896101 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f9d09db3-3130-41c3-873c-0e8faa9474e1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.208917 Apr 05 12:14:04.896669 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1666/3306] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:04 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:05.030451 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3905d49b-f9af-434f-89d2-a44e607e1e5e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:05.031087 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3905d49b-f9af-434f-89d2-a44e607e1e5e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 64db0811-1092-48cb-b6aa-9018da662bfc] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:05.038240 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3905d49b-f9af-434f-89d2-a44e607e1e5e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:05.038936 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3905d49b-f9af-434f-89d2-a44e607e1e5e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:05.040227 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3905d49b-f9af-434f-89d2-a44e607e1e5e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:05.040675 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3905d49b-f9af-434f-89d2-a44e607e1e5e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:05.179822 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3905d49b-f9af-434f-89d2-a44e607e1e5e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:05.187762 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3905d49b-f9af-434f-89d2-a44e607e1e5e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:05.189271 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3905d49b-f9af-434f-89d2-a44e607e1e5e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:05.190355 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3905d49b-f9af-434f-89d2-a44e607e1e5e tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc" status: 200 len: 1408 microversion: 2.20 time: 0.166380 Apr 05 12:14:05.198546 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1641/3307] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:14:05 2022] GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:14:05.583733 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-787432d9-52d5-4ef9-a3f4-4965ec895a8c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:05.584768 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-787432d9-52d5-4ef9-a3f4-4965ec895a8c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:05.594784 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-787432d9-52d5-4ef9-a3f4-4965ec895a8c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:05.595521 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-787432d9-52d5-4ef9-a3f4-4965ec895a8c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:05.596817 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-787432d9-52d5-4ef9-a3f4-4965ec895a8c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:05.597517 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-787432d9-52d5-4ef9-a3f4-4965ec895a8c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:05.751389 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-787432d9-52d5-4ef9-a3f4-4965ec895a8c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:05.760623 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-787432d9-52d5-4ef9-a3f4-4965ec895a8c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.183256 Apr 05 12:14:05.761211 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1667/3308] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:05 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:05.828729 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b61b8152-cc78-43af-8c29-235bdfff2ff0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:05.829402 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b61b8152-cc78-43af-8c29-235bdfff2ff0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:05.836577 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b61b8152-cc78-43af-8c29-235bdfff2ff0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:05.837021 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b61b8152-cc78-43af-8c29-235bdfff2ff0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:05.837770 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b61b8152-cc78-43af-8c29-235bdfff2ff0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:05.838199 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b61b8152-cc78-43af-8c29-235bdfff2ff0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:05.907604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b61b8152-cc78-43af-8c29-235bdfff2ff0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:05.913363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-116e16d5-7289-4df1-9dba-094749139cb5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:05.913968 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-116e16d5-7289-4df1-9dba-094749139cb5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:05.916106 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b61b8152-cc78-43af-8c29-235bdfff2ff0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.091810 Apr 05 12:14:05.916696 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1642/3309] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:05 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:05.919979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-116e16d5-7289-4df1-9dba-094749139cb5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:05.920456 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-116e16d5-7289-4df1-9dba-094749139cb5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:05.921200 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-116e16d5-7289-4df1-9dba-094749139cb5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:05.921625 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-116e16d5-7289-4df1-9dba-094749139cb5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:06.056644 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-116e16d5-7289-4df1-9dba-094749139cb5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:06.064916 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-116e16d5-7289-4df1-9dba-094749139cb5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.155062 Apr 05 12:14:06.065504 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1668/3310] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:05 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:14:06.214742 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-199a9a30-24b8-44cb-aef0-652ee67a9586 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:06.215358 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-199a9a30-24b8-44cb-aef0-652ee67a9586 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 64db0811-1092-48cb-b6aa-9018da662bfc] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:06.217313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-d1815458-f899-42ca-b1bd-0c422e50a3c3 req-c6f763ee-9f03-491d-a4e1-c15065690040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64db0811-1092-48cb-b6aa-9018da662bfc", "name": "network-vif-plugged", "status": "completed", "tag": "311b46f0-2b31-4866-8942-835f4de933e0"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:06.221229 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-199a9a30-24b8-44cb-aef0-652ee67a9586 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:06.221698 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-199a9a30-24b8-44cb-aef0-652ee67a9586 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:06.222448 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-199a9a30-24b8-44cb-aef0-652ee67a9586 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:06.222885 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-199a9a30-24b8-44cb-aef0-652ee67a9586 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:06.225329 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-d1815458-f899-42ca-b1bd-0c422e50a3c3 req-c6f763ee-9f03-491d-a4e1-c15065690040 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:06.225768 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-d1815458-f899-42ca-b1bd-0c422e50a3c3 req-c6f763ee-9f03-491d-a4e1-c15065690040 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:06.236795 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-d1815458-f899-42ca-b1bd-0c422e50a3c3 req-c6f763ee-9f03-491d-a4e1-c15065690040 service nova] Creating event network-vif-plugged:311b46f0-2b31-4866-8942-835f4de933e0 for instance 64db0811-1092-48cb-b6aa-9018da662bfc on hv-cinder-82956 Apr 05 12:14:06.242192 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-d1815458-f899-42ca-b1bd-0c422e50a3c3 req-c6f763ee-9f03-491d-a4e1-c15065690040 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104073 Apr 05 12:14:06.242928 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1643/3311] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:14:06.355562 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-199a9a30-24b8-44cb-aef0-652ee67a9586 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:06.364246 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-199a9a30-24b8-44cb-aef0-652ee67a9586 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:06.365730 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-199a9a30-24b8-44cb-aef0-652ee67a9586 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:06.366827 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-199a9a30-24b8-44cb-aef0-652ee67a9586 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc" status: 200 len: 1408 microversion: 2.20 time: 0.162625 Apr 05 12:14:06.367392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1669/3312] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:14:06 2022] GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:14:06.778379 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5d44106d-0134-4468-8beb-648ab7fde9f0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:06.778999 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5d44106d-0134-4468-8beb-648ab7fde9f0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:06.785672 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d44106d-0134-4468-8beb-648ab7fde9f0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:06.786209 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d44106d-0134-4468-8beb-648ab7fde9f0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:06.786974 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d44106d-0134-4468-8beb-648ab7fde9f0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:06.787410 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d44106d-0134-4468-8beb-648ab7fde9f0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:06.919849 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5d44106d-0134-4468-8beb-648ab7fde9f0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:06.928203 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5d44106d-0134-4468-8beb-648ab7fde9f0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.154114 Apr 05 12:14:06.928746 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1644/3313] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:06 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:06.933302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8de3cf45-f9ea-48ec-91c5-bc55c2317569 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:06.933908 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8de3cf45-f9ea-48ec-91c5-bc55c2317569 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:06.940410 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8de3cf45-f9ea-48ec-91c5-bc55c2317569 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:06.940854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8de3cf45-f9ea-48ec-91c5-bc55c2317569 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:06.941600 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8de3cf45-f9ea-48ec-91c5-bc55c2317569 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:06.942024 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8de3cf45-f9ea-48ec-91c5-bc55c2317569 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:07.000588 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8de3cf45-f9ea-48ec-91c5-bc55c2317569 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:07.008996 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8de3cf45-f9ea-48ec-91c5-bc55c2317569 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.079483 Apr 05 12:14:07.009576 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1670/3314] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:06 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:14:07.085829 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4eddc7f9-ce32-4597-b310-090b5a2ac248 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:07.086757 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4eddc7f9-ce32-4597-b310-090b5a2ac248 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:07.096820 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4eddc7f9-ce32-4597-b310-090b5a2ac248 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:07.097565 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4eddc7f9-ce32-4597-b310-090b5a2ac248 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:07.098911 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4eddc7f9-ce32-4597-b310-090b5a2ac248 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:07.099332 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4eddc7f9-ce32-4597-b310-090b5a2ac248 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:07.241426 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4eddc7f9-ce32-4597-b310-090b5a2ac248 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:07.250261 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4eddc7f9-ce32-4597-b310-090b5a2ac248 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.171052 Apr 05 12:14:07.250834 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1645/3315] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:07 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:07.389133 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0d3bf9d6-9808-4f89-a3f4-4bd76587941f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:07.389999 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0d3bf9d6-9808-4f89-a3f4-4bd76587941f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 64db0811-1092-48cb-b6aa-9018da662bfc] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:07.398421 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0d3bf9d6-9808-4f89-a3f4-4bd76587941f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:07.398865 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0d3bf9d6-9808-4f89-a3f4-4bd76587941f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:07.399609 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0d3bf9d6-9808-4f89-a3f4-4bd76587941f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:07.400036 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0d3bf9d6-9808-4f89-a3f4-4bd76587941f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:07.538098 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0d3bf9d6-9808-4f89-a3f4-4bd76587941f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:07.546193 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0d3bf9d6-9808-4f89-a3f4-4bd76587941f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:07.547722 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0d3bf9d6-9808-4f89-a3f4-4bd76587941f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:07.548865 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0d3bf9d6-9808-4f89-a3f4-4bd76587941f tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc" status: 200 len: 1408 microversion: 2.20 time: 0.166333 Apr 05 12:14:07.549438 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1671/3316] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:14:07 2022] GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:14:07.948886 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d8e4f8c8-6619-491d-9425-eefe0b7aefc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:07.950018 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d8e4f8c8-6619-491d-9425-eefe0b7aefc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:07.959651 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d8e4f8c8-6619-491d-9425-eefe0b7aefc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:07.960063 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d8e4f8c8-6619-491d-9425-eefe0b7aefc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:07.960877 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d8e4f8c8-6619-491d-9425-eefe0b7aefc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:07.961304 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d8e4f8c8-6619-491d-9425-eefe0b7aefc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:08.026090 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b61930e0-fff4-436f-84c1-8dcc34bf86bd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:08.026866 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b61930e0-fff4-436f-84c1-8dcc34bf86bd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:08.034353 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b61930e0-fff4-436f-84c1-8dcc34bf86bd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:08.035071 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b61930e0-fff4-436f-84c1-8dcc34bf86bd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:08.036066 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b61930e0-fff4-436f-84c1-8dcc34bf86bd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:08.036543 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b61930e0-fff4-436f-84c1-8dcc34bf86bd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:08.099026 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b61930e0-fff4-436f-84c1-8dcc34bf86bd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:08.102969 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d8e4f8c8-6619-491d-9425-eefe0b7aefc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:08.107424 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b61930e0-fff4-436f-84c1-8dcc34bf86bd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.085329 Apr 05 12:14:08.108301 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1672/3317] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:08 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:14:08.110776 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d8e4f8c8-6619-491d-9425-eefe0b7aefc4 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.168275 Apr 05 12:14:08.111331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1646/3318] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:07 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:08.272113 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ede2fbab-473e-4e51-86e0-50dfb94cbaf3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:08.273129 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ede2fbab-473e-4e51-86e0-50dfb94cbaf3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:08.283283 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ede2fbab-473e-4e51-86e0-50dfb94cbaf3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:08.284038 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ede2fbab-473e-4e51-86e0-50dfb94cbaf3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:08.285349 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ede2fbab-473e-4e51-86e0-50dfb94cbaf3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:08.286075 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ede2fbab-473e-4e51-86e0-50dfb94cbaf3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:08.423321 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ede2fbab-473e-4e51-86e0-50dfb94cbaf3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:08.431170 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ede2fbab-473e-4e51-86e0-50dfb94cbaf3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.165653 Apr 05 12:14:08.431747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1673/3319] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:08 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:08.568159 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-41cdbdb3-19be-405d-9b81-3dc32c962e85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:08.568706 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-41cdbdb3-19be-405d-9b81-3dc32c962e85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 64db0811-1092-48cb-b6aa-9018da662bfc] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:08.578067 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-41cdbdb3-19be-405d-9b81-3dc32c962e85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:08.578788 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-41cdbdb3-19be-405d-9b81-3dc32c962e85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:08.580028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-41cdbdb3-19be-405d-9b81-3dc32c962e85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:08.580830 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-41cdbdb3-19be-405d-9b81-3dc32c962e85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:08.726828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-41cdbdb3-19be-405d-9b81-3dc32c962e85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:08.735376 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-41cdbdb3-19be-405d-9b81-3dc32c962e85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:08.736906 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-41cdbdb3-19be-405d-9b81-3dc32c962e85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:08.738048 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-41cdbdb3-19be-405d-9b81-3dc32c962e85 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc" status: 200 len: 1599 microversion: 2.20 time: 0.174113 Apr 05 12:14:08.738613 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1647/3320] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:14:08 2022] GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc => generated 1599 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:14:08.755951 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-46218b10-5adf-4daa-877d-ba3319f7b4e4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:08.756463 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-46218b10-5adf-4daa-877d-ba3319f7b4e4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 64db0811-1092-48cb-b6aa-9018da662bfc] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:08.762729 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-46218b10-5adf-4daa-877d-ba3319f7b4e4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:08.763174 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-46218b10-5adf-4daa-877d-ba3319f7b4e4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:08.763917 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-46218b10-5adf-4daa-877d-ba3319f7b4e4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:08.764377 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-46218b10-5adf-4daa-877d-ba3319f7b4e4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:08.853025 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-46218b10-5adf-4daa-877d-ba3319f7b4e4 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.099637 Apr 05 12:14:08.853635 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1674/3321] 10.222.0.61 () {60 vars in 1315 bytes} [Tue Apr 5 12:14:08 2022] GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:14:09.124597 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4bf5c72b-3bb8-42bb-8204-3baf3f6b2e9b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:09.125166 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4bf5c72b-3bb8-42bb-8204-3baf3f6b2e9b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:09.129597 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ea19bd1a-96fc-4c7a-bb21-99569bd897b6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:09.130304 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ea19bd1a-96fc-4c7a-bb21-99569bd897b6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:09.132091 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4bf5c72b-3bb8-42bb-8204-3baf3f6b2e9b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:09.132560 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4bf5c72b-3bb8-42bb-8204-3baf3f6b2e9b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:09.133330 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4bf5c72b-3bb8-42bb-8204-3baf3f6b2e9b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:09.133765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4bf5c72b-3bb8-42bb-8204-3baf3f6b2e9b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:09.136209 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea19bd1a-96fc-4c7a-bb21-99569bd897b6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:09.136667 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea19bd1a-96fc-4c7a-bb21-99569bd897b6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:09.137434 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea19bd1a-96fc-4c7a-bb21-99569bd897b6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:09.137862 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea19bd1a-96fc-4c7a-bb21-99569bd897b6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:09.202412 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4bf5c72b-3bb8-42bb-8204-3baf3f6b2e9b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:09.210831 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4bf5c72b-3bb8-42bb-8204-3baf3f6b2e9b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.089852 Apr 05 12:14:09.211420 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1648/3322] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:09 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:09.410851 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ea19bd1a-96fc-4c7a-bb21-99569bd897b6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:09.419075 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ea19bd1a-96fc-4c7a-bb21-99569bd897b6 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.295058 Apr 05 12:14:09.419773 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1675/3323] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:09 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:09.449331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-da7cefa8-ebb5-4ca0-9d4e-c4f375e803bd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:09.449953 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-da7cefa8-ebb5-4ca0-9d4e-c4f375e803bd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:09.455870 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-da7cefa8-ebb5-4ca0-9d4e-c4f375e803bd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:09.456365 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-da7cefa8-ebb5-4ca0-9d4e-c4f375e803bd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:09.457128 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-da7cefa8-ebb5-4ca0-9d4e-c4f375e803bd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:09.457563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-da7cefa8-ebb5-4ca0-9d4e-c4f375e803bd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:09.600877 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-da7cefa8-ebb5-4ca0-9d4e-c4f375e803bd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:09.608975 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-da7cefa8-ebb5-4ca0-9d4e-c4f375e803bd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.163709 Apr 05 12:14:09.609552 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1649/3324] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:09 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:09.909150 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-1f0499f8-2a65-4690-abd3-d758c13b4918 req-115f507b-461e-4f98-9742-66402404156d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64db0811-1092-48cb-b6aa-9018da662bfc", "tag": "311b46f0-2b31-4866-8942-835f4de933e0"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:09.917343 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-1f0499f8-2a65-4690-abd3-d758c13b4918 req-115f507b-461e-4f98-9742-66402404156d service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:09.917777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-1f0499f8-2a65-4690-abd3-d758c13b4918 req-115f507b-461e-4f98-9742-66402404156d service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:09.928867 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-1f0499f8-2a65-4690-abd3-d758c13b4918 req-115f507b-461e-4f98-9742-66402404156d service nova] Creating event network-changed:311b46f0-2b31-4866-8942-835f4de933e0 for instance 64db0811-1092-48cb-b6aa-9018da662bfc on hv-cinder-82956 Apr 05 12:14:09.935792 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-1f0499f8-2a65-4690-abd3-d758c13b4918 req-115f507b-461e-4f98-9742-66402404156d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030199 Apr 05 12:14:09.936550 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1676/3325] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:14:10.226830 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7ecf3327-bdb5-408a-8308-993b428908f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:10.228131 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7ecf3327-bdb5-408a-8308-993b428908f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:10.234305 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7ecf3327-bdb5-408a-8308-993b428908f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:10.234750 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7ecf3327-bdb5-408a-8308-993b428908f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:10.235576 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7ecf3327-bdb5-408a-8308-993b428908f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:10.236120 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7ecf3327-bdb5-408a-8308-993b428908f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:10.301727 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7ecf3327-bdb5-408a-8308-993b428908f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:10.309547 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7ecf3327-bdb5-408a-8308-993b428908f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.086533 Apr 05 12:14:10.310363 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1650/3326] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:10 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:10.438088 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0a31f667-fdf9-4d11-b185-e75942fa898b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:10.439636 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0a31f667-fdf9-4d11-b185-e75942fa898b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:10.446613 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0a31f667-fdf9-4d11-b185-e75942fa898b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:10.447188 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0a31f667-fdf9-4d11-b185-e75942fa898b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:10.447782 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0a31f667-fdf9-4d11-b185-e75942fa898b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:10.448509 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0a31f667-fdf9-4d11-b185-e75942fa898b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:10.595359 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0a31f667-fdf9-4d11-b185-e75942fa898b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:10.603815 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0a31f667-fdf9-4d11-b185-e75942fa898b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.170301 Apr 05 12:14:10.604414 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1677/3327] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:10 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:10.626244 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b7bde393-d1f2-4985-aa01-be66e742c058 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:10.626850 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b7bde393-d1f2-4985-aa01-be66e742c058 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:10.633197 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b7bde393-d1f2-4985-aa01-be66e742c058 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:10.633643 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b7bde393-d1f2-4985-aa01-be66e742c058 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:10.634395 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b7bde393-d1f2-4985-aa01-be66e742c058 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:10.634818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b7bde393-d1f2-4985-aa01-be66e742c058 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:10.764722 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b7bde393-d1f2-4985-aa01-be66e742c058 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:10.773098 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b7bde393-d1f2-4985-aa01-be66e742c058 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.150695 Apr 05 12:14:10.773684 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1651/3328] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:10 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:11.326707 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-94a92637-98d4-40c0-b4c5-a60326fec90e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:11.327312 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-94a92637-98d4-40c0-b4c5-a60326fec90e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:11.334106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94a92637-98d4-40c0-b4c5-a60326fec90e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:11.334553 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94a92637-98d4-40c0-b4c5-a60326fec90e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:11.335293 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94a92637-98d4-40c0-b4c5-a60326fec90e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:11.335726 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94a92637-98d4-40c0-b4c5-a60326fec90e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:11.400103 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-94a92637-98d4-40c0-b4c5-a60326fec90e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:11.408564 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-94a92637-98d4-40c0-b4c5-a60326fec90e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.085831 Apr 05 12:14:11.409133 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1678/3329] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:11 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:11.625158 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a107d7d7-acfd-4f26-a2c9-63b0d7705841 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:11.626206 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a107d7d7-acfd-4f26-a2c9-63b0d7705841 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:11.634504 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a107d7d7-acfd-4f26-a2c9-63b0d7705841 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:11.634953 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a107d7d7-acfd-4f26-a2c9-63b0d7705841 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:11.635723 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a107d7d7-acfd-4f26-a2c9-63b0d7705841 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:11.636187 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a107d7d7-acfd-4f26-a2c9-63b0d7705841 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:11.765920 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a107d7d7-acfd-4f26-a2c9-63b0d7705841 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:11.774456 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a107d7d7-acfd-4f26-a2c9-63b0d7705841 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.155770 Apr 05 12:14:11.775038 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1652/3330] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:11 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:11.792559 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-50547e7d-7250-4231-8030-cf3c4dc0b867 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:11.793222 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-50547e7d-7250-4231-8030-cf3c4dc0b867 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:11.801892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-50547e7d-7250-4231-8030-cf3c4dc0b867 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:11.802336 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-50547e7d-7250-4231-8030-cf3c4dc0b867 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:11.803082 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-50547e7d-7250-4231-8030-cf3c4dc0b867 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:11.803509 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-50547e7d-7250-4231-8030-cf3c4dc0b867 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:11.938248 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-50547e7d-7250-4231-8030-cf3c4dc0b867 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:11.946342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-50547e7d-7250-4231-8030-cf3c4dc0b867 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.160137 Apr 05 12:14:11.946921 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1679/3331] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:11 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:12.429151 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-42b607ff-f346-40bc-a184-5b29c5678699 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:12.429704 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-42b607ff-f346-40bc-a184-5b29c5678699 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:12.436359 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-42b607ff-f346-40bc-a184-5b29c5678699 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:12.436823 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-42b607ff-f346-40bc-a184-5b29c5678699 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:12.437616 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-42b607ff-f346-40bc-a184-5b29c5678699 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:12.438065 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-42b607ff-f346-40bc-a184-5b29c5678699 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:12.501489 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-42b607ff-f346-40bc-a184-5b29c5678699 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:12.509897 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-42b607ff-f346-40bc-a184-5b29c5678699 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.086261 Apr 05 12:14:12.510465 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1653/3332] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:12 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:12.795762 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cc0fc754-d94f-4466-981e-0fd90cb2cb01 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:12.796814 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cc0fc754-d94f-4466-981e-0fd90cb2cb01 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:12.807479 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cc0fc754-d94f-4466-981e-0fd90cb2cb01 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:12.808284 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cc0fc754-d94f-4466-981e-0fd90cb2cb01 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:12.809520 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cc0fc754-d94f-4466-981e-0fd90cb2cb01 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:12.810230 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cc0fc754-d94f-4466-981e-0fd90cb2cb01 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:12.944895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cc0fc754-d94f-4466-981e-0fd90cb2cb01 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:12.952774 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cc0fc754-d94f-4466-981e-0fd90cb2cb01 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.163399 Apr 05 12:14:12.953346 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1680/3333] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:12 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:12.962839 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-81907c0f-c66e-4cc4-bb30-34ca74ef5ea6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:12.963451 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-81907c0f-c66e-4cc4-bb30-34ca74ef5ea6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:12.970236 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-81907c0f-c66e-4cc4-bb30-34ca74ef5ea6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:12.970680 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-81907c0f-c66e-4cc4-bb30-34ca74ef5ea6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:12.971461 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-81907c0f-c66e-4cc4-bb30-34ca74ef5ea6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:12.971887 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-81907c0f-c66e-4cc4-bb30-34ca74ef5ea6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:13.108305 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-81907c0f-c66e-4cc4-bb30-34ca74ef5ea6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:13.120134 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-81907c0f-c66e-4cc4-bb30-34ca74ef5ea6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.160905 Apr 05 12:14:13.120973 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1654/3334] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:12 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:13.526465 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ab9f19d9-74e1-45d9-93d3-620d2a69110f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:13.527070 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ab9f19d9-74e1-45d9-93d3-620d2a69110f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:13.533882 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ab9f19d9-74e1-45d9-93d3-620d2a69110f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:13.534321 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ab9f19d9-74e1-45d9-93d3-620d2a69110f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:13.535074 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ab9f19d9-74e1-45d9-93d3-620d2a69110f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:13.535500 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ab9f19d9-74e1-45d9-93d3-620d2a69110f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:13.598950 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ab9f19d9-74e1-45d9-93d3-620d2a69110f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:13.607320 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ab9f19d9-74e1-45d9-93d3-620d2a69110f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.084927 Apr 05 12:14:13.607901 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1681/3335] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:13 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:13.971212 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7f5de81d-ddd6-47a1-8377-e5607450e06f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:13.971823 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7f5de81d-ddd6-47a1-8377-e5607450e06f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:13.978477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f5de81d-ddd6-47a1-8377-e5607450e06f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:13.978923 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f5de81d-ddd6-47a1-8377-e5607450e06f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:13.979674 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f5de81d-ddd6-47a1-8377-e5607450e06f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:13.980117 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7f5de81d-ddd6-47a1-8377-e5607450e06f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:14.111839 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7f5de81d-ddd6-47a1-8377-e5607450e06f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:14.119747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7f5de81d-ddd6-47a1-8377-e5607450e06f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.152457 Apr 05 12:14:14.120314 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1655/3336] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:13 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:14.143891 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bd91882b-361d-414f-a6e4-fdfe469b9758 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:14.144663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bd91882b-361d-414f-a6e4-fdfe469b9758 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:14.151363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bd91882b-361d-414f-a6e4-fdfe469b9758 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:14.151823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bd91882b-361d-414f-a6e4-fdfe469b9758 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:14.152613 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bd91882b-361d-414f-a6e4-fdfe469b9758 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:14.153050 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bd91882b-361d-414f-a6e4-fdfe469b9758 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:14.539781 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bd91882b-361d-414f-a6e4-fdfe469b9758 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:14.547612 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bd91882b-361d-414f-a6e4-fdfe469b9758 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.409963 Apr 05 12:14:14.548185 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1682/3337] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:14 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:14.628747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-95e05721-a3fb-4ae9-b7d1-5372eecda852 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:14.629947 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-95e05721-a3fb-4ae9-b7d1-5372eecda852 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:14.636411 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-95e05721-a3fb-4ae9-b7d1-5372eecda852 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:14.636854 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-95e05721-a3fb-4ae9-b7d1-5372eecda852 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:14.637608 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-95e05721-a3fb-4ae9-b7d1-5372eecda852 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:14.638034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-95e05721-a3fb-4ae9-b7d1-5372eecda852 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:14.701005 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-95e05721-a3fb-4ae9-b7d1-5372eecda852 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:14.709200 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-95e05721-a3fb-4ae9-b7d1-5372eecda852 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.087299 Apr 05 12:14:14.709766 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1656/3338] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:14 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:15.137112 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d5ef37d2-95d5-45b0-b57a-9df45fab8040 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:15.137706 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d5ef37d2-95d5-45b0-b57a-9df45fab8040 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:15.143938 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d5ef37d2-95d5-45b0-b57a-9df45fab8040 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:15.144628 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d5ef37d2-95d5-45b0-b57a-9df45fab8040 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:15.145259 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d5ef37d2-95d5-45b0-b57a-9df45fab8040 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:15.145688 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d5ef37d2-95d5-45b0-b57a-9df45fab8040 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:15.280867 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d5ef37d2-95d5-45b0-b57a-9df45fab8040 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:15.289080 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d5ef37d2-95d5-45b0-b57a-9df45fab8040 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.155911 Apr 05 12:14:15.289650 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1683/3339] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:15 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:15.569521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9b55cf92-daf4-4e39-b49c-41dd23b8cce3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:15.570347 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9b55cf92-daf4-4e39-b49c-41dd23b8cce3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:15.581054 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9b55cf92-daf4-4e39-b49c-41dd23b8cce3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:15.581796 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9b55cf92-daf4-4e39-b49c-41dd23b8cce3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:15.583114 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9b55cf92-daf4-4e39-b49c-41dd23b8cce3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:15.583545 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9b55cf92-daf4-4e39-b49c-41dd23b8cce3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:15.718513 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9b55cf92-daf4-4e39-b49c-41dd23b8cce3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:15.727964 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9b55cf92-daf4-4e39-b49c-41dd23b8cce3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.165266 Apr 05 12:14:15.728388 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8bad0568-71a0-4f91-ba19-dc881e85f823 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:15.728862 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1657/3340] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:15 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:15.729020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8bad0568-71a0-4f91-ba19-dc881e85f823 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:15.735196 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8bad0568-71a0-4f91-ba19-dc881e85f823 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:15.735638 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8bad0568-71a0-4f91-ba19-dc881e85f823 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:15.736411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8bad0568-71a0-4f91-ba19-dc881e85f823 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:15.736846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8bad0568-71a0-4f91-ba19-dc881e85f823 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:15.798617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8bad0568-71a0-4f91-ba19-dc881e85f823 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:15.807100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8bad0568-71a0-4f91-ba19-dc881e85f823 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.082534 Apr 05 12:14:15.807683 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1684/3341] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:15 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:14:16.309927 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-754daa5e-79ff-4ccf-ab9a-8f329e3ecd41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:16.310912 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-754daa5e-79ff-4ccf-ab9a-8f329e3ecd41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:16.321423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-754daa5e-79ff-4ccf-ab9a-8f329e3ecd41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:16.322162 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-754daa5e-79ff-4ccf-ab9a-8f329e3ecd41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:16.323398 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-754daa5e-79ff-4ccf-ab9a-8f329e3ecd41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:16.324119 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-754daa5e-79ff-4ccf-ab9a-8f329e3ecd41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:16.465470 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-754daa5e-79ff-4ccf-ab9a-8f329e3ecd41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:16.473308 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-754daa5e-79ff-4ccf-ab9a-8f329e3ecd41 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.170110 Apr 05 12:14:16.473883 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1658/3342] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:16 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:16.749574 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3a29e800-a11d-4412-bb75-50448cf84f4d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:16.750559 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3a29e800-a11d-4412-bb75-50448cf84f4d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:16.759418 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a29e800-a11d-4412-bb75-50448cf84f4d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:16.759865 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a29e800-a11d-4412-bb75-50448cf84f4d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:16.760642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a29e800-a11d-4412-bb75-50448cf84f4d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:16.761074 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3a29e800-a11d-4412-bb75-50448cf84f4d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:16.823607 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e611fdc7-15e3-4bcf-8a69-3874b778b492 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:16.824250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e611fdc7-15e3-4bcf-8a69-3874b778b492 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:16.830669 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e611fdc7-15e3-4bcf-8a69-3874b778b492 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:16.831109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e611fdc7-15e3-4bcf-8a69-3874b778b492 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:16.831859 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e611fdc7-15e3-4bcf-8a69-3874b778b492 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:16.832323 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e611fdc7-15e3-4bcf-8a69-3874b778b492 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:16.894593 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e611fdc7-15e3-4bcf-8a69-3874b778b492 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:16.896090 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3a29e800-a11d-4412-bb75-50448cf84f4d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:16.902563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e611fdc7-15e3-4bcf-8a69-3874b778b492 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.082774 Apr 05 12:14:16.903146 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1659/3343] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:16 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:14:16.905758 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3a29e800-a11d-4412-bb75-50448cf84f4d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.162716 Apr 05 12:14:16.906304 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1685/3344] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:16 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:17.491864 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d3969240-98b5-483d-acc9-38b02aec5538 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:17.492673 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d3969240-98b5-483d-acc9-38b02aec5538 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:17.500231 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d3969240-98b5-483d-acc9-38b02aec5538 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:17.500772 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d3969240-98b5-483d-acc9-38b02aec5538 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:17.501663 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d3969240-98b5-483d-acc9-38b02aec5538 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:17.502549 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d3969240-98b5-483d-acc9-38b02aec5538 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:17.643165 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d3969240-98b5-483d-acc9-38b02aec5538 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:17.651445 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d3969240-98b5-483d-acc9-38b02aec5538 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.164234 Apr 05 12:14:17.652021 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1660/3345] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:17 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:17.923295 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4cfc0dcb-8f25-4a78-8a8a-229406be0fbb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:17.924251 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4cfc0dcb-8f25-4a78-8a8a-229406be0fbb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:17.926657 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cbc883d4-02bd-441c-9a85-412cd289a54d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:17.927726 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cbc883d4-02bd-441c-9a85-412cd289a54d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:17.932232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cfc0dcb-8f25-4a78-8a8a-229406be0fbb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:17.932686 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cfc0dcb-8f25-4a78-8a8a-229406be0fbb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:17.933447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cfc0dcb-8f25-4a78-8a8a-229406be0fbb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:17.933881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cfc0dcb-8f25-4a78-8a8a-229406be0fbb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:17.934122 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cbc883d4-02bd-441c-9a85-412cd289a54d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:17.934570 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cbc883d4-02bd-441c-9a85-412cd289a54d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:17.935332 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cbc883d4-02bd-441c-9a85-412cd289a54d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:17.935791 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cbc883d4-02bd-441c-9a85-412cd289a54d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:17.994055 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4cfc0dcb-8f25-4a78-8a8a-229406be0fbb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:18.002032 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4cfc0dcb-8f25-4a78-8a8a-229406be0fbb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.085626 Apr 05 12:14:18.002994 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1686/3346] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:17 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:18.068183 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-cbc883d4-02bd-441c-9a85-412cd289a54d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:18.076164 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cbc883d4-02bd-441c-9a85-412cd289a54d tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.155776 Apr 05 12:14:18.076729 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1661/3347] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:17 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:18.673465 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-566d6ec8-5545-4dc7-a540-6040d40b0934 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:18.674538 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-566d6ec8-5545-4dc7-a540-6040d40b0934 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:18.682123 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-566d6ec8-5545-4dc7-a540-6040d40b0934 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:18.682564 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-566d6ec8-5545-4dc7-a540-6040d40b0934 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:18.683323 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-566d6ec8-5545-4dc7-a540-6040d40b0934 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:18.683754 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-566d6ec8-5545-4dc7-a540-6040d40b0934 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:18.822533 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-566d6ec8-5545-4dc7-a540-6040d40b0934 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:18.830526 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-566d6ec8-5545-4dc7-a540-6040d40b0934 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.163807 Apr 05 12:14:18.831096 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1687/3348] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:18 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:19.022456 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-85b32da5-06f9-4966-8af3-afb80449c58d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:19.023327 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-85b32da5-06f9-4966-8af3-afb80449c58d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:19.033793 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85b32da5-06f9-4966-8af3-afb80449c58d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:19.034522 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85b32da5-06f9-4966-8af3-afb80449c58d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:19.035760 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85b32da5-06f9-4966-8af3-afb80449c58d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:19.036518 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85b32da5-06f9-4966-8af3-afb80449c58d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:19.093896 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9d29ca56-e62d-4522-86f5-85bb9b73fa25 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:19.094521 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9d29ca56-e62d-4522-86f5-85bb9b73fa25 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:19.101505 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-85b32da5-06f9-4966-8af3-afb80449c58d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:19.101875 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9d29ca56-e62d-4522-86f5-85bb9b73fa25 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:19.102457 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9d29ca56-e62d-4522-86f5-85bb9b73fa25 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:19.103243 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9d29ca56-e62d-4522-86f5-85bb9b73fa25 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:19.103683 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9d29ca56-e62d-4522-86f5-85bb9b73fa25 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:19.109409 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-85b32da5-06f9-4966-8af3-afb80449c58d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.093541 Apr 05 12:14:19.109981 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1662/3349] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:19 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:19.241510 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9d29ca56-e62d-4522-86f5-85bb9b73fa25 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:19.249679 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9d29ca56-e62d-4522-86f5-85bb9b73fa25 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.159762 Apr 05 12:14:19.250296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1688/3350] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:19 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:19.852018 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2af74257-41bc-4275-bb34-ffdf4d03fa36 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:19.852898 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2af74257-41bc-4275-bb34-ffdf4d03fa36 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:19.861157 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2af74257-41bc-4275-bb34-ffdf4d03fa36 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:19.861720 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2af74257-41bc-4275-bb34-ffdf4d03fa36 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:19.862905 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2af74257-41bc-4275-bb34-ffdf4d03fa36 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:19.863459 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2af74257-41bc-4275-bb34-ffdf4d03fa36 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:19.996099 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2af74257-41bc-4275-bb34-ffdf4d03fa36 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:20.005060 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2af74257-41bc-4275-bb34-ffdf4d03fa36 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.159311 Apr 05 12:14:20.005657 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1663/3351] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:19 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:20.131131 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-28c91d30-58a1-44d3-96d8-e218bfae56c6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:20.132030 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-28c91d30-58a1-44d3-96d8-e218bfae56c6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:20.142649 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-28c91d30-58a1-44d3-96d8-e218bfae56c6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:20.143398 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-28c91d30-58a1-44d3-96d8-e218bfae56c6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:20.144729 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-28c91d30-58a1-44d3-96d8-e218bfae56c6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:20.145406 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-28c91d30-58a1-44d3-96d8-e218bfae56c6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:20.206512 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-28c91d30-58a1-44d3-96d8-e218bfae56c6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:20.215296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-28c91d30-58a1-44d3-96d8-e218bfae56c6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.091192 Apr 05 12:14:20.215866 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1689/3352] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:20 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:20.272313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6e9009fb-3f79-4f9b-b7ae-67468470bf1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:20.273579 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6e9009fb-3f79-4f9b-b7ae-67468470bf1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:20.284409 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6e9009fb-3f79-4f9b-b7ae-67468470bf1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:20.285157 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6e9009fb-3f79-4f9b-b7ae-67468470bf1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:20.286394 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6e9009fb-3f79-4f9b-b7ae-67468470bf1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:20.287109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6e9009fb-3f79-4f9b-b7ae-67468470bf1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:20.422013 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6e9009fb-3f79-4f9b-b7ae-67468470bf1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:20.430023 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6e9009fb-3f79-4f9b-b7ae-67468470bf1e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.164671 Apr 05 12:14:20.430610 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1664/3353] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:20 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:21.022713 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a4c330b1-3d94-470e-81aa-41a73e6f945b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:21.023375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a4c330b1-3d94-470e-81aa-41a73e6f945b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:21.029806 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a4c330b1-3d94-470e-81aa-41a73e6f945b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:21.030243 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a4c330b1-3d94-470e-81aa-41a73e6f945b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:21.031029 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a4c330b1-3d94-470e-81aa-41a73e6f945b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:21.031466 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a4c330b1-3d94-470e-81aa-41a73e6f945b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:21.176172 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a4c330b1-3d94-470e-81aa-41a73e6f945b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:21.188805 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a4c330b1-3d94-470e-81aa-41a73e6f945b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.169739 Apr 05 12:14:21.189602 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1690/3354] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:21 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:21.232391 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-031f0024-5878-4605-a884-f2a6de3bb809 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:21.233040 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-031f0024-5878-4605-a884-f2a6de3bb809 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:21.239429 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-031f0024-5878-4605-a884-f2a6de3bb809 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:21.240235 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-031f0024-5878-4605-a884-f2a6de3bb809 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:21.241036 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-031f0024-5878-4605-a884-f2a6de3bb809 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:21.241473 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-031f0024-5878-4605-a884-f2a6de3bb809 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:21.304560 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-031f0024-5878-4605-a884-f2a6de3bb809 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:21.312841 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-031f0024-5878-4605-a884-f2a6de3bb809 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.084477 Apr 05 12:14:21.313431 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1665/3355] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:21 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:21.453704 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-88821da3-d1f4-41c5-8fc9-9be756192f7b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:21.454977 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-88821da3-d1f4-41c5-8fc9-9be756192f7b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:21.464505 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-88821da3-d1f4-41c5-8fc9-9be756192f7b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:21.465077 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-88821da3-d1f4-41c5-8fc9-9be756192f7b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:21.466003 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-88821da3-d1f4-41c5-8fc9-9be756192f7b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:21.466547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-88821da3-d1f4-41c5-8fc9-9be756192f7b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:21.602479 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-88821da3-d1f4-41c5-8fc9-9be756192f7b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:21.610649 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-88821da3-d1f4-41c5-8fc9-9be756192f7b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.165384 Apr 05 12:14:21.611246 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1691/3356] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:21 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:22.211324 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a32f5da0-5b92-4694-83e4-d4b96ddb673e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:22.212140 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a32f5da0-5b92-4694-83e4-d4b96ddb673e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:22.220511 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a32f5da0-5b92-4694-83e4-d4b96ddb673e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:22.221107 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a32f5da0-5b92-4694-83e4-d4b96ddb673e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:22.222161 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a32f5da0-5b92-4694-83e4-d4b96ddb673e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:22.222742 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a32f5da0-5b92-4694-83e4-d4b96ddb673e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:22.329516 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cb868fe5-37c9-411b-8b8c-fcba7d75b049 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:22.330098 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cb868fe5-37c9-411b-8b8c-fcba7d75b049 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:22.336656 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cb868fe5-37c9-411b-8b8c-fcba7d75b049 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:22.337105 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cb868fe5-37c9-411b-8b8c-fcba7d75b049 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:22.337864 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cb868fe5-37c9-411b-8b8c-fcba7d75b049 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:22.338296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cb868fe5-37c9-411b-8b8c-fcba7d75b049 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:22.362818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a32f5da0-5b92-4694-83e4-d4b96ddb673e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:22.371120 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a32f5da0-5b92-4694-83e4-d4b96ddb673e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.165949 Apr 05 12:14:22.371672 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1666/3357] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:22 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:22.397125 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cb868fe5-37c9-411b-8b8c-fcba7d75b049 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:22.404969 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cb868fe5-37c9-411b-8b8c-fcba7d75b049 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.079347 Apr 05 12:14:22.405532 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1692/3358] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:22 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:22.631456 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-db81c6f6-2d14-4a67-b3b3-7a2028d458f0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:22.632599 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-db81c6f6-2d14-4a67-b3b3-7a2028d458f0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:22.639873 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-db81c6f6-2d14-4a67-b3b3-7a2028d458f0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:22.640437 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-db81c6f6-2d14-4a67-b3b3-7a2028d458f0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:22.641328 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-db81c6f6-2d14-4a67-b3b3-7a2028d458f0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:22.641828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-db81c6f6-2d14-4a67-b3b3-7a2028d458f0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:22.783126 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-db81c6f6-2d14-4a67-b3b3-7a2028d458f0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:22.791584 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-db81c6f6-2d14-4a67-b3b3-7a2028d458f0 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.166768 Apr 05 12:14:22.792151 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1667/3359] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:22 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:23.396433 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-dbfe574c-6546-4dd7-830a-8fe31ab345dc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:23.397955 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-dbfe574c-6546-4dd7-830a-8fe31ab345dc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:23.413553 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dbfe574c-6546-4dd7-830a-8fe31ab345dc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:23.414424 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dbfe574c-6546-4dd7-830a-8fe31ab345dc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:23.415700 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dbfe574c-6546-4dd7-830a-8fe31ab345dc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:23.416495 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dbfe574c-6546-4dd7-830a-8fe31ab345dc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:23.424882 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cc9d5950-6c0c-4178-bd5b-37cf232e5451 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:23.425857 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cc9d5950-6c0c-4178-bd5b-37cf232e5451 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:23.436415 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cc9d5950-6c0c-4178-bd5b-37cf232e5451 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:23.437218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cc9d5950-6c0c-4178-bd5b-37cf232e5451 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:23.438500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cc9d5950-6c0c-4178-bd5b-37cf232e5451 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:23.439195 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cc9d5950-6c0c-4178-bd5b-37cf232e5451 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:23.506599 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-cc9d5950-6c0c-4178-bd5b-37cf232e5451 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:23.514827 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cc9d5950-6c0c-4178-bd5b-37cf232e5451 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.096123 Apr 05 12:14:23.515408 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1668/3360] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:23 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:14:23.567681 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-dbfe574c-6546-4dd7-830a-8fe31ab345dc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:23.576118 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-dbfe574c-6546-4dd7-830a-8fe31ab345dc tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.189938 Apr 05 12:14:23.576664 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1693/3361] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:23 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:23.808721 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8b6904fb-7108-47dd-973b-55636e1f16a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:23.809292 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8b6904fb-7108-47dd-973b-55636e1f16a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:23.815816 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8b6904fb-7108-47dd-973b-55636e1f16a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:23.816322 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8b6904fb-7108-47dd-973b-55636e1f16a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:23.817086 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8b6904fb-7108-47dd-973b-55636e1f16a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:23.817522 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8b6904fb-7108-47dd-973b-55636e1f16a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:23.952481 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8b6904fb-7108-47dd-973b-55636e1f16a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:23.964689 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8b6904fb-7108-47dd-973b-55636e1f16a7 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.159658 Apr 05 12:14:23.965568 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1669/3362] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:23 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:24.532103 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-29fc32de-4ba0-4889-a4f9-1010d124df82 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:24.532733 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-29fc32de-4ba0-4889-a4f9-1010d124df82 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:24.539415 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-29fc32de-4ba0-4889-a4f9-1010d124df82 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:24.539861 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-29fc32de-4ba0-4889-a4f9-1010d124df82 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:24.540657 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-29fc32de-4ba0-4889-a4f9-1010d124df82 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:24.541087 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-29fc32de-4ba0-4889-a4f9-1010d124df82 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:24.594410 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c881fe06-7096-4aee-9c09-6bf25bb3a462 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:24.595087 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c881fe06-7096-4aee-9c09-6bf25bb3a462 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:24.601305 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c881fe06-7096-4aee-9c09-6bf25bb3a462 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:24.601749 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c881fe06-7096-4aee-9c09-6bf25bb3a462 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:24.602504 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c881fe06-7096-4aee-9c09-6bf25bb3a462 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:24.602931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c881fe06-7096-4aee-9c09-6bf25bb3a462 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:24.606632 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-29fc32de-4ba0-4889-a4f9-1010d124df82 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:24.614642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-29fc32de-4ba0-4889-a4f9-1010d124df82 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.086465 Apr 05 12:14:24.615216 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1694/3363] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:24 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:24.739268 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c881fe06-7096-4aee-9c09-6bf25bb3a462 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:24.747859 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c881fe06-7096-4aee-9c09-6bf25bb3a462 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.157861 Apr 05 12:14:24.748468 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1670/3364] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:24 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:24.989600 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a3c3c4d4-2cec-4f4e-bea3-796f79dd98ae tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:24.990592 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a3c3c4d4-2cec-4f4e-bea3-796f79dd98ae tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:25.000851 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a3c3c4d4-2cec-4f4e-bea3-796f79dd98ae tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:25.001593 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a3c3c4d4-2cec-4f4e-bea3-796f79dd98ae tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:25.003262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a3c3c4d4-2cec-4f4e-bea3-796f79dd98ae tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:25.003968 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a3c3c4d4-2cec-4f4e-bea3-796f79dd98ae tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:25.147561 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a3c3c4d4-2cec-4f4e-bea3-796f79dd98ae tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:25.155748 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a3c3c4d4-2cec-4f4e-bea3-796f79dd98ae tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1724 microversion: 2.1 time: 0.172664 Apr 05 12:14:25.156373 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1695/3365] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:24 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:25.173329 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d0774401-2830-41d4-9253-85c5dd10b149 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '.version_select at 0x7f161c29eb80>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:25.193333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d0774401-2830-41d4-9253-85c5dd10b149 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-420995151" status: 202 len: 0 microversion: 2.1 time: 0.023853 Apr 05 12:14:25.193897 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1671/3366] 10.222.0.61 () {58 vars in 1217 bytes} [Tue Apr 5 12:14:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-420995151 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:25.632438 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1e39746e-1bb0-4d7a-b4c6-9c6ac84e743c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:25.633089 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1e39746e-1bb0-4d7a-b4c6-9c6ac84e743c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:25.640121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1e39746e-1bb0-4d7a-b4c6-9c6ac84e743c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:25.640580 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1e39746e-1bb0-4d7a-b4c6-9c6ac84e743c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:25.641678 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1e39746e-1bb0-4d7a-b4c6-9c6ac84e743c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:25.641778 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1e39746e-1bb0-4d7a-b4c6-9c6ac84e743c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:25.735395 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1e39746e-1bb0-4d7a-b4c6-9c6ac84e743c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:25.743910 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1e39746e-1bb0-4d7a-b4c6-9c6ac84e743c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.115356 Apr 05 12:14:25.744475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1696/3367] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:25 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:25.768751 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9ef42415-6df2-4e10-89cc-2ecb828576ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:25.769458 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9ef42415-6df2-4e10-89cc-2ecb828576ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:25.775722 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9ef42415-6df2-4e10-89cc-2ecb828576ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:25.776202 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9ef42415-6df2-4e10-89cc-2ecb828576ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:25.776957 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9ef42415-6df2-4e10-89cc-2ecb828576ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:25.777404 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9ef42415-6df2-4e10-89cc-2ecb828576ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:25.915286 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9ef42415-6df2-4e10-89cc-2ecb828576ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:25.923518 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9ef42415-6df2-4e10-89cc-2ecb828576ef tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.158692 Apr 05 12:14:25.924389 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1672/3368] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:25 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:26.127649 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-8318bf44-1312-4806-a269-cf6943b4dadc req-e8ce76b9-0abb-4ab2-af82-b2b49bb9178e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8d507e3-5f14-419a-a3cd-31f36496b2d8", "tag": "54ad08dc-d08d-49a7-a3d3-ff818ba84298"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:26.134084 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-8318bf44-1312-4806-a269-cf6943b4dadc req-e8ce76b9-0abb-4ab2-af82-b2b49bb9178e service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:26.134615 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-8318bf44-1312-4806-a269-cf6943b4dadc req-e8ce76b9-0abb-4ab2-af82-b2b49bb9178e service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:26.150231 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-8318bf44-1312-4806-a269-cf6943b4dadc req-e8ce76b9-0abb-4ab2-af82-b2b49bb9178e service nova] Creating event network-changed:54ad08dc-d08d-49a7-a3d3-ff818ba84298 for instance f8d507e3-5f14-419a-a3cd-31f36496b2d8 on hv-cinder-82956 Apr 05 12:14:26.155868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-8318bf44-1312-4806-a269-cf6943b4dadc req-e8ce76b9-0abb-4ab2-af82-b2b49bb9178e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034928 Apr 05 12:14:26.156583 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1697/3369] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:14:26.342218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7b386290-6b59-487f-a78b-095a76915a85 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Action: 'create', calling method: .version_select at 0x7f161c2570d0>, body: {"keypair": {"name": "tempest-keypair-1025132166"}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:26.360687 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-7b386290-6b59-487f-a78b-095a76915a85 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Getting quotas for project 0f6e126c0851462ca2607a90c7581616. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 12:14:26.369085 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-7b386290-6b59-487f-a78b-095a76915a85 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Getting quotas for user e5ae307df96e45ec9ac6d4b383c84abb and project 0f6e126c0851462ca2607a90c7581616. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 12:14:26.582518 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-7b386290-6b59-487f-a78b-095a76915a85 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Getting quotas for project 0f6e126c0851462ca2607a90c7581616. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 12:14:26.587270 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-7b386290-6b59-487f-a78b-095a76915a85 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Getting quotas for user e5ae307df96e45ec9ac6d4b383c84abb and project 0f6e126c0851462ca2607a90c7581616. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 12:14:26.600546 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7b386290-6b59-487f-a78b-095a76915a85 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.262225 Apr 05 12:14:26.601161 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1673/3370] 10.222.0.61 () {60 vars in 1157 bytes} [Tue Apr 5 12:14:26 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:26.770496 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bb38c30b-562b-4d25-a3fe-2dc29505b3b9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:26.771252 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bb38c30b-562b-4d25-a3fe-2dc29505b3b9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:26.778404 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bb38c30b-562b-4d25-a3fe-2dc29505b3b9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:26.778848 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bb38c30b-562b-4d25-a3fe-2dc29505b3b9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:26.780014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bb38c30b-562b-4d25-a3fe-2dc29505b3b9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:26.780951 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bb38c30b-562b-4d25-a3fe-2dc29505b3b9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:26.860985 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bb38c30b-562b-4d25-a3fe-2dc29505b3b9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:26.873173 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bb38c30b-562b-4d25-a3fe-2dc29505b3b9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.108474 Apr 05 12:14:26.876138 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1698/3371] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:26 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:14:26.941450 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b95cf8f8-8386-4bb5-924d-d3c1c9901828 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:26.942062 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b95cf8f8-8386-4bb5-924d-d3c1c9901828 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:26.952576 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b95cf8f8-8386-4bb5-924d-d3c1c9901828 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:26.953169 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b95cf8f8-8386-4bb5-924d-d3c1c9901828 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:26.953872 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b95cf8f8-8386-4bb5-924d-d3c1c9901828 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:26.954530 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b95cf8f8-8386-4bb5-924d-d3c1c9901828 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:27.108863 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b95cf8f8-8386-4bb5-924d-d3c1c9901828 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:27.117671 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b95cf8f8-8386-4bb5-924d-d3c1c9901828 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.180127 Apr 05 12:14:27.118702 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1674/3372] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:26 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:27.891132 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-35916ea4-9063-4e30-bb63-bedc04e6cafd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:27.891742 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-35916ea4-9063-4e30-bb63-bedc04e6cafd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:27.899101 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-35916ea4-9063-4e30-bb63-bedc04e6cafd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:27.899817 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-35916ea4-9063-4e30-bb63-bedc04e6cafd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:27.900808 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-35916ea4-9063-4e30-bb63-bedc04e6cafd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:27.901241 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-35916ea4-9063-4e30-bb63-bedc04e6cafd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:27.972765 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-35916ea4-9063-4e30-bb63-bedc04e6cafd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:27.981245 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-35916ea4-9063-4e30-bb63-bedc04e6cafd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.094024 Apr 05 12:14:27.981957 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1699/3373] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:27 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:28.069246 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2c966f8b-9ae4-4b7c-9dd2-6292ea530a77 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2036997813", "imageRef": "2b657785-cb0b-43ba-956c-1564c27fd10a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "655b7336-f06e-410c-ae4e-8aa6ab359991"}], "security_groups": [{"name": "tempest-securitygroup--558661986"}], "key_name": "tempest-keypair-1025132166", "user_data": "}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:28.135533 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-95fc6073-463e-4ef3-9ebc-a3c4628f5098 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:28.136187 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-95fc6073-463e-4ef3-9ebc-a3c4628f5098 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:28.142145 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95fc6073-463e-4ef3-9ebc-a3c4628f5098 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:28.142597 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95fc6073-463e-4ef3-9ebc-a3c4628f5098 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:28.143356 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95fc6073-463e-4ef3-9ebc-a3c4628f5098 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:28.143785 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95fc6073-463e-4ef3-9ebc-a3c4628f5098 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:28.170734 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.network.neutron [None req-2c966f8b-9ae4-4b7c-9dd2-6292ea530a77 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] validate_networks() for [('655b7336-f06e-410c-ae4e-8aa6ab359991', None, None, None, None, None)] {{(pid=123357) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 12:14:28.280263 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-95fc6073-463e-4ef3-9ebc-a3c4628f5098 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:28.288401 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-95fc6073-463e-4ef3-9ebc-a3c4628f5098 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.156679 Apr 05 12:14:28.289271 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1700/3374] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:28 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:14:28.541833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-2c966f8b-9ae4-4b7c-9dd2-6292ea530a77 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Flavor limits 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 12:14:28.542247 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-2c966f8b-9ae4-4b7c-9dd2-6292ea530a77 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Image limits 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:14:28.542713 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-2c966f8b-9ae4-4b7c-9dd2-6292ea530a77 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Flavor pref 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 12:14:28.543123 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-2c966f8b-9ae4-4b7c-9dd2-6292ea530a77 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Image pref 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:14:28.543522 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-2c966f8b-9ae4-4b7c-9dd2-6292ea530a77 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 12:14:28.552755 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2c966f8b-9ae4-4b7c-9dd2-6292ea530a77 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:28.553199 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2c966f8b-9ae4-4b7c-9dd2-6292ea530a77 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:28.553990 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2c966f8b-9ae4-4b7c-9dd2-6292ea530a77 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:28.554420 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2c966f8b-9ae4-4b7c-9dd2-6292ea530a77 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:28.571437 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-2c966f8b-9ae4-4b7c-9dd2-6292ea530a77 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Getting quotas for project 0f6e126c0851462ca2607a90c7581616. Resources: {'ram', 'instances', 'cores'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 12:14:28.575883 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-2c966f8b-9ae4-4b7c-9dd2-6292ea530a77 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Getting quotas for user e5ae307df96e45ec9ac6d4b383c84abb and project 0f6e126c0851462ca2607a90c7581616. Resources: {'ram', 'instances', 'cores'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 12:14:28.588034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2c966f8b-9ae4-4b7c-9dd2-6292ea530a77 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Going to run 1 instances... {{(pid=123357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 12:14:28.590323 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2c966f8b-9ae4-4b7c-9dd2-6292ea530a77 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e045d626-74de-4955-85df-c15ce8e5f33d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b657785-cb0b-43ba-956c-1564c27fd10a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 12:14:28.637166 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2c966f8b-9ae4-4b7c-9dd2-6292ea530a77 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.572328 Apr 05 12:14:28.637816 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1675/3375] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Apr 5 12:14:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 12:14:28.648132 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4ef8c375-5286-41a0-ba10-48aa0d2ed7a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:28.648742 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4ef8c375-5286-41a0-ba10-48aa0d2ed7a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e045d626-74de-4955-85df-c15ce8e5f33d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:28.702312 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4ef8c375-5286-41a0-ba10-48aa0d2ed7a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:28.709043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4ef8c375-5286-41a0-ba10-48aa0d2ed7a3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d" status: 200 len: 1242 microversion: 2.1 time: 0.064811 Apr 05 12:14:28.709661 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1701/3376] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:28 2022] GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:28.999751 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-be0884ff-7e79-4b1f-871a-08057cb47384 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:29.000314 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-be0884ff-7e79-4b1f-871a-08057cb47384 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:29.007277 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-be0884ff-7e79-4b1f-871a-08057cb47384 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:29.007737 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-be0884ff-7e79-4b1f-871a-08057cb47384 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:29.008548 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-be0884ff-7e79-4b1f-871a-08057cb47384 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:29.008993 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-be0884ff-7e79-4b1f-871a-08057cb47384 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:29.072124 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-be0884ff-7e79-4b1f-871a-08057cb47384 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:29.081326 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-be0884ff-7e79-4b1f-871a-08057cb47384 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.086515 Apr 05 12:14:29.081911 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1676/3377] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:28 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:29.306066 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-354b825a-b757-4c10-962d-2c73bcddc59e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:29.306694 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-354b825a-b757-4c10-962d-2c73bcddc59e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:29.313393 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-354b825a-b757-4c10-962d-2c73bcddc59e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:29.313844 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-354b825a-b757-4c10-962d-2c73bcddc59e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:29.314602 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-354b825a-b757-4c10-962d-2c73bcddc59e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:29.315039 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-354b825a-b757-4c10-962d-2c73bcddc59e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:29.454968 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-354b825a-b757-4c10-962d-2c73bcddc59e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:29.463153 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-354b825a-b757-4c10-962d-2c73bcddc59e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.161029 Apr 05 12:14:29.463730 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1702/3378] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:29 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:29.726520 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-dff86b1e-a0df-45bf-82fc-9e1c7e36c258 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:29.727685 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-dff86b1e-a0df-45bf-82fc-9e1c7e36c258 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e045d626-74de-4955-85df-c15ce8e5f33d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:29.733769 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dff86b1e-a0df-45bf-82fc-9e1c7e36c258 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:29.734216 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dff86b1e-a0df-45bf-82fc-9e1c7e36c258 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:29.735012 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dff86b1e-a0df-45bf-82fc-9e1c7e36c258 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:29.735443 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dff86b1e-a0df-45bf-82fc-9e1c7e36c258 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:29.795523 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-dff86b1e-a0df-45bf-82fc-9e1c7e36c258 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:29.802732 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-dff86b1e-a0df-45bf-82fc-9e1c7e36c258 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d" status: 200 len: 1300 microversion: 2.1 time: 0.080331 Apr 05 12:14:29.803300 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1677/3379] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:29 2022] GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d => generated 1300 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:30.098403 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-472dd36d-ceee-4f10-bead-ccc442c160ef tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:30.099010 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-472dd36d-ceee-4f10-bead-ccc442c160ef tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:30.105068 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-472dd36d-ceee-4f10-bead-ccc442c160ef tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:30.105504 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-472dd36d-ceee-4f10-bead-ccc442c160ef tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:30.106255 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-472dd36d-ceee-4f10-bead-ccc442c160ef tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:30.106679 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-472dd36d-ceee-4f10-bead-ccc442c160ef tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:30.195305 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-472dd36d-ceee-4f10-bead-ccc442c160ef tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:30.203769 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-472dd36d-ceee-4f10-bead-ccc442c160ef tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.109262 Apr 05 12:14:30.204491 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1703/3380] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:30 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:30.480949 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a1898e53-d117-4834-af48-1505ffa1905f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:30.481598 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a1898e53-d117-4834-af48-1505ffa1905f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:30.487615 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a1898e53-d117-4834-af48-1505ffa1905f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:30.488033 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a1898e53-d117-4834-af48-1505ffa1905f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:30.488816 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a1898e53-d117-4834-af48-1505ffa1905f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:30.489240 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a1898e53-d117-4834-af48-1505ffa1905f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:30.628386 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a1898e53-d117-4834-af48-1505ffa1905f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:30.636256 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a1898e53-d117-4834-af48-1505ffa1905f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.159498 Apr 05 12:14:30.636828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1678/3381] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:30 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:30.820818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fcd824a6-e34d-4115-aad4-6f3cda64471e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:30.822113 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fcd824a6-e34d-4115-aad4-6f3cda64471e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e045d626-74de-4955-85df-c15ce8e5f33d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:30.829821 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fcd824a6-e34d-4115-aad4-6f3cda64471e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:30.830397 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fcd824a6-e34d-4115-aad4-6f3cda64471e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:30.831312 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fcd824a6-e34d-4115-aad4-6f3cda64471e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:30.831841 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fcd824a6-e34d-4115-aad4-6f3cda64471e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:31.047779 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fcd824a6-e34d-4115-aad4-6f3cda64471e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:31.056120 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fcd824a6-e34d-4115-aad4-6f3cda64471e tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d" status: 200 len: 1367 microversion: 2.1 time: 0.239562 Apr 05 12:14:31.056632 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1704/3382] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:30 2022] GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:31.100187 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-da7f157f-e8f2-4c27-af26-c3ed789be97c req-b290b112-942f-4f00-a5e5-e1d2f3f1ffcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e045d626-74de-4955-85df-c15ce8e5f33d", "tag": "40af0dc8-4ea4-4c16-86c7-1bcf48b1c93a"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:31.111808 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-da7f157f-e8f2-4c27-af26-c3ed789be97c req-b290b112-942f-4f00-a5e5-e1d2f3f1ffcc service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:31.112481 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-da7f157f-e8f2-4c27-af26-c3ed789be97c req-b290b112-942f-4f00-a5e5-e1d2f3f1ffcc service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:31.128935 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-da7f157f-e8f2-4c27-af26-c3ed789be97c req-b290b112-942f-4f00-a5e5-e1d2f3f1ffcc service nova] Creating event network-changed:40af0dc8-4ea4-4c16-86c7-1bcf48b1c93a for instance e045d626-74de-4955-85df-c15ce8e5f33d on hv-cinder-82956 Apr 05 12:14:31.133887 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-da7f157f-e8f2-4c27-af26-c3ed789be97c req-b290b112-942f-4f00-a5e5-e1d2f3f1ffcc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037826 Apr 05 12:14:31.134530 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1679/3383] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:14:31.222193 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cfff225a-294f-43d0-927c-d5a679e034b6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:31.223084 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cfff225a-294f-43d0-927c-d5a679e034b6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:31.229916 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cfff225a-294f-43d0-927c-d5a679e034b6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:31.230363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cfff225a-294f-43d0-927c-d5a679e034b6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:31.231146 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cfff225a-294f-43d0-927c-d5a679e034b6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:31.231574 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cfff225a-294f-43d0-927c-d5a679e034b6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:31.300509 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cfff225a-294f-43d0-927c-d5a679e034b6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:31.309202 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cfff225a-294f-43d0-927c-d5a679e034b6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.091792 Apr 05 12:14:31.309971 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1705/3384] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:31 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:31.658897 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-05f72f27-567b-4939-84ad-845b190f05d2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:31.660098 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-05f72f27-567b-4939-84ad-845b190f05d2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:31.668195 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-05f72f27-567b-4939-84ad-845b190f05d2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:31.668641 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-05f72f27-567b-4939-84ad-845b190f05d2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:31.669398 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-05f72f27-567b-4939-84ad-845b190f05d2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:31.669823 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-05f72f27-567b-4939-84ad-845b190f05d2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:32.036510 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-05f72f27-567b-4939-84ad-845b190f05d2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:32.044723 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-05f72f27-567b-4939-84ad-845b190f05d2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.393678 Apr 05 12:14:32.045292 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1680/3385] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:31 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:32.073083 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0423e097-6ecf-47ac-aa52-57801423ec4b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:32.073693 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0423e097-6ecf-47ac-aa52-57801423ec4b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e045d626-74de-4955-85df-c15ce8e5f33d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:32.080338 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0423e097-6ecf-47ac-aa52-57801423ec4b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:32.080777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0423e097-6ecf-47ac-aa52-57801423ec4b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:32.081567 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0423e097-6ecf-47ac-aa52-57801423ec4b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:32.082017 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0423e097-6ecf-47ac-aa52-57801423ec4b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:32.217451 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0423e097-6ecf-47ac-aa52-57801423ec4b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:32.228193 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0423e097-6ecf-47ac-aa52-57801423ec4b tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d" status: 200 len: 1367 microversion: 2.1 time: 0.159072 Apr 05 12:14:32.228732 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1706/3386] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:32 2022] GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:32.330340 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f0edc79c-ff91-4993-9b7d-4be510396d44 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:32.331227 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f0edc79c-ff91-4993-9b7d-4be510396d44 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:32.341281 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f0edc79c-ff91-4993-9b7d-4be510396d44 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:32.342005 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f0edc79c-ff91-4993-9b7d-4be510396d44 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:32.343254 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f0edc79c-ff91-4993-9b7d-4be510396d44 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:32.343962 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f0edc79c-ff91-4993-9b7d-4be510396d44 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:32.406055 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f0edc79c-ff91-4993-9b7d-4be510396d44 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:32.413981 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f0edc79c-ff91-4993-9b7d-4be510396d44 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.090219 Apr 05 12:14:32.414618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1681/3387] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:32 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:33.061506 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-da93cc5e-6441-4372-9ad3-8ec3b7bb5a4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:33.062218 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-da93cc5e-6441-4372-9ad3-8ec3b7bb5a4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:33.068490 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-da93cc5e-6441-4372-9ad3-8ec3b7bb5a4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:33.069015 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-da93cc5e-6441-4372-9ad3-8ec3b7bb5a4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:33.069843 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-da93cc5e-6441-4372-9ad3-8ec3b7bb5a4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:33.070276 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-da93cc5e-6441-4372-9ad3-8ec3b7bb5a4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:33.245138 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8ae2e299-a704-4827-b769-b5bd27895b55 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:33.245724 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8ae2e299-a704-4827-b769-b5bd27895b55 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e045d626-74de-4955-85df-c15ce8e5f33d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:33.252898 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8ae2e299-a704-4827-b769-b5bd27895b55 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:33.253344 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8ae2e299-a704-4827-b769-b5bd27895b55 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:33.254116 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8ae2e299-a704-4827-b769-b5bd27895b55 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:33.254552 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8ae2e299-a704-4827-b769-b5bd27895b55 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:33.315600 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-da93cc5e-6441-4372-9ad3-8ec3b7bb5a4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:33.323988 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-da93cc5e-6441-4372-9ad3-8ec3b7bb5a4d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.266417 Apr 05 12:14:33.324684 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1707/3388] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:33 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:33.390267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8ae2e299-a704-4827-b769-b5bd27895b55 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:33.400672 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8ae2e299-a704-4827-b769-b5bd27895b55 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d" status: 200 len: 1367 microversion: 2.1 time: 0.159335 Apr 05 12:14:33.401245 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1682/3389] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:33 2022] GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:33.430919 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8601c9b2-24e5-4aed-9f5c-0269fa87e759 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:33.431517 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8601c9b2-24e5-4aed-9f5c-0269fa87e759 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:33.437985 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8601c9b2-24e5-4aed-9f5c-0269fa87e759 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:33.438429 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8601c9b2-24e5-4aed-9f5c-0269fa87e759 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:33.439181 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8601c9b2-24e5-4aed-9f5c-0269fa87e759 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:33.439608 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8601c9b2-24e5-4aed-9f5c-0269fa87e759 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:33.502324 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8601c9b2-24e5-4aed-9f5c-0269fa87e759 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:33.513554 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8601c9b2-24e5-4aed-9f5c-0269fa87e759 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.086302 Apr 05 12:14:33.514282 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1708/3390] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:33 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:34.341608 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3a8563db-1431-407c-b7f2-90486db41bc1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:34.342217 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3a8563db-1431-407c-b7f2-90486db41bc1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:34.348743 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3a8563db-1431-407c-b7f2-90486db41bc1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:34.349195 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3a8563db-1431-407c-b7f2-90486db41bc1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:34.349951 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3a8563db-1431-407c-b7f2-90486db41bc1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:34.350383 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3a8563db-1431-407c-b7f2-90486db41bc1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:34.417951 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c514cc92-a9bb-49bb-aeaa-b8dc77a823e2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:34.419268 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c514cc92-a9bb-49bb-aeaa-b8dc77a823e2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e045d626-74de-4955-85df-c15ce8e5f33d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:34.426182 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c514cc92-a9bb-49bb-aeaa-b8dc77a823e2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:34.426624 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c514cc92-a9bb-49bb-aeaa-b8dc77a823e2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:34.427384 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c514cc92-a9bb-49bb-aeaa-b8dc77a823e2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:34.427863 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c514cc92-a9bb-49bb-aeaa-b8dc77a823e2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:34.486309 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3a8563db-1431-407c-b7f2-90486db41bc1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:34.495931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3a8563db-1431-407c-b7f2-90486db41bc1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.158232 Apr 05 12:14:34.496583 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1683/3391] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:34 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:34.533713 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e9d52790-e7a7-41b8-8320-4bef64825d4f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:34.534320 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e9d52790-e7a7-41b8-8320-4bef64825d4f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:34.540348 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e9d52790-e7a7-41b8-8320-4bef64825d4f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:34.540801 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e9d52790-e7a7-41b8-8320-4bef64825d4f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:34.541561 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e9d52790-e7a7-41b8-8320-4bef64825d4f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:34.541993 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e9d52790-e7a7-41b8-8320-4bef64825d4f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:34.559065 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c514cc92-a9bb-49bb-aeaa-b8dc77a823e2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:34.566237 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c514cc92-a9bb-49bb-aeaa-b8dc77a823e2 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d" status: 200 len: 1367 microversion: 2.1 time: 0.152773 Apr 05 12:14:34.566790 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1709/3392] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:34 2022] GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:34.602436 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e9d52790-e7a7-41b8-8320-4bef64825d4f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:34.610224 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e9d52790-e7a7-41b8-8320-4bef64825d4f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.080329 Apr 05 12:14:34.610743 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1684/3393] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:34 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:35.517680 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-68e3417c-4ca2-46df-b31f-0df7a9c0ae00 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:35.518424 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-68e3417c-4ca2-46df-b31f-0df7a9c0ae00 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:35.526736 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-68e3417c-4ca2-46df-b31f-0df7a9c0ae00 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:35.527289 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-68e3417c-4ca2-46df-b31f-0df7a9c0ae00 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:35.528302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-68e3417c-4ca2-46df-b31f-0df7a9c0ae00 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:35.528836 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-68e3417c-4ca2-46df-b31f-0df7a9c0ae00 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:35.584488 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3219fbfd-7828-46e0-a0b2-9e595de904cc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:35.585106 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3219fbfd-7828-46e0-a0b2-9e595de904cc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e045d626-74de-4955-85df-c15ce8e5f33d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:35.591931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3219fbfd-7828-46e0-a0b2-9e595de904cc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:35.592421 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3219fbfd-7828-46e0-a0b2-9e595de904cc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:35.593194 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3219fbfd-7828-46e0-a0b2-9e595de904cc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:35.593630 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3219fbfd-7828-46e0-a0b2-9e595de904cc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:35.679393 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-68e3417c-4ca2-46df-b31f-0df7a9c0ae00 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:35.687847 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-68e3417c-4ca2-46df-b31f-0df7a9c0ae00 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.176515 Apr 05 12:14:35.688463 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1710/3394] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:35 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:35.693016 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-371befb6-e496-4b51-ac1e-26b0d56413ac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:35.693611 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-371befb6-e496-4b51-ac1e-26b0d56413ac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:35.700131 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-371befb6-e496-4b51-ac1e-26b0d56413ac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:35.700578 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-371befb6-e496-4b51-ac1e-26b0d56413ac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:35.701328 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-371befb6-e496-4b51-ac1e-26b0d56413ac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:35.701754 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-371befb6-e496-4b51-ac1e-26b0d56413ac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:35.731977 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3219fbfd-7828-46e0-a0b2-9e595de904cc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:35.739703 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3219fbfd-7828-46e0-a0b2-9e595de904cc tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d" status: 200 len: 1367 microversion: 2.1 time: 0.160138 Apr 05 12:14:35.740435 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1685/3395] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:35 2022] GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:35.760354 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-371befb6-e496-4b51-ac1e-26b0d56413ac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:35.768356 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-371befb6-e496-4b51-ac1e-26b0d56413ac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.078908 Apr 05 12:14:35.768924 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1711/3396] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:35 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:36.275301 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-07bc12fa-eda2-44dd-8d9d-758032c36b07 req-65adcf46-1687-480a-8259-93d32a68f2e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e045d626-74de-4955-85df-c15ce8e5f33d", "name": "network-vif-plugged", "status": "completed", "tag": "40af0dc8-4ea4-4c16-86c7-1bcf48b1c93a"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:36.284032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-07bc12fa-eda2-44dd-8d9d-758032c36b07 req-65adcf46-1687-480a-8259-93d32a68f2e7 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:36.284675 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-07bc12fa-eda2-44dd-8d9d-758032c36b07 req-65adcf46-1687-480a-8259-93d32a68f2e7 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:36.296308 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-07bc12fa-eda2-44dd-8d9d-758032c36b07 req-65adcf46-1687-480a-8259-93d32a68f2e7 service nova] Creating event network-vif-plugged:40af0dc8-4ea4-4c16-86c7-1bcf48b1c93a for instance e045d626-74de-4955-85df-c15ce8e5f33d on hv-cinder-82956 Apr 05 12:14:36.301421 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-07bc12fa-eda2-44dd-8d9d-758032c36b07 req-65adcf46-1687-480a-8259-93d32a68f2e7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030424 Apr 05 12:14:36.302062 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1686/3397] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:14:36.709997 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e9d0265e-f776-4d2a-be7c-b9beb9264bea tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:36.710977 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e9d0265e-f776-4d2a-be7c-b9beb9264bea tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:36.721618 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e9d0265e-f776-4d2a-be7c-b9beb9264bea tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:36.722353 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e9d0265e-f776-4d2a-be7c-b9beb9264bea tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:36.723599 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e9d0265e-f776-4d2a-be7c-b9beb9264bea tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:36.724368 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e9d0265e-f776-4d2a-be7c-b9beb9264bea tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:36.757673 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-95c8824b-3c76-4415-aab9-83ca9bfc18cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:36.758317 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-95c8824b-3c76-4415-aab9-83ca9bfc18cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e045d626-74de-4955-85df-c15ce8e5f33d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:36.764816 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-95c8824b-3c76-4415-aab9-83ca9bfc18cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:36.765292 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-95c8824b-3c76-4415-aab9-83ca9bfc18cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:36.766063 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-95c8824b-3c76-4415-aab9-83ca9bfc18cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:36.766500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-95c8824b-3c76-4415-aab9-83ca9bfc18cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:36.859078 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e9d0265e-f776-4d2a-be7c-b9beb9264bea tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:36.867346 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e9d0265e-f776-4d2a-be7c-b9beb9264bea tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.163895 Apr 05 12:14:36.868150 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1712/3398] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:36 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:36.878177 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1f3fdb35-cb5d-4bb6-9a1f-18a3976784e2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:36.878778 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1f3fdb35-cb5d-4bb6-9a1f-18a3976784e2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:36.884818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1f3fdb35-cb5d-4bb6-9a1f-18a3976784e2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:36.885234 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1f3fdb35-cb5d-4bb6-9a1f-18a3976784e2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:36.886005 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1f3fdb35-cb5d-4bb6-9a1f-18a3976784e2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:36.886432 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1f3fdb35-cb5d-4bb6-9a1f-18a3976784e2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:36.901173 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-95c8824b-3c76-4415-aab9-83ca9bfc18cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:36.909705 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-95c8824b-3c76-4415-aab9-83ca9bfc18cf tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d" status: 200 len: 1367 microversion: 2.1 time: 0.156724 Apr 05 12:14:36.910284 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1687/3399] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:36 2022] GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:36.955861 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1f3fdb35-cb5d-4bb6-9a1f-18a3976784e2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:36.964113 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1f3fdb35-cb5d-4bb6-9a1f-18a3976784e2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.089983 Apr 05 12:14:36.964693 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1713/3400] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:36 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:37.889115 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f37d2758-0422-4565-a404-9435b274e8fd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:37.890004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f37d2758-0422-4565-a404-9435b274e8fd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:37.900065 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f37d2758-0422-4565-a404-9435b274e8fd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:37.900546 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f37d2758-0422-4565-a404-9435b274e8fd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:37.901313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f37d2758-0422-4565-a404-9435b274e8fd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:37.901753 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f37d2758-0422-4565-a404-9435b274e8fd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:37.926549 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b8d9524a-b353-49c7-9fde-758230716ced tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:37.927391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b8d9524a-b353-49c7-9fde-758230716ced tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e045d626-74de-4955-85df-c15ce8e5f33d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:37.934493 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b8d9524a-b353-49c7-9fde-758230716ced tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:37.935013 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b8d9524a-b353-49c7-9fde-758230716ced tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:37.935827 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b8d9524a-b353-49c7-9fde-758230716ced tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:37.936377 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b8d9524a-b353-49c7-9fde-758230716ced tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:38.039583 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f37d2758-0422-4565-a404-9435b274e8fd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:38.047472 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f37d2758-0422-4565-a404-9435b274e8fd tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.164973 Apr 05 12:14:38.048051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1688/3401] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:37 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:38.061589 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4cc1cc82-f7f9-43ea-9c83-691838d5d380 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:38.062192 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4cc1cc82-f7f9-43ea-9c83-691838d5d380 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:38.067962 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4cc1cc82-f7f9-43ea-9c83-691838d5d380 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:38.068456 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4cc1cc82-f7f9-43ea-9c83-691838d5d380 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:38.069216 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4cc1cc82-f7f9-43ea-9c83-691838d5d380 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:38.069649 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4cc1cc82-f7f9-43ea-9c83-691838d5d380 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:38.073794 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b8d9524a-b353-49c7-9fde-758230716ced tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:38.081279 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b8d9524a-b353-49c7-9fde-758230716ced tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d" status: 200 len: 1367 microversion: 2.1 time: 0.158559 Apr 05 12:14:38.081855 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1714/3402] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:37 2022] GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:38.128571 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4cc1cc82-f7f9-43ea-9c83-691838d5d380 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:38.136593 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4cc1cc82-f7f9-43ea-9c83-691838d5d380 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.078495 Apr 05 12:14:38.137156 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1689/3403] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:38 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:39.069154 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cd37e35c-c3e0-4876-a109-b135d2581f34 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:39.070216 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cd37e35c-c3e0-4876-a109-b135d2581f34 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:39.080815 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cd37e35c-c3e0-4876-a109-b135d2581f34 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:39.081601 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cd37e35c-c3e0-4876-a109-b135d2581f34 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:39.082802 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cd37e35c-c3e0-4876-a109-b135d2581f34 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:39.083521 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cd37e35c-c3e0-4876-a109-b135d2581f34 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:39.098500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-77eac6ab-004f-493f-98d1-36e681b3f7f1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:39.099062 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-77eac6ab-004f-493f-98d1-36e681b3f7f1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e045d626-74de-4955-85df-c15ce8e5f33d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:39.105692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-77eac6ab-004f-493f-98d1-36e681b3f7f1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:39.106133 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-77eac6ab-004f-493f-98d1-36e681b3f7f1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:39.106883 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-77eac6ab-004f-493f-98d1-36e681b3f7f1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:39.107306 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-77eac6ab-004f-493f-98d1-36e681b3f7f1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:39.219630 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cd37e35c-c3e0-4876-a109-b135d2581f34 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:39.227489 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cd37e35c-c3e0-4876-a109-b135d2581f34 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.164877 Apr 05 12:14:39.228089 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1715/3404] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:39 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:39.232520 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5cf3902f-4485-4e69-9463-ffe33a82ae62 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:39.233191 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5cf3902f-4485-4e69-9463-ffe33a82ae62 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:39.238862 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5cf3902f-4485-4e69-9463-ffe33a82ae62 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:39.239374 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5cf3902f-4485-4e69-9463-ffe33a82ae62 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:39.240159 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5cf3902f-4485-4e69-9463-ffe33a82ae62 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:39.240336 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-77eac6ab-004f-493f-98d1-36e681b3f7f1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:39.240595 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5cf3902f-4485-4e69-9463-ffe33a82ae62 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:39.247775 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-77eac6ab-004f-493f-98d1-36e681b3f7f1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d" status: 200 len: 1556 microversion: 2.1 time: 0.153111 Apr 05 12:14:39.248392 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1690/3405] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:39 2022] GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:39.264116 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b8187399-982b-4e0d-af34-783f21afb271 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:39.264646 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b8187399-982b-4e0d-af34-783f21afb271 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e045d626-74de-4955-85df-c15ce8e5f33d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:39.270470 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b8187399-982b-4e0d-af34-783f21afb271 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:39.270915 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b8187399-982b-4e0d-af34-783f21afb271 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:39.271669 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b8187399-982b-4e0d-af34-783f21afb271 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:39.272139 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b8187399-982b-4e0d-af34-783f21afb271 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:39.301023 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5cf3902f-4485-4e69-9463-ffe33a82ae62 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:39.309324 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5cf3902f-4485-4e69-9463-ffe33a82ae62 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.080257 Apr 05 12:14:39.309903 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1716/3406] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:39 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:39.355566 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b8187399-982b-4e0d-af34-783f21afb271 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095095 Apr 05 12:14:39.356321 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1691/3407] 10.222.0.61 () {58 vars in 1274 bytes} [Tue Apr 5 12:14:39 2022] GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:14:40.245827 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7a241e89-e787-4fd7-aaf5-07e9ce8059f9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:40.246455 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7a241e89-e787-4fd7-aaf5-07e9ce8059f9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:40.253604 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a241e89-e787-4fd7-aaf5-07e9ce8059f9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:40.254035 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a241e89-e787-4fd7-aaf5-07e9ce8059f9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:40.254783 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a241e89-e787-4fd7-aaf5-07e9ce8059f9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:40.255207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a241e89-e787-4fd7-aaf5-07e9ce8059f9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:40.335919 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5086d769-37e8-45aa-8437-766ab83c0cfb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:40.335919 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5086d769-37e8-45aa-8437-766ab83c0cfb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:40.340241 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5086d769-37e8-45aa-8437-766ab83c0cfb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:40.340695 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5086d769-37e8-45aa-8437-766ab83c0cfb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:40.341475 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5086d769-37e8-45aa-8437-766ab83c0cfb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:40.341910 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5086d769-37e8-45aa-8437-766ab83c0cfb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:40.403769 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5086d769-37e8-45aa-8437-766ab83c0cfb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:40.411604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5086d769-37e8-45aa-8437-766ab83c0cfb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.089117 Apr 05 12:14:40.412224 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1692/3408] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:40 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:14:40.424254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7a241e89-e787-4fd7-aaf5-07e9ce8059f9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:40.432587 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7a241e89-e787-4fd7-aaf5-07e9ce8059f9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.190602 Apr 05 12:14:40.433538 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1717/3409] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:40 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:40.486234 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-c5f55820-0644-4c86-9211-58a14702b23c req-00edc9ba-8ec7-4493-809a-5b62ecfd2f01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e045d626-74de-4955-85df-c15ce8e5f33d", "tag": "40af0dc8-4ea4-4c16-86c7-1bcf48b1c93a"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:40.495950 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-c5f55820-0644-4c86-9211-58a14702b23c req-00edc9ba-8ec7-4493-809a-5b62ecfd2f01 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:40.496492 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-c5f55820-0644-4c86-9211-58a14702b23c req-00edc9ba-8ec7-4493-809a-5b62ecfd2f01 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:40.509062 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-c5f55820-0644-4c86-9211-58a14702b23c req-00edc9ba-8ec7-4493-809a-5b62ecfd2f01 service nova] Creating event network-changed:40af0dc8-4ea4-4c16-86c7-1bcf48b1c93a for instance e045d626-74de-4955-85df-c15ce8e5f33d on hv-cinder-82956 Apr 05 12:14:40.514291 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-c5f55820-0644-4c86-9211-58a14702b23c req-00edc9ba-8ec7-4493-809a-5b62ecfd2f01 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100914 Apr 05 12:14:40.514899 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1693/3410] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:14:41.429314 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4a0569e0-c062-4d23-9186-0ee30fc5068d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:41.429964 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4a0569e0-c062-4d23-9186-0ee30fc5068d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:41.436459 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a0569e0-c062-4d23-9186-0ee30fc5068d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:41.436906 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a0569e0-c062-4d23-9186-0ee30fc5068d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:41.437699 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a0569e0-c062-4d23-9186-0ee30fc5068d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:41.438140 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4a0569e0-c062-4d23-9186-0ee30fc5068d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:41.451012 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-aabd0786-9259-429e-b7a1-b0e803b92447 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:41.451862 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-aabd0786-9259-429e-b7a1-b0e803b92447 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:41.458465 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aabd0786-9259-429e-b7a1-b0e803b92447 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:41.458745 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aabd0786-9259-429e-b7a1-b0e803b92447 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:41.459639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aabd0786-9259-429e-b7a1-b0e803b92447 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:41.460195 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aabd0786-9259-429e-b7a1-b0e803b92447 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:41.501501 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4a0569e0-c062-4d23-9186-0ee30fc5068d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:41.509922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4a0569e0-c062-4d23-9186-0ee30fc5068d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.084788 Apr 05 12:14:41.510712 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1718/3411] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:41 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:41.596409 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-aabd0786-9259-429e-b7a1-b0e803b92447 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:41.605402 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-aabd0786-9259-429e-b7a1-b0e803b92447 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.158757 Apr 05 12:14:41.606280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1694/3412] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:41 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:42.527458 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a9a94003-3ca6-4991-ae6b-006d466e662a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:42.528060 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a9a94003-3ca6-4991-ae6b-006d466e662a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:42.534826 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a9a94003-3ca6-4991-ae6b-006d466e662a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:42.535263 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a9a94003-3ca6-4991-ae6b-006d466e662a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:42.536022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a9a94003-3ca6-4991-ae6b-006d466e662a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:42.536487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a9a94003-3ca6-4991-ae6b-006d466e662a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:42.599050 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a9a94003-3ca6-4991-ae6b-006d466e662a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:42.608394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a9a94003-3ca6-4991-ae6b-006d466e662a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.085159 Apr 05 12:14:42.608979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1719/3413] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:42 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:42.625718 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-385a10cd-70e7-451b-88e4-b6425306f997 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:42.627047 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-385a10cd-70e7-451b-88e4-b6425306f997 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:42.635903 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-385a10cd-70e7-451b-88e4-b6425306f997 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:42.636386 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-385a10cd-70e7-451b-88e4-b6425306f997 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:42.637146 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-385a10cd-70e7-451b-88e4-b6425306f997 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:42.637574 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-385a10cd-70e7-451b-88e4-b6425306f997 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:42.782649 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-385a10cd-70e7-451b-88e4-b6425306f997 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:42.790983 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-385a10cd-70e7-451b-88e4-b6425306f997 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.171722 Apr 05 12:14:42.791565 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1695/3414] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:42 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:43.629762 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7f67420a-c537-4255-95d5-41a7f5d847a3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:43.630808 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7f67420a-c537-4255-95d5-41a7f5d847a3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:43.641396 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7f67420a-c537-4255-95d5-41a7f5d847a3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:43.642279 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7f67420a-c537-4255-95d5-41a7f5d847a3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:43.643505 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7f67420a-c537-4255-95d5-41a7f5d847a3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:43.644263 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7f67420a-c537-4255-95d5-41a7f5d847a3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:43.710735 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7f67420a-c537-4255-95d5-41a7f5d847a3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:43.719629 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7f67420a-c537-4255-95d5-41a7f5d847a3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.096889 Apr 05 12:14:43.720366 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1720/3415] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:43 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:43.810917 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-775bdcbb-4226-4f92-ade9-cfdb2d0746b1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:43.811567 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-775bdcbb-4226-4f92-ade9-cfdb2d0746b1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:43.818952 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-775bdcbb-4226-4f92-ade9-cfdb2d0746b1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:43.819482 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-775bdcbb-4226-4f92-ade9-cfdb2d0746b1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:43.820419 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-775bdcbb-4226-4f92-ade9-cfdb2d0746b1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:43.820931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-775bdcbb-4226-4f92-ade9-cfdb2d0746b1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:43.967071 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-775bdcbb-4226-4f92-ade9-cfdb2d0746b1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:43.975358 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-775bdcbb-4226-4f92-ade9-cfdb2d0746b1 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.169544 Apr 05 12:14:43.975929 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1696/3416] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:43 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:44.740887 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3ccbd0f8-91cf-45c9-bb40-a5ff8ddf4b78 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:44.741902 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3ccbd0f8-91cf-45c9-bb40-a5ff8ddf4b78 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:44.753029 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3ccbd0f8-91cf-45c9-bb40-a5ff8ddf4b78 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:44.753777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3ccbd0f8-91cf-45c9-bb40-a5ff8ddf4b78 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:44.755040 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3ccbd0f8-91cf-45c9-bb40-a5ff8ddf4b78 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:44.755767 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3ccbd0f8-91cf-45c9-bb40-a5ff8ddf4b78 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:44.817869 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3ccbd0f8-91cf-45c9-bb40-a5ff8ddf4b78 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:44.826247 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3ccbd0f8-91cf-45c9-bb40-a5ff8ddf4b78 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.092000 Apr 05 12:14:44.826832 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1721/3417] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:44 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:44.947054 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fca79ae5-9884-4b97-bc44-3d036e598728 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:44.947675 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fca79ae5-9884-4b97-bc44-3d036e598728 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 64db0811-1092-48cb-b6aa-9018da662bfc] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:44.954408 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fca79ae5-9884-4b97-bc44-3d036e598728 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:44.954859 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fca79ae5-9884-4b97-bc44-3d036e598728 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:44.955625 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fca79ae5-9884-4b97-bc44-3d036e598728 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:44.956057 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fca79ae5-9884-4b97-bc44-3d036e598728 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:44.978785 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fca79ae5-9884-4b97-bc44-3d036e598728 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc/ips" status: 200 len: 151 microversion: 2.20 time: 0.035820 Apr 05 12:14:44.979346 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1697/3418] 10.222.0.61 () {60 vars in 1288 bytes} [Tue Apr 5 12:14:44 2022] GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:14:44.992746 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-55f6c1f3-e951-4c13-8461-4d1f100cf751 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:44.993325 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-55f6c1f3-e951-4c13-8461-4d1f100cf751 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:44.999854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-55f6c1f3-e951-4c13-8461-4d1f100cf751 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:45.000349 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-55f6c1f3-e951-4c13-8461-4d1f100cf751 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:45.001111 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-55f6c1f3-e951-4c13-8461-4d1f100cf751 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:45.001584 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-55f6c1f3-e951-4c13-8461-4d1f100cf751 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:45.138330 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-55f6c1f3-e951-4c13-8461-4d1f100cf751 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:45.146226 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-55f6c1f3-e951-4c13-8461-4d1f100cf751 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.157442 Apr 05 12:14:45.146877 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1722/3419] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:44 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:45.845215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-593ed3c8-390b-4099-bc2f-2c5a5537b7d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:45.845892 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-593ed3c8-390b-4099-bc2f-2c5a5537b7d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:45.853673 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-593ed3c8-390b-4099-bc2f-2c5a5537b7d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:45.854316 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-593ed3c8-390b-4099-bc2f-2c5a5537b7d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:45.855304 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-593ed3c8-390b-4099-bc2f-2c5a5537b7d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:45.855836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-593ed3c8-390b-4099-bc2f-2c5a5537b7d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:45.917925 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-593ed3c8-390b-4099-bc2f-2c5a5537b7d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:45.926760 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-593ed3c8-390b-4099-bc2f-2c5a5537b7d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.086564 Apr 05 12:14:45.927408 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1698/3420] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:45 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:46.166916 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-59e4f8b1-e4c3-41b6-9823-02177a56618a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:46.167619 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-59e4f8b1-e4c3-41b6-9823-02177a56618a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:46.176183 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-59e4f8b1-e4c3-41b6-9823-02177a56618a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:46.176799 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-59e4f8b1-e4c3-41b6-9823-02177a56618a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:46.177826 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-59e4f8b1-e4c3-41b6-9823-02177a56618a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:46.178392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-59e4f8b1-e4c3-41b6-9823-02177a56618a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:46.330904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-59e4f8b1-e4c3-41b6-9823-02177a56618a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:46.342835 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-59e4f8b1-e4c3-41b6-9823-02177a56618a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.182270 Apr 05 12:14:46.343650 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1723/3421] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:46 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:46.947511 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c216ebd1-5161-4ca6-bacc-99d6e7bca87b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:46.948364 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c216ebd1-5161-4ca6-bacc-99d6e7bca87b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:46.955826 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c216ebd1-5161-4ca6-bacc-99d6e7bca87b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:46.956367 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c216ebd1-5161-4ca6-bacc-99d6e7bca87b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:46.957213 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c216ebd1-5161-4ca6-bacc-99d6e7bca87b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:46.957694 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c216ebd1-5161-4ca6-bacc-99d6e7bca87b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:47.023149 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c216ebd1-5161-4ca6-bacc-99d6e7bca87b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:47.031456 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c216ebd1-5161-4ca6-bacc-99d6e7bca87b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.090548 Apr 05 12:14:47.032040 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1699/3422] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:46 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:47.367772 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-98e48366-82c1-4928-85f5-3a0938680a26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:47.368868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-98e48366-82c1-4928-85f5-3a0938680a26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:47.375922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-98e48366-82c1-4928-85f5-3a0938680a26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:47.376407 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-98e48366-82c1-4928-85f5-3a0938680a26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:47.377518 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-98e48366-82c1-4928-85f5-3a0938680a26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:47.377944 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-98e48366-82c1-4928-85f5-3a0938680a26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:47.518614 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-98e48366-82c1-4928-85f5-3a0938680a26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:47.526650 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-98e48366-82c1-4928-85f5-3a0938680a26 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.165267 Apr 05 12:14:47.527191 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1724/3423] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:47 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:48.053086 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b12d65bc-3ee6-48e1-ae70-4f987a8e7cc9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:48.054110 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b12d65bc-3ee6-48e1-ae70-4f987a8e7cc9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:48.061774 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b12d65bc-3ee6-48e1-ae70-4f987a8e7cc9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:48.062229 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b12d65bc-3ee6-48e1-ae70-4f987a8e7cc9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:48.062997 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b12d65bc-3ee6-48e1-ae70-4f987a8e7cc9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:48.063434 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b12d65bc-3ee6-48e1-ae70-4f987a8e7cc9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:48.133681 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b12d65bc-3ee6-48e1-ae70-4f987a8e7cc9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:48.146292 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b12d65bc-3ee6-48e1-ae70-4f987a8e7cc9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.099393 Apr 05 12:14:48.147172 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1700/3424] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:48 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:48.553679 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7abfdfe8-ac39-4880-8baf-e34ed3ce2cae tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:48.554682 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7abfdfe8-ac39-4880-8baf-e34ed3ce2cae tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:48.565242 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7abfdfe8-ac39-4880-8baf-e34ed3ce2cae tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:48.565986 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7abfdfe8-ac39-4880-8baf-e34ed3ce2cae tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:48.567242 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7abfdfe8-ac39-4880-8baf-e34ed3ce2cae tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:48.567961 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7abfdfe8-ac39-4880-8baf-e34ed3ce2cae tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:48.710746 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7abfdfe8-ac39-4880-8baf-e34ed3ce2cae tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:48.718964 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7abfdfe8-ac39-4880-8baf-e34ed3ce2cae tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.171827 Apr 05 12:14:48.719524 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1725/3425] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:48 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:49.167801 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-552d41a5-189a-4598-aa49-7bcd9e74e931 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:49.168597 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-552d41a5-189a-4598-aa49-7bcd9e74e931 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:49.176685 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-552d41a5-189a-4598-aa49-7bcd9e74e931 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:49.177292 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-552d41a5-189a-4598-aa49-7bcd9e74e931 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:49.178241 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-552d41a5-189a-4598-aa49-7bcd9e74e931 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:49.178797 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-552d41a5-189a-4598-aa49-7bcd9e74e931 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:49.241952 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-552d41a5-189a-4598-aa49-7bcd9e74e931 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:49.249867 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-552d41a5-189a-4598-aa49-7bcd9e74e931 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.088393 Apr 05 12:14:49.250450 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1701/3426] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:49 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:49.745594 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8b0ecca3-4770-4cd8-83ab-b5db180d4ecb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:49.746907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8b0ecca3-4770-4cd8-83ab-b5db180d4ecb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:49.753593 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8b0ecca3-4770-4cd8-83ab-b5db180d4ecb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:49.754035 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8b0ecca3-4770-4cd8-83ab-b5db180d4ecb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:49.754784 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8b0ecca3-4770-4cd8-83ab-b5db180d4ecb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:49.755207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8b0ecca3-4770-4cd8-83ab-b5db180d4ecb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:49.887788 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8b0ecca3-4770-4cd8-83ab-b5db180d4ecb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:49.895706 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8b0ecca3-4770-4cd8-83ab-b5db180d4ecb tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.162167 Apr 05 12:14:49.896365 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1726/3427] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:49 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:50.271799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-22822c62-f987-4d6c-b654-3f99f3abc92e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:50.272833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-22822c62-f987-4d6c-b654-3f99f3abc92e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:50.280844 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-22822c62-f987-4d6c-b654-3f99f3abc92e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:50.281296 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-22822c62-f987-4d6c-b654-3f99f3abc92e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:50.282056 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-22822c62-f987-4d6c-b654-3f99f3abc92e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:50.282490 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-22822c62-f987-4d6c-b654-3f99f3abc92e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:50.350470 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-22822c62-f987-4d6c-b654-3f99f3abc92e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:50.358469 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-22822c62-f987-4d6c-b654-3f99f3abc92e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.093352 Apr 05 12:14:50.359048 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1702/3428] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:50 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:50.917364 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7295f1b5-05d3-4a29-9d40-f3d6a6e5c750 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:50.917978 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7295f1b5-05d3-4a29-9d40-f3d6a6e5c750 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:50.924691 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7295f1b5-05d3-4a29-9d40-f3d6a6e5c750 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:50.925164 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7295f1b5-05d3-4a29-9d40-f3d6a6e5c750 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:50.925881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7295f1b5-05d3-4a29-9d40-f3d6a6e5c750 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:50.926342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7295f1b5-05d3-4a29-9d40-f3d6a6e5c750 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:51.068048 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7295f1b5-05d3-4a29-9d40-f3d6a6e5c750 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:51.080702 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7295f1b5-05d3-4a29-9d40-f3d6a6e5c750 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.168082 Apr 05 12:14:51.081597 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1727/3429] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:50 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:51.379649 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-19095fa1-6bc3-4981-936e-3c1fe3567b92 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:51.380681 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-19095fa1-6bc3-4981-936e-3c1fe3567b92 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:51.389269 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-19095fa1-6bc3-4981-936e-3c1fe3567b92 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:51.389724 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-19095fa1-6bc3-4981-936e-3c1fe3567b92 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:51.390483 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-19095fa1-6bc3-4981-936e-3c1fe3567b92 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:51.390919 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-19095fa1-6bc3-4981-936e-3c1fe3567b92 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:51.459116 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-19095fa1-6bc3-4981-936e-3c1fe3567b92 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:51.467347 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-19095fa1-6bc3-4981-936e-3c1fe3567b92 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.094900 Apr 05 12:14:51.467895 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1703/3430] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:51 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:52.105041 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a392c445-58df-475d-833b-41e55d594083 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:52.106059 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a392c445-58df-475d-833b-41e55d594083 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:52.116759 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a392c445-58df-475d-833b-41e55d594083 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:52.117504 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a392c445-58df-475d-833b-41e55d594083 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:52.118754 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a392c445-58df-475d-833b-41e55d594083 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:52.119475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a392c445-58df-475d-833b-41e55d594083 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:52.275940 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a392c445-58df-475d-833b-41e55d594083 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:52.284470 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a392c445-58df-475d-833b-41e55d594083 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.186044 Apr 05 12:14:52.285048 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1728/3431] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:52 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:52.489122 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3d4fd453-7213-4133-b613-2e33ad52eab4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:52.490041 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3d4fd453-7213-4133-b613-2e33ad52eab4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:52.498811 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3d4fd453-7213-4133-b613-2e33ad52eab4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:52.499263 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3d4fd453-7213-4133-b613-2e33ad52eab4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:52.500034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3d4fd453-7213-4133-b613-2e33ad52eab4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:52.500503 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3d4fd453-7213-4133-b613-2e33ad52eab4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:52.559838 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3d4fd453-7213-4133-b613-2e33ad52eab4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:52.568475 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3d4fd453-7213-4133-b613-2e33ad52eab4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.086759 Apr 05 12:14:52.569050 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1704/3432] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:52 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:53.306118 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-71d26c53-bba1-4b77-9d79-07f4b89f5f0f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:53.307237 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-71d26c53-bba1-4b77-9d79-07f4b89f5f0f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:53.313972 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71d26c53-bba1-4b77-9d79-07f4b89f5f0f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:53.314421 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71d26c53-bba1-4b77-9d79-07f4b89f5f0f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:53.315220 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71d26c53-bba1-4b77-9d79-07f4b89f5f0f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:53.315654 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71d26c53-bba1-4b77-9d79-07f4b89f5f0f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:53.477321 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-71d26c53-bba1-4b77-9d79-07f4b89f5f0f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:53.485567 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-71d26c53-bba1-4b77-9d79-07f4b89f5f0f tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.186171 Apr 05 12:14:53.486144 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1729/3433] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:53 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:53.589485 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4c488d0c-276f-4749-a746-414e67f5f2e0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:53.590499 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4c488d0c-276f-4749-a746-414e67f5f2e0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:53.601249 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c488d0c-276f-4749-a746-414e67f5f2e0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:53.601997 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c488d0c-276f-4749-a746-414e67f5f2e0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:53.603249 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c488d0c-276f-4749-a746-414e67f5f2e0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:53.603969 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4c488d0c-276f-4749-a746-414e67f5f2e0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:53.671073 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4c488d0c-276f-4749-a746-414e67f5f2e0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:53.677178 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4c488d0c-276f-4749-a746-414e67f5f2e0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.094301 Apr 05 12:14:53.677758 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1705/3434] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:53 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:54.507321 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8e4e1666-f20a-4279-b35b-1d2df7899e70 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:54.508356 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8e4e1666-f20a-4279-b35b-1d2df7899e70 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:54.515918 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e4e1666-f20a-4279-b35b-1d2df7899e70 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:54.516396 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e4e1666-f20a-4279-b35b-1d2df7899e70 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:54.517154 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e4e1666-f20a-4279-b35b-1d2df7899e70 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:54.517583 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e4e1666-f20a-4279-b35b-1d2df7899e70 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:54.650444 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8e4e1666-f20a-4279-b35b-1d2df7899e70 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:54.658532 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8e4e1666-f20a-4279-b35b-1d2df7899e70 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.158149 Apr 05 12:14:54.659083 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1730/3435] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:54 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:54.697465 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-65673753-2547-466b-91ab-fe72bed32018 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:54.698520 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-65673753-2547-466b-91ab-fe72bed32018 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:54.708110 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-65673753-2547-466b-91ab-fe72bed32018 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:54.708864 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-65673753-2547-466b-91ab-fe72bed32018 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:54.710104 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-65673753-2547-466b-91ab-fe72bed32018 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:54.710818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-65673753-2547-466b-91ab-fe72bed32018 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:54.770611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-65673753-2547-466b-91ab-fe72bed32018 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:54.778746 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-65673753-2547-466b-91ab-fe72bed32018 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.087948 Apr 05 12:14:54.779304 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1706/3436] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:54 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:14:55.680103 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e64416d7-8ed4-4aff-a66b-7bec170b42d8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:55.681123 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e64416d7-8ed4-4aff-a66b-7bec170b42d8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:55.688991 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e64416d7-8ed4-4aff-a66b-7bec170b42d8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:55.689488 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e64416d7-8ed4-4aff-a66b-7bec170b42d8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:55.690322 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e64416d7-8ed4-4aff-a66b-7bec170b42d8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:55.690798 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e64416d7-8ed4-4aff-a66b-7bec170b42d8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:55.794890 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-dbd1ccc4-ffae-44f2-97d3-99f0d6a046c0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:55.795506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-dbd1ccc4-ffae-44f2-97d3-99f0d6a046c0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:55.802257 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dbd1ccc4-ffae-44f2-97d3-99f0d6a046c0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:55.802689 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dbd1ccc4-ffae-44f2-97d3-99f0d6a046c0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:55.803455 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dbd1ccc4-ffae-44f2-97d3-99f0d6a046c0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:55.803888 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dbd1ccc4-ffae-44f2-97d3-99f0d6a046c0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:55.841738 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e64416d7-8ed4-4aff-a66b-7bec170b42d8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:55.849668 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e64416d7-8ed4-4aff-a66b-7bec170b42d8 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.175999 Apr 05 12:14:55.850258 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1731/3437] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:55 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:55.862968 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-dbd1ccc4-ffae-44f2-97d3-99f0d6a046c0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:55.871126 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-dbd1ccc4-ffae-44f2-97d3-99f0d6a046c0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.080185 Apr 05 12:14:55.871669 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1707/3438] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:55 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:14:56.871815 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1bc01bec-3db2-40dd-9f40-1bf40bc00d2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:56.872985 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1bc01bec-3db2-40dd-9f40-1bf40bc00d2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:56.883685 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1bc01bec-3db2-40dd-9f40-1bf40bc00d2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:56.884481 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1bc01bec-3db2-40dd-9f40-1bf40bc00d2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:56.885814 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1bc01bec-3db2-40dd-9f40-1bf40bc00d2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:56.886246 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1bc01bec-3db2-40dd-9f40-1bf40bc00d2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:56.889973 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-01575c85-e015-481f-beb8-0999db6ebf47 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:56.890666 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-01575c85-e015-481f-beb8-0999db6ebf47 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:56.897289 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-01575c85-e015-481f-beb8-0999db6ebf47 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:56.897751 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-01575c85-e015-481f-beb8-0999db6ebf47 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:56.898520 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-01575c85-e015-481f-beb8-0999db6ebf47 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:56.898954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-01575c85-e015-481f-beb8-0999db6ebf47 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:56.959254 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-01575c85-e015-481f-beb8-0999db6ebf47 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:56.967502 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-01575c85-e015-481f-beb8-0999db6ebf47 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.081441 Apr 05 12:14:56.968494 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1708/3439] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:56 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:57.017517 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1bc01bec-3db2-40dd-9f40-1bf40bc00d2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:57.026351 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1bc01bec-3db2-40dd-9f40-1bf40bc00d2c tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.161391 Apr 05 12:14:57.026953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1732/3440] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:56 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:57.988641 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6ac7d89a-c3c0-42b8-a6bf-ca2b1915cc28 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:57.989631 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6ac7d89a-c3c0-42b8-a6bf-ca2b1915cc28 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:57.998224 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6ac7d89a-c3c0-42b8-a6bf-ca2b1915cc28 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:57.998674 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6ac7d89a-c3c0-42b8-a6bf-ca2b1915cc28 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:57.999431 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6ac7d89a-c3c0-42b8-a6bf-ca2b1915cc28 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:57.999863 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6ac7d89a-c3c0-42b8-a6bf-ca2b1915cc28 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:58.043897 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2d537ac9-009d-4b3b-9794-a65c7c9dd35a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:58.044564 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2d537ac9-009d-4b3b-9794-a65c7c9dd35a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:58.050685 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2d537ac9-009d-4b3b-9794-a65c7c9dd35a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:58.051121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2d537ac9-009d-4b3b-9794-a65c7c9dd35a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:58.051868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2d537ac9-009d-4b3b-9794-a65c7c9dd35a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:58.052318 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2d537ac9-009d-4b3b-9794-a65c7c9dd35a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:58.059187 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6ac7d89a-c3c0-42b8-a6bf-ca2b1915cc28 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:58.067161 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6ac7d89a-c3c0-42b8-a6bf-ca2b1915cc28 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.085117 Apr 05 12:14:58.067725 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1709/3441] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:57 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:58.182876 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2d537ac9-009d-4b3b-9794-a65c7c9dd35a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:58.191372 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2d537ac9-009d-4b3b-9794-a65c7c9dd35a tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.151453 Apr 05 12:14:58.191952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1733/3442] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:58 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:59.088444 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0c543eb1-6a49-4721-9e07-6dd568bea6ff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:59.089418 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0c543eb1-6a49-4721-9e07-6dd568bea6ff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:59.101022 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0c543eb1-6a49-4721-9e07-6dd568bea6ff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:59.101891 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0c543eb1-6a49-4721-9e07-6dd568bea6ff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:59.103223 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0c543eb1-6a49-4721-9e07-6dd568bea6ff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:59.104167 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0c543eb1-6a49-4721-9e07-6dd568bea6ff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:59.177487 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0c543eb1-6a49-4721-9e07-6dd568bea6ff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:59.187654 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0c543eb1-6a49-4721-9e07-6dd568bea6ff tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.105876 Apr 05 12:14:59.188256 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1710/3443] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:59 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:59.208326 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-24f16f51-cab4-4b3b-ba23-b73851920152 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:14:59.208908 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-24f16f51-cab4-4b3b-ba23-b73851920152 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:14:59.216027 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24f16f51-cab4-4b3b-ba23-b73851920152 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:59.216527 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24f16f51-cab4-4b3b-ba23-b73851920152 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:59.217288 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24f16f51-cab4-4b3b-ba23-b73851920152 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:14:59.217755 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-24f16f51-cab4-4b3b-ba23-b73851920152 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:14:59.368741 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-24f16f51-cab4-4b3b-ba23-b73851920152 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:14:59.377526 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-24f16f51-cab4-4b3b-ba23-b73851920152 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.173078 Apr 05 12:14:59.378116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1734/3444] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:14:59 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:00.211396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e8e5d7f9-2de8-442d-b26e-8680967e338f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:00.212448 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e8e5d7f9-2de8-442d-b26e-8680967e338f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:00.219550 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e8e5d7f9-2de8-442d-b26e-8680967e338f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:00.220008 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e8e5d7f9-2de8-442d-b26e-8680967e338f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:00.220806 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e8e5d7f9-2de8-442d-b26e-8680967e338f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:00.221238 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e8e5d7f9-2de8-442d-b26e-8680967e338f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:00.283145 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e8e5d7f9-2de8-442d-b26e-8680967e338f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:00.291090 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e8e5d7f9-2de8-442d-b26e-8680967e338f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.086062 Apr 05 12:15:00.291664 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1711/3445] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:00 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:00.399711 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-593b4e5c-f35a-4e1b-8a23-2b56522cf765 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:00.400695 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-593b4e5c-f35a-4e1b-8a23-2b56522cf765 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:00.411426 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-593b4e5c-f35a-4e1b-8a23-2b56522cf765 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:00.412232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-593b4e5c-f35a-4e1b-8a23-2b56522cf765 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:00.413484 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-593b4e5c-f35a-4e1b-8a23-2b56522cf765 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:00.414203 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-593b4e5c-f35a-4e1b-8a23-2b56522cf765 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:00.546787 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-593b4e5c-f35a-4e1b-8a23-2b56522cf765 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:00.555073 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-593b4e5c-f35a-4e1b-8a23-2b56522cf765 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.161683 Apr 05 12:15:00.555638 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1735/3446] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:00 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:01.311957 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0ebec2cc-eb56-436c-a45b-96164a294633 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:01.313013 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0ebec2cc-eb56-436c-a45b-96164a294633 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:01.323338 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0ebec2cc-eb56-436c-a45b-96164a294633 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:01.323785 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0ebec2cc-eb56-436c-a45b-96164a294633 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:01.324576 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0ebec2cc-eb56-436c-a45b-96164a294633 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:01.325002 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0ebec2cc-eb56-436c-a45b-96164a294633 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:01.394953 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0ebec2cc-eb56-436c-a45b-96164a294633 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:01.406120 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0ebec2cc-eb56-436c-a45b-96164a294633 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.100423 Apr 05 12:15:01.406863 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1712/3447] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:01 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:01.576450 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9f23983f-4a08-42ff-a8ca-59f7cc7cf026 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:01.577438 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9f23983f-4a08-42ff-a8ca-59f7cc7cf026 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 99328563-d12a-4ef5-952b-c6c86929a22d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:01.587873 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9f23983f-4a08-42ff-a8ca-59f7cc7cf026 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:01.588678 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9f23983f-4a08-42ff-a8ca-59f7cc7cf026 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:01.589426 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9f23983f-4a08-42ff-a8ca-59f7cc7cf026 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:01.589857 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9f23983f-4a08-42ff-a8ca-59f7cc7cf026 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:01.737979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9f23983f-4a08-42ff-a8ca-59f7cc7cf026 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:01.746629 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9f23983f-4a08-42ff-a8ca-59f7cc7cf026 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d" status: 200 len: 1735 microversion: 2.1 time: 0.176684 Apr 05 12:15:01.747131 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1736/3448] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:01 2022] GET /compute/v2.1/servers/99328563-d12a-4ef5-952b-c6c86929a22d => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:01.765837 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cab6346d-e5aa-48cd-824e-989c73b61db0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '.version_select at 0x7f161c2cfd30>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:01.791559 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cab6346d-e5aa-48cd-824e-989c73b61db0 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-229201080" status: 202 len: 0 microversion: 2.1 time: 0.031897 Apr 05 12:15:01.792231 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1713/3449] 10.222.0.61 () {58 vars in 1217 bytes} [Tue Apr 5 12:15:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-229201080 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:15:02.426532 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c99d89f0-dfab-4e93-9f54-4386311b7a80 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:02.427100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c99d89f0-dfab-4e93-9f54-4386311b7a80 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:02.433481 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c99d89f0-dfab-4e93-9f54-4386311b7a80 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:02.433933 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c99d89f0-dfab-4e93-9f54-4386311b7a80 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:02.434684 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c99d89f0-dfab-4e93-9f54-4386311b7a80 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:02.435113 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c99d89f0-dfab-4e93-9f54-4386311b7a80 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:02.528567 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c99d89f0-dfab-4e93-9f54-4386311b7a80 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:02.536833 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c99d89f0-dfab-4e93-9f54-4386311b7a80 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.114432 Apr 05 12:15:02.537747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1737/3450] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:02 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:02.749074 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-d97e5d5a-7be5-4833-9062-80ca2003e5ab req-628827af-9ee4-468a-a793-de857d0b67d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99328563-d12a-4ef5-952b-c6c86929a22d", "tag": "d788cf01-8528-46be-b9ed-aa38fac571ee"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:02.759463 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-d97e5d5a-7be5-4833-9062-80ca2003e5ab req-628827af-9ee4-468a-a793-de857d0b67d6 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:02.759923 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-d97e5d5a-7be5-4833-9062-80ca2003e5ab req-628827af-9ee4-468a-a793-de857d0b67d6 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:02.770872 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-d97e5d5a-7be5-4833-9062-80ca2003e5ab req-628827af-9ee4-468a-a793-de857d0b67d6 service nova] Creating event network-changed:d788cf01-8528-46be-b9ed-aa38fac571ee for instance 99328563-d12a-4ef5-952b-c6c86929a22d on hv-cinder-82956 Apr 05 12:15:02.776707 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-d97e5d5a-7be5-4833-9062-80ca2003e5ab req-628827af-9ee4-468a-a793-de857d0b67d6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031705 Apr 05 12:15:02.777561 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1714/3451] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:15:03.554034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-46421c16-834a-438f-a938-a87dbbf488d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:03.554726 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-46421c16-834a-438f-a938-a87dbbf488d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:03.561966 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-46421c16-834a-438f-a938-a87dbbf488d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:03.562413 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-46421c16-834a-438f-a938-a87dbbf488d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:03.563184 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-46421c16-834a-438f-a938-a87dbbf488d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:03.563642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-46421c16-834a-438f-a938-a87dbbf488d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:03.625840 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-46421c16-834a-438f-a938-a87dbbf488d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:03.634467 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-46421c16-834a-438f-a938-a87dbbf488d4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.084294 Apr 05 12:15:03.635092 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1738/3452] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:03 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:04.656064 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e1ae0369-740c-4efb-809b-adc1a9d96c55 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:04.657226 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e1ae0369-740c-4efb-809b-adc1a9d96c55 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:04.668135 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e1ae0369-740c-4efb-809b-adc1a9d96c55 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:04.668887 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e1ae0369-740c-4efb-809b-adc1a9d96c55 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:04.670127 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e1ae0369-740c-4efb-809b-adc1a9d96c55 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:04.670841 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e1ae0369-740c-4efb-809b-adc1a9d96c55 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:04.735565 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e1ae0369-740c-4efb-809b-adc1a9d96c55 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:04.743606 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e1ae0369-740c-4efb-809b-adc1a9d96c55 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.094626 Apr 05 12:15:04.744098 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1715/3453] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:04 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:05.764248 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d94799ee-87c2-4b53-8d6f-99c57e578905 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:05.764990 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d94799ee-87c2-4b53-8d6f-99c57e578905 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:05.773229 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d94799ee-87c2-4b53-8d6f-99c57e578905 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:05.773767 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d94799ee-87c2-4b53-8d6f-99c57e578905 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:05.774688 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d94799ee-87c2-4b53-8d6f-99c57e578905 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:05.775224 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d94799ee-87c2-4b53-8d6f-99c57e578905 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:05.840897 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d94799ee-87c2-4b53-8d6f-99c57e578905 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:05.848586 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d94799ee-87c2-4b53-8d6f-99c57e578905 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.089733 Apr 05 12:15:05.849150 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1739/3454] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:05 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:06.865765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-672efbc2-ed81-413d-950f-e22d4da9c2f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:06.866396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-672efbc2-ed81-413d-950f-e22d4da9c2f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:06.873164 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-672efbc2-ed81-413d-950f-e22d4da9c2f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:06.873614 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-672efbc2-ed81-413d-950f-e22d4da9c2f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:06.874373 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-672efbc2-ed81-413d-950f-e22d4da9c2f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:06.874807 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-672efbc2-ed81-413d-950f-e22d4da9c2f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:06.934748 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-672efbc2-ed81-413d-950f-e22d4da9c2f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:06.943177 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-672efbc2-ed81-413d-950f-e22d4da9c2f9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.081270 Apr 05 12:15:06.943775 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1716/3455] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:06 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:07.960854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e6d036aa-d194-412d-a0a5-cb01556f7fa2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:07.961523 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e6d036aa-d194-412d-a0a5-cb01556f7fa2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:07.968828 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6d036aa-d194-412d-a0a5-cb01556f7fa2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:07.969280 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6d036aa-d194-412d-a0a5-cb01556f7fa2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:07.970106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6d036aa-d194-412d-a0a5-cb01556f7fa2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:07.970533 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e6d036aa-d194-412d-a0a5-cb01556f7fa2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:08.031955 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e6d036aa-d194-412d-a0a5-cb01556f7fa2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:08.042154 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e6d036aa-d194-412d-a0a5-cb01556f7fa2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.085339 Apr 05 12:15:08.042844 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1740/3456] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:07 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:09.063866 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-07eea29a-a07d-400c-bec6-361828eb481a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:09.065046 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-07eea29a-a07d-400c-bec6-361828eb481a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:09.075575 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-07eea29a-a07d-400c-bec6-361828eb481a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:09.076381 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-07eea29a-a07d-400c-bec6-361828eb481a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:09.077632 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-07eea29a-a07d-400c-bec6-361828eb481a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:09.078350 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-07eea29a-a07d-400c-bec6-361828eb481a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:09.142423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-07eea29a-a07d-400c-bec6-361828eb481a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:09.152890 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-07eea29a-a07d-400c-bec6-361828eb481a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.095476 Apr 05 12:15:09.153465 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1717/3457] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:09 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:10.173842 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-513d80e2-9beb-4d01-9b1b-644ac26300de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:10.174807 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-513d80e2-9beb-4d01-9b1b-644ac26300de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:10.184982 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-513d80e2-9beb-4d01-9b1b-644ac26300de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:10.185726 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-513d80e2-9beb-4d01-9b1b-644ac26300de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:10.186965 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-513d80e2-9beb-4d01-9b1b-644ac26300de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:10.187726 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-513d80e2-9beb-4d01-9b1b-644ac26300de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:10.253475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-513d80e2-9beb-4d01-9b1b-644ac26300de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:10.264214 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-513d80e2-9beb-4d01-9b1b-644ac26300de tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.096878 Apr 05 12:15:10.264787 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1741/3458] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:10 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:11.283905 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4aba2cff-486a-4205-81cd-b3d2b4359bdf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:11.284879 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4aba2cff-486a-4205-81cd-b3d2b4359bdf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:11.295489 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4aba2cff-486a-4205-81cd-b3d2b4359bdf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:11.296257 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4aba2cff-486a-4205-81cd-b3d2b4359bdf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:11.297488 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4aba2cff-486a-4205-81cd-b3d2b4359bdf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:11.298123 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4aba2cff-486a-4205-81cd-b3d2b4359bdf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:11.362356 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4aba2cff-486a-4205-81cd-b3d2b4359bdf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:11.370175 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4aba2cff-486a-4205-81cd-b3d2b4359bdf tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.092273 Apr 05 12:15:11.370848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1718/3459] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:11 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:12.391736 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7601449a-5b97-46b2-93d4-278c8a84b77a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:12.392994 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7601449a-5b97-46b2-93d4-278c8a84b77a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:12.403284 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7601449a-5b97-46b2-93d4-278c8a84b77a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:12.404027 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7601449a-5b97-46b2-93d4-278c8a84b77a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:12.405306 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7601449a-5b97-46b2-93d4-278c8a84b77a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:12.406011 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7601449a-5b97-46b2-93d4-278c8a84b77a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:12.469522 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7601449a-5b97-46b2-93d4-278c8a84b77a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:12.477841 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7601449a-5b97-46b2-93d4-278c8a84b77a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.092583 Apr 05 12:15:12.478413 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1742/3460] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:12 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:13.495980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e98baee8-c19a-403f-9123-6cb1f3badb31 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:13.496620 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e98baee8-c19a-403f-9123-6cb1f3badb31 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:13.503639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e98baee8-c19a-403f-9123-6cb1f3badb31 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:13.504095 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e98baee8-c19a-403f-9123-6cb1f3badb31 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:13.504880 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e98baee8-c19a-403f-9123-6cb1f3badb31 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:13.505313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e98baee8-c19a-403f-9123-6cb1f3badb31 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:13.566541 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e98baee8-c19a-403f-9123-6cb1f3badb31 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:13.574758 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e98baee8-c19a-403f-9123-6cb1f3badb31 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.083468 Apr 05 12:15:13.575332 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1719/3461] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:13 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:14.595860 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0f8148e1-9e98-4593-a2b8-b486163dd449 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:14.596913 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0f8148e1-9e98-4593-a2b8-b486163dd449 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:14.607659 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0f8148e1-9e98-4593-a2b8-b486163dd449 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:14.608319 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0f8148e1-9e98-4593-a2b8-b486163dd449 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:14.609366 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0f8148e1-9e98-4593-a2b8-b486163dd449 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:14.609915 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0f8148e1-9e98-4593-a2b8-b486163dd449 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:14.679144 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0f8148e1-9e98-4593-a2b8-b486163dd449 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:14.687451 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0f8148e1-9e98-4593-a2b8-b486163dd449 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.098169 Apr 05 12:15:14.687992 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1743/3462] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:14 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:15.336916 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9f69f03e-c76f-4bd2-81fc-eeec2199f672 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:15.337759 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9f69f03e-c76f-4bd2-81fc-eeec2199f672 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e045d626-74de-4955-85df-c15ce8e5f33d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:15.348031 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9f69f03e-c76f-4bd2-81fc-eeec2199f672 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:15.348837 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9f69f03e-c76f-4bd2-81fc-eeec2199f672 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:15.350090 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9f69f03e-c76f-4bd2-81fc-eeec2199f672 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:15.350808 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9f69f03e-c76f-4bd2-81fc-eeec2199f672 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:15.374949 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9f69f03e-c76f-4bd2-81fc-eeec2199f672 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d/ips" status: 200 len: 147 microversion: 2.1 time: 0.044705 Apr 05 12:15:15.375510 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1720/3463] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Apr 5 12:15:15 2022] GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d/ips => generated 147 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:15:15.708344 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-90478010-57ba-4135-b817-7384bfe16a5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:15.709380 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-90478010-57ba-4135-b817-7384bfe16a5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:15.717824 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90478010-57ba-4135-b817-7384bfe16a5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:15.718265 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90478010-57ba-4135-b817-7384bfe16a5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:15.719013 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90478010-57ba-4135-b817-7384bfe16a5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:15.719467 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90478010-57ba-4135-b817-7384bfe16a5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:15.946593 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-90478010-57ba-4135-b817-7384bfe16a5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:15.954658 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-90478010-57ba-4135-b817-7384bfe16a5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.252836 Apr 05 12:15:15.955251 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1744/3464] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:15 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:16.975509 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-15e17ac7-afb2-4e11-872f-2f7bd8dcfc40 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:16.976528 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-15e17ac7-afb2-4e11-872f-2f7bd8dcfc40 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:16.984549 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-15e17ac7-afb2-4e11-872f-2f7bd8dcfc40 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:16.984998 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-15e17ac7-afb2-4e11-872f-2f7bd8dcfc40 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:16.985754 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-15e17ac7-afb2-4e11-872f-2f7bd8dcfc40 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:16.986187 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-15e17ac7-afb2-4e11-872f-2f7bd8dcfc40 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:17.050878 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-15e17ac7-afb2-4e11-872f-2f7bd8dcfc40 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:17.058801 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-15e17ac7-afb2-4e11-872f-2f7bd8dcfc40 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.089760 Apr 05 12:15:17.059368 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1721/3465] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:16 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:18.076013 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ba5df4ed-2d7e-406c-b84e-299e26cc9c26 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:18.076685 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ba5df4ed-2d7e-406c-b84e-299e26cc9c26 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:18.083464 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ba5df4ed-2d7e-406c-b84e-299e26cc9c26 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:18.083917 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ba5df4ed-2d7e-406c-b84e-299e26cc9c26 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:18.084712 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ba5df4ed-2d7e-406c-b84e-299e26cc9c26 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:18.085147 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ba5df4ed-2d7e-406c-b84e-299e26cc9c26 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:18.149198 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ba5df4ed-2d7e-406c-b84e-299e26cc9c26 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:18.157604 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ba5df4ed-2d7e-406c-b84e-299e26cc9c26 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.085690 Apr 05 12:15:18.158181 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1745/3466] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:18 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:19.178697 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b94572b6-ceff-45b3-b7b6-18a82019f96f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:19.179636 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b94572b6-ceff-45b3-b7b6-18a82019f96f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:19.190319 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b94572b6-ceff-45b3-b7b6-18a82019f96f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:19.191073 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b94572b6-ceff-45b3-b7b6-18a82019f96f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:19.192402 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b94572b6-ceff-45b3-b7b6-18a82019f96f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:19.193132 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b94572b6-ceff-45b3-b7b6-18a82019f96f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:19.254985 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b94572b6-ceff-45b3-b7b6-18a82019f96f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:19.263092 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b94572b6-ceff-45b3-b7b6-18a82019f96f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.091013 Apr 05 12:15:19.263660 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1722/3467] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:19 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:20.284066 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9f357b3b-7f30-45ed-aa84-47011d8565f6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:20.284984 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9f357b3b-7f30-45ed-aa84-47011d8565f6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:20.295463 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9f357b3b-7f30-45ed-aa84-47011d8565f6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:20.296243 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9f357b3b-7f30-45ed-aa84-47011d8565f6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:20.297473 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9f357b3b-7f30-45ed-aa84-47011d8565f6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:20.298182 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9f357b3b-7f30-45ed-aa84-47011d8565f6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:20.359791 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9f357b3b-7f30-45ed-aa84-47011d8565f6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:20.367972 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9f357b3b-7f30-45ed-aa84-47011d8565f6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.090426 Apr 05 12:15:20.368555 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1746/3468] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:20 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:21.389981 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7ef24d5b-c9f2-48df-87d2-4478d4a1ebac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:21.391001 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7ef24d5b-c9f2-48df-87d2-4478d4a1ebac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:21.401616 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7ef24d5b-c9f2-48df-87d2-4478d4a1ebac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:21.404041 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7ef24d5b-c9f2-48df-87d2-4478d4a1ebac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:21.405374 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7ef24d5b-c9f2-48df-87d2-4478d4a1ebac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:21.406108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7ef24d5b-c9f2-48df-87d2-4478d4a1ebac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:21.482099 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7ef24d5b-c9f2-48df-87d2-4478d4a1ebac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:21.490498 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7ef24d5b-c9f2-48df-87d2-4478d4a1ebac tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.107098 Apr 05 12:15:21.490976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1723/3469] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:21 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:22.508043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e901014b-b751-4bc4-af89-81945da3b967 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:22.508717 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e901014b-b751-4bc4-af89-81945da3b967 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:22.517424 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e901014b-b751-4bc4-af89-81945da3b967 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:22.517876 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e901014b-b751-4bc4-af89-81945da3b967 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:22.518641 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e901014b-b751-4bc4-af89-81945da3b967 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:22.519314 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e901014b-b751-4bc4-af89-81945da3b967 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:22.584546 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e901014b-b751-4bc4-af89-81945da3b967 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:22.592999 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e901014b-b751-4bc4-af89-81945da3b967 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.089023 Apr 05 12:15:22.593567 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1747/3470] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:22 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:23.614044 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-84065f53-9b2a-4ea6-a4b4-ca5d53d87e7b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:23.615148 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-84065f53-9b2a-4ea6-a4b4-ca5d53d87e7b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:23.626663 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-84065f53-9b2a-4ea6-a4b4-ca5d53d87e7b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:23.627431 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-84065f53-9b2a-4ea6-a4b4-ca5d53d87e7b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:23.628758 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-84065f53-9b2a-4ea6-a4b4-ca5d53d87e7b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:23.629490 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-84065f53-9b2a-4ea6-a4b4-ca5d53d87e7b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:23.694046 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-84065f53-9b2a-4ea6-a4b4-ca5d53d87e7b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:23.702351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-84065f53-9b2a-4ea6-a4b4-ca5d53d87e7b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.094875 Apr 05 12:15:23.702922 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1724/3471] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:23 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:24.722964 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-91c170ad-354a-43b7-88d6-a53fe2662d57 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:24.723968 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-91c170ad-354a-43b7-88d6-a53fe2662d57 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:24.734627 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-91c170ad-354a-43b7-88d6-a53fe2662d57 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:24.735397 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-91c170ad-354a-43b7-88d6-a53fe2662d57 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:24.736805 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-91c170ad-354a-43b7-88d6-a53fe2662d57 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:24.737627 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-91c170ad-354a-43b7-88d6-a53fe2662d57 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:24.801097 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-91c170ad-354a-43b7-88d6-a53fe2662d57 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:24.809505 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-91c170ad-354a-43b7-88d6-a53fe2662d57 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.093020 Apr 05 12:15:24.810074 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1748/3472] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:24 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:25.830899 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bccfc7ac-e5b8-4d82-bf16-94bd462145d8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:25.831753 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bccfc7ac-e5b8-4d82-bf16-94bd462145d8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:25.841800 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bccfc7ac-e5b8-4d82-bf16-94bd462145d8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:25.842531 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bccfc7ac-e5b8-4d82-bf16-94bd462145d8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:25.843775 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bccfc7ac-e5b8-4d82-bf16-94bd462145d8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:25.844542 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bccfc7ac-e5b8-4d82-bf16-94bd462145d8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:25.907836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-bccfc7ac-e5b8-4d82-bf16-94bd462145d8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:25.916005 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bccfc7ac-e5b8-4d82-bf16-94bd462145d8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.092023 Apr 05 12:15:25.916651 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1725/3473] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:25 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:26.936196 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-12c24159-4581-48a7-b870-00564fa91fab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:26.936785 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-12c24159-4581-48a7-b870-00564fa91fab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:26.943305 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-12c24159-4581-48a7-b870-00564fa91fab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:26.943765 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-12c24159-4581-48a7-b870-00564fa91fab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:26.944560 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-12c24159-4581-48a7-b870-00564fa91fab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:26.944996 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-12c24159-4581-48a7-b870-00564fa91fab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:27.012948 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-12c24159-4581-48a7-b870-00564fa91fab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:27.023318 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-12c24159-4581-48a7-b870-00564fa91fab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.092126 Apr 05 12:15:27.024110 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1749/3474] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:26 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:28.045919 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fa95dd86-c8c1-4ab8-97ea-6884e721dd84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:28.047169 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fa95dd86-c8c1-4ab8-97ea-6884e721dd84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:28.054335 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fa95dd86-c8c1-4ab8-97ea-6884e721dd84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:28.054900 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fa95dd86-c8c1-4ab8-97ea-6884e721dd84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:28.055658 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fa95dd86-c8c1-4ab8-97ea-6884e721dd84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:28.056170 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fa95dd86-c8c1-4ab8-97ea-6884e721dd84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:28.126327 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fa95dd86-c8c1-4ab8-97ea-6884e721dd84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:28.134142 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fa95dd86-c8c1-4ab8-97ea-6884e721dd84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.095494 Apr 05 12:15:28.134720 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1726/3475] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:28 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:29.155391 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3e295b84-59de-4b27-baeb-81031b5515dd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:29.156361 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3e295b84-59de-4b27-baeb-81031b5515dd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:29.166922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3e295b84-59de-4b27-baeb-81031b5515dd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:29.167581 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3e295b84-59de-4b27-baeb-81031b5515dd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:29.168375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3e295b84-59de-4b27-baeb-81031b5515dd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:29.168804 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3e295b84-59de-4b27-baeb-81031b5515dd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:29.228740 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3e295b84-59de-4b27-baeb-81031b5515dd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:29.236841 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3e295b84-59de-4b27-baeb-81031b5515dd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.087919 Apr 05 12:15:29.237403 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1750/3476] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:29 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:30.258293 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-abde9ff0-976c-4ea2-825d-4c2a29bc8f38 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:30.259228 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-abde9ff0-976c-4ea2-825d-4c2a29bc8f38 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:30.270075 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-abde9ff0-976c-4ea2-825d-4c2a29bc8f38 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:30.270845 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-abde9ff0-976c-4ea2-825d-4c2a29bc8f38 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:30.272116 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-abde9ff0-976c-4ea2-825d-4c2a29bc8f38 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:30.272999 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-abde9ff0-976c-4ea2-825d-4c2a29bc8f38 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:30.334948 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-abde9ff0-976c-4ea2-825d-4c2a29bc8f38 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:30.343133 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-abde9ff0-976c-4ea2-825d-4c2a29bc8f38 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.091739 Apr 05 12:15:30.343695 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1727/3477] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:30 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:31.364167 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a2d7448e-45ae-479b-8029-6500c6695b19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:31.365195 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a2d7448e-45ae-479b-8029-6500c6695b19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:31.375751 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a2d7448e-45ae-479b-8029-6500c6695b19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:31.376868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a2d7448e-45ae-479b-8029-6500c6695b19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:31.378098 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a2d7448e-45ae-479b-8029-6500c6695b19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:31.378797 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a2d7448e-45ae-479b-8029-6500c6695b19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:31.444825 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a2d7448e-45ae-479b-8029-6500c6695b19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:31.456571 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a2d7448e-45ae-479b-8029-6500c6695b19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.098480 Apr 05 12:15:31.457273 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1751/3478] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:31 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:32.477165 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-58b850b9-d1b4-46ad-88c1-7a24198e5c36 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:32.477837 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-58b850b9-d1b4-46ad-88c1-7a24198e5c36 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:32.485576 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-58b850b9-d1b4-46ad-88c1-7a24198e5c36 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:32.486098 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-58b850b9-d1b4-46ad-88c1-7a24198e5c36 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:32.486987 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-58b850b9-d1b4-46ad-88c1-7a24198e5c36 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:32.487494 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-58b850b9-d1b4-46ad-88c1-7a24198e5c36 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:32.551814 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-58b850b9-d1b4-46ad-88c1-7a24198e5c36 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:32.564020 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-58b850b9-d1b4-46ad-88c1-7a24198e5c36 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.091136 Apr 05 12:15:32.564780 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1728/3479] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:32 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:33.588411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ce5b02f5-a8e6-4676-91b3-e8fcb803ecf0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:33.589278 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ce5b02f5-a8e6-4676-91b3-e8fcb803ecf0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:33.599886 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ce5b02f5-a8e6-4676-91b3-e8fcb803ecf0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:33.600700 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ce5b02f5-a8e6-4676-91b3-e8fcb803ecf0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:33.601944 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ce5b02f5-a8e6-4676-91b3-e8fcb803ecf0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:33.602665 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ce5b02f5-a8e6-4676-91b3-e8fcb803ecf0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:33.677495 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ce5b02f5-a8e6-4676-91b3-e8fcb803ecf0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:33.685822 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ce5b02f5-a8e6-4676-91b3-e8fcb803ecf0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.104051 Apr 05 12:15:33.686387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1752/3480] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:33 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:34.706907 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-75cfdde9-950d-4985-ad2e-1c7e98ee86d1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:34.707819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-75cfdde9-950d-4985-ad2e-1c7e98ee86d1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:34.717027 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-75cfdde9-950d-4985-ad2e-1c7e98ee86d1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:34.717475 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-75cfdde9-950d-4985-ad2e-1c7e98ee86d1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:34.718226 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-75cfdde9-950d-4985-ad2e-1c7e98ee86d1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:34.718653 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-75cfdde9-950d-4985-ad2e-1c7e98ee86d1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:34.787817 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-75cfdde9-950d-4985-ad2e-1c7e98ee86d1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:34.796368 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-75cfdde9-950d-4985-ad2e-1c7e98ee86d1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.095841 Apr 05 12:15:34.796933 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1729/3481] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:34 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:35.817577 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d1aeff45-7203-4205-9d93-3e103909e1cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:35.818610 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d1aeff45-7203-4205-9d93-3e103909e1cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:35.827061 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d1aeff45-7203-4205-9d93-3e103909e1cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:35.827516 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d1aeff45-7203-4205-9d93-3e103909e1cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:35.828322 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d1aeff45-7203-4205-9d93-3e103909e1cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:35.828753 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d1aeff45-7203-4205-9d93-3e103909e1cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:35.889606 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d1aeff45-7203-4205-9d93-3e103909e1cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:35.898164 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d1aeff45-7203-4205-9d93-3e103909e1cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.087166 Apr 05 12:15:35.898749 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1753/3482] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:35 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:36.916015 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-27527bd9-b3b8-41a2-ac34-7ea598d3344b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:36.916668 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-27527bd9-b3b8-41a2-ac34-7ea598d3344b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:36.923471 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-27527bd9-b3b8-41a2-ac34-7ea598d3344b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:36.923922 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-27527bd9-b3b8-41a2-ac34-7ea598d3344b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:36.924708 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-27527bd9-b3b8-41a2-ac34-7ea598d3344b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:36.925135 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-27527bd9-b3b8-41a2-ac34-7ea598d3344b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:36.988929 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-27527bd9-b3b8-41a2-ac34-7ea598d3344b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:36.997471 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-27527bd9-b3b8-41a2-ac34-7ea598d3344b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.085988 Apr 05 12:15:36.998053 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1730/3483] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:36 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:38.016370 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cba0ff58-8b24-4759-94f4-deddf9e0861a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:38.017206 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cba0ff58-8b24-4759-94f4-deddf9e0861a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:38.025040 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cba0ff58-8b24-4759-94f4-deddf9e0861a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:38.025565 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cba0ff58-8b24-4759-94f4-deddf9e0861a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:38.026488 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cba0ff58-8b24-4759-94f4-deddf9e0861a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:38.026990 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cba0ff58-8b24-4759-94f4-deddf9e0861a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:38.089254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cba0ff58-8b24-4759-94f4-deddf9e0861a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:38.097197 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cba0ff58-8b24-4759-94f4-deddf9e0861a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.085430 Apr 05 12:15:38.097778 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1754/3484] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:38 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:39.116431 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3c87a736-ccc0-4cc6-8d4f-02af1e52e335 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:39.117124 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3c87a736-ccc0-4cc6-8d4f-02af1e52e335 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:39.124156 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3c87a736-ccc0-4cc6-8d4f-02af1e52e335 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:39.124550 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3c87a736-ccc0-4cc6-8d4f-02af1e52e335 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:39.125313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3c87a736-ccc0-4cc6-8d4f-02af1e52e335 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:39.125739 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3c87a736-ccc0-4cc6-8d4f-02af1e52e335 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:39.194931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3c87a736-ccc0-4cc6-8d4f-02af1e52e335 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:39.202563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3c87a736-ccc0-4cc6-8d4f-02af1e52e335 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.090134 Apr 05 12:15:39.203123 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1731/3485] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:39 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:40.223658 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-40af6621-7bb7-4aaf-acca-1a0b742ef905 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:40.224671 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-40af6621-7bb7-4aaf-acca-1a0b742ef905 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:40.232929 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-40af6621-7bb7-4aaf-acca-1a0b742ef905 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:40.233384 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-40af6621-7bb7-4aaf-acca-1a0b742ef905 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:40.234150 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-40af6621-7bb7-4aaf-acca-1a0b742ef905 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:40.234593 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-40af6621-7bb7-4aaf-acca-1a0b742ef905 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:40.302835 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-40af6621-7bb7-4aaf-acca-1a0b742ef905 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:40.311449 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-40af6621-7bb7-4aaf-acca-1a0b742ef905 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.094443 Apr 05 12:15:40.312024 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1755/3486] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:40 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:41.332236 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6dcb9e23-46b1-4011-b9fd-0d69d3a40086 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:41.333278 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6dcb9e23-46b1-4011-b9fd-0d69d3a40086 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:41.342095 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6dcb9e23-46b1-4011-b9fd-0d69d3a40086 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:41.342541 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6dcb9e23-46b1-4011-b9fd-0d69d3a40086 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:41.343291 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6dcb9e23-46b1-4011-b9fd-0d69d3a40086 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:41.343720 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6dcb9e23-46b1-4011-b9fd-0d69d3a40086 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:41.410420 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6dcb9e23-46b1-4011-b9fd-0d69d3a40086 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:41.422143 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6dcb9e23-46b1-4011-b9fd-0d69d3a40086 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.096064 Apr 05 12:15:41.422930 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1732/3487] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:41 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:42.442788 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c9807629-ed0f-4b9f-9af6-f3491771bd99 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:42.443904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c9807629-ed0f-4b9f-9af6-f3491771bd99 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:42.452495 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9807629-ed0f-4b9f-9af6-f3491771bd99 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:42.452941 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9807629-ed0f-4b9f-9af6-f3491771bd99 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:42.453696 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9807629-ed0f-4b9f-9af6-f3491771bd99 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:42.454123 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9807629-ed0f-4b9f-9af6-f3491771bd99 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:42.516965 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c9807629-ed0f-4b9f-9af6-f3491771bd99 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:42.528216 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c9807629-ed0f-4b9f-9af6-f3491771bd99 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.091728 Apr 05 12:15:42.529017 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1756/3488] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:42 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:43.554182 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-aaead1d1-ec53-4476-b86d-fc726b1447f8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:43.555084 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-aaead1d1-ec53-4476-b86d-fc726b1447f8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:43.563165 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aaead1d1-ec53-4476-b86d-fc726b1447f8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:43.563679 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aaead1d1-ec53-4476-b86d-fc726b1447f8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:43.564530 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aaead1d1-ec53-4476-b86d-fc726b1447f8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:43.565018 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aaead1d1-ec53-4476-b86d-fc726b1447f8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:43.627405 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-aaead1d1-ec53-4476-b86d-fc726b1447f8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:43.638971 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-aaead1d1-ec53-4476-b86d-fc726b1447f8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.091049 Apr 05 12:15:43.639715 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1733/3489] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:43 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:44.664749 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-225394fb-8baf-4dcf-b942-95b5ff67487a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:44.665793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-225394fb-8baf-4dcf-b942-95b5ff67487a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:44.673571 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-225394fb-8baf-4dcf-b942-95b5ff67487a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:44.674074 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-225394fb-8baf-4dcf-b942-95b5ff67487a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:44.674919 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-225394fb-8baf-4dcf-b942-95b5ff67487a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:44.675404 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-225394fb-8baf-4dcf-b942-95b5ff67487a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:44.741702 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-225394fb-8baf-4dcf-b942-95b5ff67487a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:44.750209 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-225394fb-8baf-4dcf-b942-95b5ff67487a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.092190 Apr 05 12:15:44.750726 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1757/3490] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:44 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:45.770695 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0b3bf859-243c-409b-9dfd-c59b36beecc9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:45.771676 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0b3bf859-243c-409b-9dfd-c59b36beecc9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:45.780195 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0b3bf859-243c-409b-9dfd-c59b36beecc9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:45.780639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0b3bf859-243c-409b-9dfd-c59b36beecc9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:45.781403 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0b3bf859-243c-409b-9dfd-c59b36beecc9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:45.781834 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0b3bf859-243c-409b-9dfd-c59b36beecc9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:45.841868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0b3bf859-243c-409b-9dfd-c59b36beecc9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:45.850694 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0b3bf859-243c-409b-9dfd-c59b36beecc9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.086400 Apr 05 12:15:45.851562 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1734/3491] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:45 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:46.872068 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-417612d4-8cba-4081-bd8c-b800a76bb886 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:46.873029 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-417612d4-8cba-4081-bd8c-b800a76bb886 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:46.883979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-417612d4-8cba-4081-bd8c-b800a76bb886 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:46.884795 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-417612d4-8cba-4081-bd8c-b800a76bb886 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:46.886106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-417612d4-8cba-4081-bd8c-b800a76bb886 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:46.886559 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-417612d4-8cba-4081-bd8c-b800a76bb886 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:46.944758 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-417612d4-8cba-4081-bd8c-b800a76bb886 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:46.953035 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-417612d4-8cba-4081-bd8c-b800a76bb886 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.087414 Apr 05 12:15:46.953595 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1758/3492] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:46 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:47.973027 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-91cbdee9-157b-450b-a14c-88dfced94a60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:47.973970 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-91cbdee9-157b-450b-a14c-88dfced94a60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:47.984447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-91cbdee9-157b-450b-a14c-88dfced94a60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:47.985183 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-91cbdee9-157b-450b-a14c-88dfced94a60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:47.986422 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-91cbdee9-157b-450b-a14c-88dfced94a60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:47.987134 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-91cbdee9-157b-450b-a14c-88dfced94a60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:48.056498 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-91cbdee9-157b-450b-a14c-88dfced94a60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:48.064392 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-91cbdee9-157b-450b-a14c-88dfced94a60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.097911 Apr 05 12:15:48.064958 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1735/3493] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:47 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:49.085814 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-80adc8db-78ac-4055-a1a5-b6d898f2e98a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:49.086740 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-80adc8db-78ac-4055-a1a5-b6d898f2e98a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:49.097445 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-80adc8db-78ac-4055-a1a5-b6d898f2e98a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:49.098188 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-80adc8db-78ac-4055-a1a5-b6d898f2e98a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:49.099435 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-80adc8db-78ac-4055-a1a5-b6d898f2e98a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:49.100298 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-80adc8db-78ac-4055-a1a5-b6d898f2e98a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:49.161717 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-80adc8db-78ac-4055-a1a5-b6d898f2e98a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:49.169800 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-80adc8db-78ac-4055-a1a5-b6d898f2e98a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.090456 Apr 05 12:15:49.170354 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1759/3494] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:49 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:50.190295 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9402c413-868f-47c8-874b-6a1b81feb762 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:50.191263 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9402c413-868f-47c8-874b-6a1b81feb762 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:50.201962 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9402c413-868f-47c8-874b-6a1b81feb762 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:50.202699 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9402c413-868f-47c8-874b-6a1b81feb762 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:50.203955 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9402c413-868f-47c8-874b-6a1b81feb762 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:50.204728 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9402c413-868f-47c8-874b-6a1b81feb762 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:50.268808 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9402c413-868f-47c8-874b-6a1b81feb762 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:50.277016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9402c413-868f-47c8-874b-6a1b81feb762 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.093204 Apr 05 12:15:50.277596 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1736/3495] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:50 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:51.294333 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c09412f6-0f86-4ba5-9f3f-1debcdba059f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:51.294893 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c09412f6-0f86-4ba5-9f3f-1debcdba059f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:51.303754 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c09412f6-0f86-4ba5-9f3f-1debcdba059f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:51.304443 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c09412f6-0f86-4ba5-9f3f-1debcdba059f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:51.305591 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c09412f6-0f86-4ba5-9f3f-1debcdba059f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:51.306216 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c09412f6-0f86-4ba5-9f3f-1debcdba059f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:51.371659 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c09412f6-0f86-4ba5-9f3f-1debcdba059f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:51.384134 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c09412f6-0f86-4ba5-9f3f-1debcdba059f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.093526 Apr 05 12:15:51.384827 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1760/3496] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:51 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:52.405419 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f228fb12-7988-4b68-b984-dbbd34be1f58 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:52.406440 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f228fb12-7988-4b68-b984-dbbd34be1f58 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:52.417025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f228fb12-7988-4b68-b984-dbbd34be1f58 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:52.417469 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f228fb12-7988-4b68-b984-dbbd34be1f58 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:52.418225 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f228fb12-7988-4b68-b984-dbbd34be1f58 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:52.418655 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f228fb12-7988-4b68-b984-dbbd34be1f58 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:52.478536 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f228fb12-7988-4b68-b984-dbbd34be1f58 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:52.486753 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f228fb12-7988-4b68-b984-dbbd34be1f58 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.087871 Apr 05 12:15:52.487342 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1737/3497] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:52 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:53.508464 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-73f96f88-b483-49df-aa07-00551fad8e39 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:53.509416 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-73f96f88-b483-49df-aa07-00551fad8e39 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:53.520017 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-73f96f88-b483-49df-aa07-00551fad8e39 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:53.520725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-73f96f88-b483-49df-aa07-00551fad8e39 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:53.521954 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-73f96f88-b483-49df-aa07-00551fad8e39 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:53.522664 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-73f96f88-b483-49df-aa07-00551fad8e39 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:53.583934 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-73f96f88-b483-49df-aa07-00551fad8e39 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:53.591696 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-73f96f88-b483-49df-aa07-00551fad8e39 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.089788 Apr 05 12:15:53.592291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1761/3498] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:53 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:54.612884 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e6841099-acac-440d-8073-3ca2ed0aa1f5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:54.613883 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e6841099-acac-440d-8073-3ca2ed0aa1f5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:54.624126 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6841099-acac-440d-8073-3ca2ed0aa1f5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:54.624902 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6841099-acac-440d-8073-3ca2ed0aa1f5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:54.626500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6841099-acac-440d-8073-3ca2ed0aa1f5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:54.627222 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6841099-acac-440d-8073-3ca2ed0aa1f5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:54.704052 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e6841099-acac-440d-8073-3ca2ed0aa1f5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:54.712749 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e6841099-acac-440d-8073-3ca2ed0aa1f5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.106631 Apr 05 12:15:54.713313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1738/3499] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:54 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:55.734639 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-eb14a1cd-1ac3-4ac7-bfce-b3b9c21ee0ad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:55.735590 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-eb14a1cd-1ac3-4ac7-bfce-b3b9c21ee0ad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:55.745736 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eb14a1cd-1ac3-4ac7-bfce-b3b9c21ee0ad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:55.746171 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eb14a1cd-1ac3-4ac7-bfce-b3b9c21ee0ad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:55.746918 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eb14a1cd-1ac3-4ac7-bfce-b3b9c21ee0ad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:55.747342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eb14a1cd-1ac3-4ac7-bfce-b3b9c21ee0ad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:55.806770 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-eb14a1cd-1ac3-4ac7-bfce-b3b9c21ee0ad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:55.815022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-eb14a1cd-1ac3-4ac7-bfce-b3b9c21ee0ad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.086942 Apr 05 12:15:55.815598 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1762/3500] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:55 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:56.838855 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6e57ddfb-852b-4140-9312-76d78589a4c3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:56.839715 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6e57ddfb-852b-4140-9312-76d78589a4c3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:56.850640 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6e57ddfb-852b-4140-9312-76d78589a4c3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:56.851383 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6e57ddfb-852b-4140-9312-76d78589a4c3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:56.852711 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6e57ddfb-852b-4140-9312-76d78589a4c3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:56.853428 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6e57ddfb-852b-4140-9312-76d78589a4c3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:56.914000 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6e57ddfb-852b-4140-9312-76d78589a4c3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:56.922400 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6e57ddfb-852b-4140-9312-76d78589a4c3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.090117 Apr 05 12:15:56.922952 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1739/3501] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:56 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:57.943427 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f8ea8490-cd6a-4ae8-934c-169197946b0f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:57.944477 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f8ea8490-cd6a-4ae8-934c-169197946b0f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:57.955179 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f8ea8490-cd6a-4ae8-934c-169197946b0f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:57.956133 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f8ea8490-cd6a-4ae8-934c-169197946b0f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:57.957502 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f8ea8490-cd6a-4ae8-934c-169197946b0f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:57.958228 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f8ea8490-cd6a-4ae8-934c-169197946b0f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:58.043726 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f8ea8490-cd6a-4ae8-934c-169197946b0f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:58.054700 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f8ea8490-cd6a-4ae8-934c-169197946b0f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.117466 Apr 05 12:15:58.055434 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1763/3502] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:57 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:59.080662 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d82d8a49-0982-4314-96c5-d2e7ba60b6b7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:15:59.082029 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d82d8a49-0982-4314-96c5-d2e7ba60b6b7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:15:59.092854 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d82d8a49-0982-4314-96c5-d2e7ba60b6b7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:59.093591 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d82d8a49-0982-4314-96c5-d2e7ba60b6b7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:59.094805 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d82d8a49-0982-4314-96c5-d2e7ba60b6b7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:15:59.095471 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d82d8a49-0982-4314-96c5-d2e7ba60b6b7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:15:59.162235 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d82d8a49-0982-4314-96c5-d2e7ba60b6b7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:15:59.170444 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d82d8a49-0982-4314-96c5-d2e7ba60b6b7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.096426 Apr 05 12:15:59.171016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1740/3503] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:15:59 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:00.191569 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fc149186-695d-475c-ac5a-e7ee3aba7da9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:00.192567 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fc149186-695d-475c-ac5a-e7ee3aba7da9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:00.203029 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc149186-695d-475c-ac5a-e7ee3aba7da9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:00.203766 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc149186-695d-475c-ac5a-e7ee3aba7da9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:00.205066 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc149186-695d-475c-ac5a-e7ee3aba7da9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:00.205779 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fc149186-695d-475c-ac5a-e7ee3aba7da9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:00.269081 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fc149186-695d-475c-ac5a-e7ee3aba7da9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:00.277453 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fc149186-695d-475c-ac5a-e7ee3aba7da9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.092358 Apr 05 12:16:00.278016 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1764/3504] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:00 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:01.296425 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-48607018-37fe-4d5e-88b7-c98057663697 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:01.297097 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-48607018-37fe-4d5e-88b7-c98057663697 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:01.304400 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-48607018-37fe-4d5e-88b7-c98057663697 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:01.304874 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-48607018-37fe-4d5e-88b7-c98057663697 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:01.305723 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-48607018-37fe-4d5e-88b7-c98057663697 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:01.306194 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-48607018-37fe-4d5e-88b7-c98057663697 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:01.367588 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-48607018-37fe-4d5e-88b7-c98057663697 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:01.376245 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-48607018-37fe-4d5e-88b7-c98057663697 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.083993 Apr 05 12:16:01.376818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1741/3505] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:01 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:02.397551 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-861fb4fa-f445-4ea2-b4f8-8cf1bc854657 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:02.398533 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-861fb4fa-f445-4ea2-b4f8-8cf1bc854657 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:02.406227 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-861fb4fa-f445-4ea2-b4f8-8cf1bc854657 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:02.406679 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-861fb4fa-f445-4ea2-b4f8-8cf1bc854657 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:02.407441 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-861fb4fa-f445-4ea2-b4f8-8cf1bc854657 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:02.407879 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-861fb4fa-f445-4ea2-b4f8-8cf1bc854657 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:02.467032 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-861fb4fa-f445-4ea2-b4f8-8cf1bc854657 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:02.475254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-861fb4fa-f445-4ea2-b4f8-8cf1bc854657 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.084303 Apr 05 12:16:02.475826 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1765/3506] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:02 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:03.497042 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-59de0dd8-0dd7-4275-9a10-8b1c00cff4b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:03.497042 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-59de0dd8-0dd7-4275-9a10-8b1c00cff4b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:03.507971 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-59de0dd8-0dd7-4275-9a10-8b1c00cff4b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:03.508773 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-59de0dd8-0dd7-4275-9a10-8b1c00cff4b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:03.510019 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-59de0dd8-0dd7-4275-9a10-8b1c00cff4b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:03.510657 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-59de0dd8-0dd7-4275-9a10-8b1c00cff4b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:03.568880 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-59de0dd8-0dd7-4275-9a10-8b1c00cff4b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:03.576845 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-59de0dd8-0dd7-4275-9a10-8b1c00cff4b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.087229 Apr 05 12:16:03.577408 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1742/3507] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:03 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:04.602721 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e325724c-fddc-437c-a916-55d860e6ae33 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:04.603728 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e325724c-fddc-437c-a916-55d860e6ae33 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:04.614237 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e325724c-fddc-437c-a916-55d860e6ae33 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:04.614986 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e325724c-fddc-437c-a916-55d860e6ae33 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:04.616390 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e325724c-fddc-437c-a916-55d860e6ae33 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:04.617118 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e325724c-fddc-437c-a916-55d860e6ae33 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:04.678585 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e325724c-fddc-437c-a916-55d860e6ae33 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:04.686596 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e325724c-fddc-437c-a916-55d860e6ae33 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.090445 Apr 05 12:16:04.687156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1766/3508] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:04 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:05.708394 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8d9bd62b-c491-48e3-952e-9e8b6bb6d2bd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:05.709450 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8d9bd62b-c491-48e3-952e-9e8b6bb6d2bd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:05.720028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8d9bd62b-c491-48e3-952e-9e8b6bb6d2bd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:05.720835 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8d9bd62b-c491-48e3-952e-9e8b6bb6d2bd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:05.722087 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8d9bd62b-c491-48e3-952e-9e8b6bb6d2bd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:05.722832 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8d9bd62b-c491-48e3-952e-9e8b6bb6d2bd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:05.785149 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8d9bd62b-c491-48e3-952e-9e8b6bb6d2bd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:05.793271 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8d9bd62b-c491-48e3-952e-9e8b6bb6d2bd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.091467 Apr 05 12:16:05.793852 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1743/3509] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:05 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:06.820912 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-de7d186c-ae3d-4c40-91ae-8cc722d6e775 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:06.821841 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-de7d186c-ae3d-4c40-91ae-8cc722d6e775 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:06.832388 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-de7d186c-ae3d-4c40-91ae-8cc722d6e775 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:06.833279 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-de7d186c-ae3d-4c40-91ae-8cc722d6e775 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:06.834526 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-de7d186c-ae3d-4c40-91ae-8cc722d6e775 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:06.835408 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-de7d186c-ae3d-4c40-91ae-8cc722d6e775 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:06.897499 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-de7d186c-ae3d-4c40-91ae-8cc722d6e775 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:06.905618 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-de7d186c-ae3d-4c40-91ae-8cc722d6e775 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.092061 Apr 05 12:16:06.906205 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1767/3510] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:06 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:07.926544 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-253ec0f0-2b8f-4e71-b2c6-80f5da7dd369 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:07.927539 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-253ec0f0-2b8f-4e71-b2c6-80f5da7dd369 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:07.938666 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-253ec0f0-2b8f-4e71-b2c6-80f5da7dd369 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:07.939625 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-253ec0f0-2b8f-4e71-b2c6-80f5da7dd369 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:07.940963 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-253ec0f0-2b8f-4e71-b2c6-80f5da7dd369 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:07.941699 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-253ec0f0-2b8f-4e71-b2c6-80f5da7dd369 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:08.006798 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-253ec0f0-2b8f-4e71-b2c6-80f5da7dd369 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:08.015134 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-253ec0f0-2b8f-4e71-b2c6-80f5da7dd369 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.095562 Apr 05 12:16:08.015665 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1744/3511] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:07 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:09.031915 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1dc5670a-e078-44ef-8093-482104fe4126 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:09.032620 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1dc5670a-e078-44ef-8093-482104fe4126 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:09.038562 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1dc5670a-e078-44ef-8093-482104fe4126 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:09.039008 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1dc5670a-e078-44ef-8093-482104fe4126 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:09.039784 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1dc5670a-e078-44ef-8093-482104fe4126 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:09.040239 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1dc5670a-e078-44ef-8093-482104fe4126 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:09.114800 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1dc5670a-e078-44ef-8093-482104fe4126 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:09.122810 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1dc5670a-e078-44ef-8093-482104fe4126 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.095028 Apr 05 12:16:09.123390 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1768/3512] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:09 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:10.144323 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-30408207-d269-4c4b-8b00-0f73d71d2993 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:10.145342 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-30408207-d269-4c4b-8b00-0f73d71d2993 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:10.155928 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-30408207-d269-4c4b-8b00-0f73d71d2993 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:10.156723 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-30408207-d269-4c4b-8b00-0f73d71d2993 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:10.157957 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-30408207-d269-4c4b-8b00-0f73d71d2993 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:10.158675 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-30408207-d269-4c4b-8b00-0f73d71d2993 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:10.225331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-30408207-d269-4c4b-8b00-0f73d71d2993 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:10.233546 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-30408207-d269-4c4b-8b00-0f73d71d2993 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.095748 Apr 05 12:16:10.234113 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1745/3513] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:10 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:11.253892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9618f48a-6961-4585-99f2-c0a179ad0e79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:11.254718 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9618f48a-6961-4585-99f2-c0a179ad0e79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:11.264118 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9618f48a-6961-4585-99f2-c0a179ad0e79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:11.264725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9618f48a-6961-4585-99f2-c0a179ad0e79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:11.265893 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9618f48a-6961-4585-99f2-c0a179ad0e79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:11.266491 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9618f48a-6961-4585-99f2-c0a179ad0e79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:11.330802 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9618f48a-6961-4585-99f2-c0a179ad0e79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:11.341197 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9618f48a-6961-4585-99f2-c0a179ad0e79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.093483 Apr 05 12:16:11.341765 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1769/3514] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:11 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:12.362176 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2ee689f0-4cfd-4183-af5f-6bc328558ac4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:12.363275 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2ee689f0-4cfd-4183-af5f-6bc328558ac4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:12.373795 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ee689f0-4cfd-4183-af5f-6bc328558ac4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:12.374542 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ee689f0-4cfd-4183-af5f-6bc328558ac4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:12.376148 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ee689f0-4cfd-4183-af5f-6bc328558ac4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:12.376906 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2ee689f0-4cfd-4183-af5f-6bc328558ac4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:12.441672 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2ee689f0-4cfd-4183-af5f-6bc328558ac4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:12.450101 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2ee689f0-4cfd-4183-af5f-6bc328558ac4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.094369 Apr 05 12:16:12.450671 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1746/3515] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:12 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:13.521002 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d4302b95-3062-44dd-824f-ad7e2529f7ef tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:13.521626 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d4302b95-3062-44dd-824f-ad7e2529f7ef tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:13.528137 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d4302b95-3062-44dd-824f-ad7e2529f7ef tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:13.528630 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d4302b95-3062-44dd-824f-ad7e2529f7ef tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:13.529383 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d4302b95-3062-44dd-824f-ad7e2529f7ef tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:13.529809 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d4302b95-3062-44dd-824f-ad7e2529f7ef tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:13.603523 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d4302b95-3062-44dd-824f-ad7e2529f7ef tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:13.616144 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d4302b95-3062-44dd-824f-ad7e2529f7ef tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.152181 Apr 05 12:16:13.617021 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1770/3516] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:13 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:14.638000 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-80673740-37fe-47c5-8acd-e4495caa3ec3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:14.638749 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-80673740-37fe-47c5-8acd-e4495caa3ec3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:14.647525 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-80673740-37fe-47c5-8acd-e4495caa3ec3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:14.648129 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-80673740-37fe-47c5-8acd-e4495caa3ec3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:14.649174 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-80673740-37fe-47c5-8acd-e4495caa3ec3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:14.649747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-80673740-37fe-47c5-8acd-e4495caa3ec3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:14.722887 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-80673740-37fe-47c5-8acd-e4495caa3ec3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:14.731724 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-80673740-37fe-47c5-8acd-e4495caa3ec3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.100178 Apr 05 12:16:14.732326 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1747/3517] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:14 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:15.748482 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-92a24543-1987-4f50-b5ac-81a1afbf7c11 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:15.749087 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-92a24543-1987-4f50-b5ac-81a1afbf7c11 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:15.756115 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92a24543-1987-4f50-b5ac-81a1afbf7c11 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:15.756594 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92a24543-1987-4f50-b5ac-81a1afbf7c11 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:15.757350 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92a24543-1987-4f50-b5ac-81a1afbf7c11 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:15.757778 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92a24543-1987-4f50-b5ac-81a1afbf7c11 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:15.817438 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-92a24543-1987-4f50-b5ac-81a1afbf7c11 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:15.825579 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-92a24543-1987-4f50-b5ac-81a1afbf7c11 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.081115 Apr 05 12:16:15.826144 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1771/3518] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:15 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:16.843642 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0a0341ca-cb5b-4c75-9747-820a9b26cc99 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:16.844280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0a0341ca-cb5b-4c75-9747-820a9b26cc99 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:16.850908 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0a0341ca-cb5b-4c75-9747-820a9b26cc99 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:16.851353 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0a0341ca-cb5b-4c75-9747-820a9b26cc99 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:16.852148 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0a0341ca-cb5b-4c75-9747-820a9b26cc99 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:16.852738 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0a0341ca-cb5b-4c75-9747-820a9b26cc99 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:16.918217 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0a0341ca-cb5b-4c75-9747-820a9b26cc99 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:16.927316 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0a0341ca-cb5b-4c75-9747-820a9b26cc99 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.087790 Apr 05 12:16:16.927977 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1748/3519] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:16 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:17.131195 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:16:17.131987 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Tue Apr 5 12:16:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:16:17.949537 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-92e48f27-e4ae-43d4-bdb5-a571f522c411 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:17.950398 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-92e48f27-e4ae-43d4-bdb5-a571f522c411 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:17.961121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92e48f27-e4ae-43d4-bdb5-a571f522c411 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:17.961913 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92e48f27-e4ae-43d4-bdb5-a571f522c411 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:17.963109 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92e48f27-e4ae-43d4-bdb5-a571f522c411 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:17.963816 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-92e48f27-e4ae-43d4-bdb5-a571f522c411 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:18.024447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-92e48f27-e4ae-43d4-bdb5-a571f522c411 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:18.032485 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-92e48f27-e4ae-43d4-bdb5-a571f522c411 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.089635 Apr 05 12:16:18.033038 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1772/3520] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:17 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:19.053537 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0807bef4-6b52-4e0b-afc1-ff849e597a79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:19.054548 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0807bef4-6b52-4e0b-afc1-ff849e597a79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:19.065055 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0807bef4-6b52-4e0b-afc1-ff849e597a79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:19.065787 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0807bef4-6b52-4e0b-afc1-ff849e597a79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:19.067022 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0807bef4-6b52-4e0b-afc1-ff849e597a79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:19.067744 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0807bef4-6b52-4e0b-afc1-ff849e597a79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:19.141482 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0807bef4-6b52-4e0b-afc1-ff849e597a79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:19.153610 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0807bef4-6b52-4e0b-afc1-ff849e597a79 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.106451 Apr 05 12:16:19.154393 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1749/3521] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:19 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:20.179104 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5f6aca6b-41f2-41bb-ad67-f471c89f1695 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:20.180156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5f6aca6b-41f2-41bb-ad67-f471c89f1695 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:20.189170 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5f6aca6b-41f2-41bb-ad67-f471c89f1695 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:20.189612 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5f6aca6b-41f2-41bb-ad67-f471c89f1695 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:20.190361 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5f6aca6b-41f2-41bb-ad67-f471c89f1695 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:20.190787 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5f6aca6b-41f2-41bb-ad67-f471c89f1695 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:20.250132 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5f6aca6b-41f2-41bb-ad67-f471c89f1695 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:20.258416 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5f6aca6b-41f2-41bb-ad67-f471c89f1695 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.085975 Apr 05 12:16:20.258997 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1773/3522] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:20 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:21.275339 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3b0f17fb-9c46-4c34-8f49-c31edda4e8b0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:21.275993 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3b0f17fb-9c46-4c34-8f49-c31edda4e8b0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:21.284922 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b0f17fb-9c46-4c34-8f49-c31edda4e8b0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:21.285389 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b0f17fb-9c46-4c34-8f49-c31edda4e8b0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:21.286324 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b0f17fb-9c46-4c34-8f49-c31edda4e8b0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:21.286885 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3b0f17fb-9c46-4c34-8f49-c31edda4e8b0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:21.357021 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3b0f17fb-9c46-4c34-8f49-c31edda4e8b0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:21.365137 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3b0f17fb-9c46-4c34-8f49-c31edda4e8b0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.094159 Apr 05 12:16:21.365713 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1750/3523] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:21 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:22.321579 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-b8b2e423-be8e-4251-aebd-8605ecb8fd28 req-5dd1fdc8-df79-4460-b93f-ddd5d67326bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a3437c-94c0-4133-a629-9386b4639a2d", "name": "network-vif-deleted", "tag": "4b172ae7-f382-4bd9-8d9f-48fd8694b406"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:22.330799 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-b8b2e423-be8e-4251-aebd-8605ecb8fd28 req-5dd1fdc8-df79-4460-b93f-ddd5d67326bf service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:22.331291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-b8b2e423-be8e-4251-aebd-8605ecb8fd28 req-5dd1fdc8-df79-4460-b93f-ddd5d67326bf service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:22.342280 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-b8b2e423-be8e-4251-aebd-8605ecb8fd28 req-5dd1fdc8-df79-4460-b93f-ddd5d67326bf service nova] Creating event network-vif-deleted:4b172ae7-f382-4bd9-8d9f-48fd8694b406 for instance 98a3437c-94c0-4133-a629-9386b4639a2d on hv-cinder-82956 Apr 05 12:16:22.348145 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-b8b2e423-be8e-4251-aebd-8605ecb8fd28 req-5dd1fdc8-df79-4460-b93f-ddd5d67326bf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030496 Apr 05 12:16:22.348746 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1774/3524] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:16:22.382230 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1495ff19-2bc5-4e5f-8984-9413baabf609 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:22.382820 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1495ff19-2bc5-4e5f-8984-9413baabf609 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:22.389314 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1495ff19-2bc5-4e5f-8984-9413baabf609 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:22.390072 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1495ff19-2bc5-4e5f-8984-9413baabf609 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:22.390827 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1495ff19-2bc5-4e5f-8984-9413baabf609 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:22.391251 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1495ff19-2bc5-4e5f-8984-9413baabf609 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:22.456244 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1495ff19-2bc5-4e5f-8984-9413baabf609 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:22.466765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1495ff19-2bc5-4e5f-8984-9413baabf609 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.088217 Apr 05 12:16:22.467596 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1751/3525] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:22 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:23.487396 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5741002e-6c5e-4b3c-bf01-896929102910 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:23.488190 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5741002e-6c5e-4b3c-bf01-896929102910 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:23.495492 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5741002e-6c5e-4b3c-bf01-896929102910 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:23.495985 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5741002e-6c5e-4b3c-bf01-896929102910 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:23.496861 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5741002e-6c5e-4b3c-bf01-896929102910 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:23.497336 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5741002e-6c5e-4b3c-bf01-896929102910 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:23.559893 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5741002e-6c5e-4b3c-bf01-896929102910 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:23.568344 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5741002e-6c5e-4b3c-bf01-896929102910 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.086232 Apr 05 12:16:23.568984 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1775/3526] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:23 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:24.309301 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:16:24.309677 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Tue Apr 5 12:16:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:16:24.590368 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ab1d1995-a788-44e3-878e-6dd460ab15c6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:24.591272 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ab1d1995-a788-44e3-878e-6dd460ab15c6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:24.598646 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab1d1995-a788-44e3-878e-6dd460ab15c6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:24.599087 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab1d1995-a788-44e3-878e-6dd460ab15c6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:24.599837 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab1d1995-a788-44e3-878e-6dd460ab15c6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:24.600302 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ab1d1995-a788-44e3-878e-6dd460ab15c6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:24.660156 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ab1d1995-a788-44e3-878e-6dd460ab15c6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:24.667945 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ab1d1995-a788-44e3-878e-6dd460ab15c6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.084459 Apr 05 12:16:24.668544 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1752/3527] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:24 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:25.692763 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c2719baa-ad16-49b3-bcd2-5a5b85a1e6c9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:25.693656 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c2719baa-ad16-49b3-bcd2-5a5b85a1e6c9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:25.703989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c2719baa-ad16-49b3-bcd2-5a5b85a1e6c9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:25.704548 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c2719baa-ad16-49b3-bcd2-5a5b85a1e6c9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:25.705318 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c2719baa-ad16-49b3-bcd2-5a5b85a1e6c9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:25.705756 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c2719baa-ad16-49b3-bcd2-5a5b85a1e6c9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:25.769820 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c2719baa-ad16-49b3-bcd2-5a5b85a1e6c9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:25.781745 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c2719baa-ad16-49b3-bcd2-5a5b85a1e6c9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.095365 Apr 05 12:16:25.782562 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1776/3528] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:25 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:26.807281 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f46fc947-5f7f-4b48-9b5c-b05f9e675ea5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:26.808204 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f46fc947-5f7f-4b48-9b5c-b05f9e675ea5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:26.816872 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f46fc947-5f7f-4b48-9b5c-b05f9e675ea5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:26.817329 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f46fc947-5f7f-4b48-9b5c-b05f9e675ea5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:26.818097 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f46fc947-5f7f-4b48-9b5c-b05f9e675ea5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:26.818537 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f46fc947-5f7f-4b48-9b5c-b05f9e675ea5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:26.886556 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f46fc947-5f7f-4b48-9b5c-b05f9e675ea5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:26.894701 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f46fc947-5f7f-4b48-9b5c-b05f9e675ea5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.093960 Apr 05 12:16:26.895276 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1753/3529] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:26 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:27.911381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7b5721da-d534-4b32-bc87-4c8e38040ef0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:27.912011 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7b5721da-d534-4b32-bc87-4c8e38040ef0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:27.918653 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b5721da-d534-4b32-bc87-4c8e38040ef0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:27.919105 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b5721da-d534-4b32-bc87-4c8e38040ef0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:27.919868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b5721da-d534-4b32-bc87-4c8e38040ef0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:27.920334 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7b5721da-d534-4b32-bc87-4c8e38040ef0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:27.983976 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7b5721da-d534-4b32-bc87-4c8e38040ef0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:27.993001 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7b5721da-d534-4b32-bc87-4c8e38040ef0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.085491 Apr 05 12:16:27.993576 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1777/3530] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:27 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:29.014766 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-21311938-e473-49d7-aa10-5b7dc1f6911e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:29.015821 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-21311938-e473-49d7-aa10-5b7dc1f6911e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:29.026671 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-21311938-e473-49d7-aa10-5b7dc1f6911e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:29.027416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-21311938-e473-49d7-aa10-5b7dc1f6911e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:29.028723 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-21311938-e473-49d7-aa10-5b7dc1f6911e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:29.029443 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-21311938-e473-49d7-aa10-5b7dc1f6911e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:29.088753 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-21311938-e473-49d7-aa10-5b7dc1f6911e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:29.096793 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-21311938-e473-49d7-aa10-5b7dc1f6911e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.088751 Apr 05 12:16:29.097373 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1754/3531] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:29 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:30.117892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bad6b0cc-8ab3-4daf-a5b2-e3b5ef9ee2df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:30.118935 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bad6b0cc-8ab3-4daf-a5b2-e3b5ef9ee2df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:30.130090 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bad6b0cc-8ab3-4daf-a5b2-e3b5ef9ee2df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:30.130822 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bad6b0cc-8ab3-4daf-a5b2-e3b5ef9ee2df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:30.132050 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bad6b0cc-8ab3-4daf-a5b2-e3b5ef9ee2df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:30.132803 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bad6b0cc-8ab3-4daf-a5b2-e3b5ef9ee2df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:30.196598 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bad6b0cc-8ab3-4daf-a5b2-e3b5ef9ee2df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:30.204463 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bad6b0cc-8ab3-4daf-a5b2-e3b5ef9ee2df tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.093144 Apr 05 12:16:30.205022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1778/3532] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:30 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:31.225002 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8677427b-dd26-43de-ac8d-3e3046f56d5b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:31.226023 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8677427b-dd26-43de-ac8d-3e3046f56d5b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:31.236702 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8677427b-dd26-43de-ac8d-3e3046f56d5b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:31.237447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8677427b-dd26-43de-ac8d-3e3046f56d5b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:31.238687 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8677427b-dd26-43de-ac8d-3e3046f56d5b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:31.239400 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8677427b-dd26-43de-ac8d-3e3046f56d5b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:31.312461 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8677427b-dd26-43de-ac8d-3e3046f56d5b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:31.320838 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8677427b-dd26-43de-ac8d-3e3046f56d5b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.102527 Apr 05 12:16:31.321374 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1755/3533] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:31 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:32.342642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-44ba3591-cb5a-4197-afea-2eb80a6f4e19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:32.343659 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-44ba3591-cb5a-4197-afea-2eb80a6f4e19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:32.354320 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-44ba3591-cb5a-4197-afea-2eb80a6f4e19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:32.355069 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-44ba3591-cb5a-4197-afea-2eb80a6f4e19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:32.356392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-44ba3591-cb5a-4197-afea-2eb80a6f4e19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:32.357117 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-44ba3591-cb5a-4197-afea-2eb80a6f4e19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:32.418756 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-44ba3591-cb5a-4197-afea-2eb80a6f4e19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:32.427136 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-44ba3591-cb5a-4197-afea-2eb80a6f4e19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.091144 Apr 05 12:16:32.427731 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1779/3534] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:32 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:33.445722 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ec1e7ffa-e28c-4653-88fd-6209a63e43e0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:33.446382 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ec1e7ffa-e28c-4653-88fd-6209a63e43e0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:33.453106 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec1e7ffa-e28c-4653-88fd-6209a63e43e0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:33.453530 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec1e7ffa-e28c-4653-88fd-6209a63e43e0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:33.454301 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec1e7ffa-e28c-4653-88fd-6209a63e43e0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:33.454738 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec1e7ffa-e28c-4653-88fd-6209a63e43e0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:33.518034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ec1e7ffa-e28c-4653-88fd-6209a63e43e0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:33.526293 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ec1e7ffa-e28c-4653-88fd-6209a63e43e0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.084540 Apr 05 12:16:33.526869 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1756/3535] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:33 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:34.547579 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fedd0165-b944-4958-8cb4-fa667371ebdd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:34.548632 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fedd0165-b944-4958-8cb4-fa667371ebdd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:34.559305 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fedd0165-b944-4958-8cb4-fa667371ebdd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:34.560049 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fedd0165-b944-4958-8cb4-fa667371ebdd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:34.561355 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fedd0165-b944-4958-8cb4-fa667371ebdd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:34.562075 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fedd0165-b944-4958-8cb4-fa667371ebdd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:34.626531 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fedd0165-b944-4958-8cb4-fa667371ebdd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:34.634519 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fedd0165-b944-4958-8cb4-fa667371ebdd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.093520 Apr 05 12:16:34.635087 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1780/3536] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:34 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:35.655987 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b879ae5b-9dac-4a64-ab5f-f5e32b9f9077 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:35.656994 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b879ae5b-9dac-4a64-ab5f-f5e32b9f9077 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:35.667213 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b879ae5b-9dac-4a64-ab5f-f5e32b9f9077 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:35.667667 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b879ae5b-9dac-4a64-ab5f-f5e32b9f9077 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:35.668463 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b879ae5b-9dac-4a64-ab5f-f5e32b9f9077 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:35.668905 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b879ae5b-9dac-4a64-ab5f-f5e32b9f9077 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:35.729879 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b879ae5b-9dac-4a64-ab5f-f5e32b9f9077 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:35.738323 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b879ae5b-9dac-4a64-ab5f-f5e32b9f9077 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.089047 Apr 05 12:16:35.738898 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1757/3537] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:35 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:36.759302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-71984c8a-4292-4493-a153-02aa49ad35c5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:36.760206 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-71984c8a-4292-4493-a153-02aa49ad35c5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:36.771025 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71984c8a-4292-4493-a153-02aa49ad35c5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:36.771767 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71984c8a-4292-4493-a153-02aa49ad35c5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:36.773092 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71984c8a-4292-4493-a153-02aa49ad35c5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:36.773923 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-71984c8a-4292-4493-a153-02aa49ad35c5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:36.835279 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-71984c8a-4292-4493-a153-02aa49ad35c5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:36.843904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-71984c8a-4292-4493-a153-02aa49ad35c5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.091345 Apr 05 12:16:36.844505 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1781/3538] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:36 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:37.861897 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3f835a79-c664-4177-a39d-93c2898829b1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:37.862559 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3f835a79-c664-4177-a39d-93c2898829b1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:37.870530 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f835a79-c664-4177-a39d-93c2898829b1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:37.871065 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f835a79-c664-4177-a39d-93c2898829b1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:37.872035 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f835a79-c664-4177-a39d-93c2898829b1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:37.872595 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3f835a79-c664-4177-a39d-93c2898829b1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:37.935380 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3f835a79-c664-4177-a39d-93c2898829b1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:37.943768 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3f835a79-c664-4177-a39d-93c2898829b1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.086762 Apr 05 12:16:37.944439 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1758/3539] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:37 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:38.965828 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2e4ce69c-76f5-4129-8bb5-a04ea574c83c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:38.966773 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2e4ce69c-76f5-4129-8bb5-a04ea574c83c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:38.977393 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2e4ce69c-76f5-4129-8bb5-a04ea574c83c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:38.978135 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2e4ce69c-76f5-4129-8bb5-a04ea574c83c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:38.979375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2e4ce69c-76f5-4129-8bb5-a04ea574c83c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:38.980114 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2e4ce69c-76f5-4129-8bb5-a04ea574c83c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:39.049049 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2e4ce69c-76f5-4129-8bb5-a04ea574c83c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:39.057233 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2e4ce69c-76f5-4129-8bb5-a04ea574c83c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.098314 Apr 05 12:16:39.057907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1782/3540] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:38 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:40.074847 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b4f9fdef-ea56-41f5-9b90-f0af6e04fb8c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:40.075506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b4f9fdef-ea56-41f5-9b90-f0af6e04fb8c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:40.082342 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b4f9fdef-ea56-41f5-9b90-f0af6e04fb8c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:40.082786 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b4f9fdef-ea56-41f5-9b90-f0af6e04fb8c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:40.083536 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b4f9fdef-ea56-41f5-9b90-f0af6e04fb8c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:40.083963 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b4f9fdef-ea56-41f5-9b90-f0af6e04fb8c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:40.152184 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b4f9fdef-ea56-41f5-9b90-f0af6e04fb8c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:40.160569 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b4f9fdef-ea56-41f5-9b90-f0af6e04fb8c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.089724 Apr 05 12:16:40.161135 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1759/3541] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:40 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:41.179073 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7bc92110-3ccf-4d57-a0c0-4eb23ab7cb3c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:41.179737 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7bc92110-3ccf-4d57-a0c0-4eb23ab7cb3c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:41.186852 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7bc92110-3ccf-4d57-a0c0-4eb23ab7cb3c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:41.187431 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7bc92110-3ccf-4d57-a0c0-4eb23ab7cb3c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:41.188214 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7bc92110-3ccf-4d57-a0c0-4eb23ab7cb3c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:41.188647 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7bc92110-3ccf-4d57-a0c0-4eb23ab7cb3c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:41.262345 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7bc92110-3ccf-4d57-a0c0-4eb23ab7cb3c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:41.275057 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7bc92110-3ccf-4d57-a0c0-4eb23ab7cb3c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.099783 Apr 05 12:16:41.275834 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1783/3542] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:41 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:42.297577 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3bff664c-db06-438d-a8cd-76c1e46737c8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:42.298255 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3bff664c-db06-438d-a8cd-76c1e46737c8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:42.305782 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3bff664c-db06-438d-a8cd-76c1e46737c8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:42.306274 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3bff664c-db06-438d-a8cd-76c1e46737c8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:42.307113 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3bff664c-db06-438d-a8cd-76c1e46737c8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:42.307593 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3bff664c-db06-438d-a8cd-76c1e46737c8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:42.376200 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3bff664c-db06-438d-a8cd-76c1e46737c8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:42.384507 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3bff664c-db06-438d-a8cd-76c1e46737c8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.093305 Apr 05 12:16:42.385071 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1760/3543] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:42 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:43.406916 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1447696d-46a7-49b2-8117-fc26a731d31d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:43.407895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1447696d-46a7-49b2-8117-fc26a731d31d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:43.415668 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1447696d-46a7-49b2-8117-fc26a731d31d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:43.416236 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1447696d-46a7-49b2-8117-fc26a731d31d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:43.417125 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1447696d-46a7-49b2-8117-fc26a731d31d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:43.417634 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1447696d-46a7-49b2-8117-fc26a731d31d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:43.481624 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1447696d-46a7-49b2-8117-fc26a731d31d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:43.489914 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1447696d-46a7-49b2-8117-fc26a731d31d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.089702 Apr 05 12:16:43.490491 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1784/3544] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:43 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:44.511608 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7758135a-fab1-4e27-b667-c3c19767f0d2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:44.512701 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7758135a-fab1-4e27-b667-c3c19767f0d2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:44.521843 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7758135a-fab1-4e27-b667-c3c19767f0d2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:44.522292 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7758135a-fab1-4e27-b667-c3c19767f0d2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:44.523058 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7758135a-fab1-4e27-b667-c3c19767f0d2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:44.523495 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7758135a-fab1-4e27-b667-c3c19767f0d2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:44.583668 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7758135a-fab1-4e27-b667-c3c19767f0d2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:44.592103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7758135a-fab1-4e27-b667-c3c19767f0d2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.087265 Apr 05 12:16:44.592729 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1761/3545] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:44 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:45.614294 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e182bd4c-fc55-482e-99d2-c5d82e635885 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:45.615279 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e182bd4c-fc55-482e-99d2-c5d82e635885 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:45.627492 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e182bd4c-fc55-482e-99d2-c5d82e635885 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:45.628326 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e182bd4c-fc55-482e-99d2-c5d82e635885 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:45.629531 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e182bd4c-fc55-482e-99d2-c5d82e635885 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:45.630004 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e182bd4c-fc55-482e-99d2-c5d82e635885 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:45.691199 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e182bd4c-fc55-482e-99d2-c5d82e635885 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:45.699642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e182bd4c-fc55-482e-99d2-c5d82e635885 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.092593 Apr 05 12:16:45.700207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1785/3546] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:45 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:46.720149 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-10ffb4f1-053b-45ca-b62e-8886c7712923 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:46.721190 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-10ffb4f1-053b-45ca-b62e-8886c7712923 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:46.731953 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-10ffb4f1-053b-45ca-b62e-8886c7712923 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:46.732759 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-10ffb4f1-053b-45ca-b62e-8886c7712923 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:46.734018 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-10ffb4f1-053b-45ca-b62e-8886c7712923 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:46.734708 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-10ffb4f1-053b-45ca-b62e-8886c7712923 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:46.799526 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-10ffb4f1-053b-45ca-b62e-8886c7712923 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:46.807605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-10ffb4f1-053b-45ca-b62e-8886c7712923 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.093856 Apr 05 12:16:46.808208 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1762/3547] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:46 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:47.824159 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-40e1de1c-3961-455d-80ea-1fd4359070e3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:47.824730 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-40e1de1c-3961-455d-80ea-1fd4359070e3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:47.831351 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-40e1de1c-3961-455d-80ea-1fd4359070e3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:47.831816 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-40e1de1c-3961-455d-80ea-1fd4359070e3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:47.832609 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-40e1de1c-3961-455d-80ea-1fd4359070e3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:47.833044 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-40e1de1c-3961-455d-80ea-1fd4359070e3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:47.893312 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-40e1de1c-3961-455d-80ea-1fd4359070e3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:47.901369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-40e1de1c-3961-455d-80ea-1fd4359070e3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.081234 Apr 05 12:16:47.901931 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1786/3548] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:47 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:48.922751 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-096e758d-82a7-47e7-9451-683823798b19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:48.923641 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-096e758d-82a7-47e7-9451-683823798b19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:48.931556 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-096e758d-82a7-47e7-9451-683823798b19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:48.931999 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-096e758d-82a7-47e7-9451-683823798b19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:48.932784 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-096e758d-82a7-47e7-9451-683823798b19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:48.933212 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-096e758d-82a7-47e7-9451-683823798b19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:48.992583 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-096e758d-82a7-47e7-9451-683823798b19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:49.000876 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-096e758d-82a7-47e7-9451-683823798b19 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.084781 Apr 05 12:16:49.001442 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1763/3549] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:48 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:50.021694 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a39d73bb-2695-4f86-af75-8576b5ad6835 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:50.022652 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a39d73bb-2695-4f86-af75-8576b5ad6835 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:50.033685 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a39d73bb-2695-4f86-af75-8576b5ad6835 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:50.034417 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a39d73bb-2695-4f86-af75-8576b5ad6835 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:50.035708 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a39d73bb-2695-4f86-af75-8576b5ad6835 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:50.036483 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a39d73bb-2695-4f86-af75-8576b5ad6835 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:50.097304 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a39d73bb-2695-4f86-af75-8576b5ad6835 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:50.105959 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a39d73bb-2695-4f86-af75-8576b5ad6835 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.090756 Apr 05 12:16:50.106529 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1787/3550] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:50 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:51.127915 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7e08a972-6739-494e-9673-7f9f04a625fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:51.128889 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7e08a972-6739-494e-9673-7f9f04a625fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:51.139514 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7e08a972-6739-494e-9673-7f9f04a625fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:51.140340 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7e08a972-6739-494e-9673-7f9f04a625fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:51.141614 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7e08a972-6739-494e-9673-7f9f04a625fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:51.142333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7e08a972-6739-494e-9673-7f9f04a625fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:51.203685 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7e08a972-6739-494e-9673-7f9f04a625fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:51.211886 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7e08a972-6739-494e-9673-7f9f04a625fd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.091032 Apr 05 12:16:51.212511 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1764/3551] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:51 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:52.233082 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8ec3b927-7259-4cd5-ae7e-5bfe5d2e9629 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:52.234121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8ec3b927-7259-4cd5-ae7e-5bfe5d2e9629 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:52.244794 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8ec3b927-7259-4cd5-ae7e-5bfe5d2e9629 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:52.245543 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8ec3b927-7259-4cd5-ae7e-5bfe5d2e9629 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:52.246798 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8ec3b927-7259-4cd5-ae7e-5bfe5d2e9629 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:52.247521 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8ec3b927-7259-4cd5-ae7e-5bfe5d2e9629 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:52.325358 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8ec3b927-7259-4cd5-ae7e-5bfe5d2e9629 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:52.336822 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8ec3b927-7259-4cd5-ae7e-5bfe5d2e9629 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.110109 Apr 05 12:16:52.337449 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1788/3552] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:52 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:53.362421 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b6d2760e-b605-4cc0-b028-d3c15a56702d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:53.363411 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b6d2760e-b605-4cc0-b028-d3c15a56702d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:53.371393 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b6d2760e-b605-4cc0-b028-d3c15a56702d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:53.371829 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b6d2760e-b605-4cc0-b028-d3c15a56702d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:53.372643 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b6d2760e-b605-4cc0-b028-d3c15a56702d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:53.373052 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b6d2760e-b605-4cc0-b028-d3c15a56702d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:53.435181 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b6d2760e-b605-4cc0-b028-d3c15a56702d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:53.443315 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b6d2760e-b605-4cc0-b028-d3c15a56702d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.087540 Apr 05 12:16:53.443880 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1765/3553] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:53 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:54.459555 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0425ee65-699e-4d8f-b4aa-3317df7d467f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:54.460199 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0425ee65-699e-4d8f-b4aa-3317df7d467f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:54.467223 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0425ee65-699e-4d8f-b4aa-3317df7d467f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:54.467667 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0425ee65-699e-4d8f-b4aa-3317df7d467f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:54.468437 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0425ee65-699e-4d8f-b4aa-3317df7d467f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:54.468867 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0425ee65-699e-4d8f-b4aa-3317df7d467f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:54.528608 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0425ee65-699e-4d8f-b4aa-3317df7d467f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:54.537104 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0425ee65-699e-4d8f-b4aa-3317df7d467f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.081508 Apr 05 12:16:54.537653 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1789/3554] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:54 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:55.557631 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-abc715dc-ce86-4f15-b82f-8f3a7c6c266f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:55.558522 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-abc715dc-ce86-4f15-b82f-8f3a7c6c266f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:55.568612 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-abc715dc-ce86-4f15-b82f-8f3a7c6c266f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:55.569348 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-abc715dc-ce86-4f15-b82f-8f3a7c6c266f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:55.570583 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-abc715dc-ce86-4f15-b82f-8f3a7c6c266f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:55.571292 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-abc715dc-ce86-4f15-b82f-8f3a7c6c266f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:55.637644 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-abc715dc-ce86-4f15-b82f-8f3a7c6c266f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:55.645967 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-abc715dc-ce86-4f15-b82f-8f3a7c6c266f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.094750 Apr 05 12:16:55.646536 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1766/3555] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:55 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:56.667282 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f56ab8c8-e715-43fb-9c7b-f0ce2a356084 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:56.668331 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f56ab8c8-e715-43fb-9c7b-f0ce2a356084 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:56.678925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f56ab8c8-e715-43fb-9c7b-f0ce2a356084 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:56.679682 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f56ab8c8-e715-43fb-9c7b-f0ce2a356084 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:56.680983 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f56ab8c8-e715-43fb-9c7b-f0ce2a356084 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:56.681720 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f56ab8c8-e715-43fb-9c7b-f0ce2a356084 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:56.754167 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f56ab8c8-e715-43fb-9c7b-f0ce2a356084 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:56.762520 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f56ab8c8-e715-43fb-9c7b-f0ce2a356084 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.101981 Apr 05 12:16:56.763095 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1790/3556] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:56 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:57.783456 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-28bbb43c-e159-4c12-9689-410a41cad2c7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:57.785497 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-28bbb43c-e159-4c12-9689-410a41cad2c7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:57.796313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-28bbb43c-e159-4c12-9689-410a41cad2c7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:57.797139 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-28bbb43c-e159-4c12-9689-410a41cad2c7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:57.798433 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-28bbb43c-e159-4c12-9689-410a41cad2c7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:57.799048 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-28bbb43c-e159-4c12-9689-410a41cad2c7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:57.861729 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-28bbb43c-e159-4c12-9689-410a41cad2c7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:57.870243 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-28bbb43c-e159-4c12-9689-410a41cad2c7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.093272 Apr 05 12:16:57.870810 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1767/3557] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:57 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:58.889882 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b738709e-5b03-41fd-8218-f0a182c4687b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:58.890556 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b738709e-5b03-41fd-8218-f0a182c4687b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:16:58.898284 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b738709e-5b03-41fd-8218-f0a182c4687b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:58.898812 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b738709e-5b03-41fd-8218-f0a182c4687b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:58.899733 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b738709e-5b03-41fd-8218-f0a182c4687b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:16:58.900280 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b738709e-5b03-41fd-8218-f0a182c4687b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:16:58.963267 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b738709e-5b03-41fd-8218-f0a182c4687b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:16:58.971597 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b738709e-5b03-41fd-8218-f0a182c4687b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.087078 Apr 05 12:16:58.972190 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1791/3558] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:58 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:59.993029 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-826a7b0e-6c67-4e70-b33e-6d292e3cdf15 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:16:59.993946 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-826a7b0e-6c67-4e70-b33e-6d292e3cdf15 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:00.001865 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-826a7b0e-6c67-4e70-b33e-6d292e3cdf15 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:00.002310 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-826a7b0e-6c67-4e70-b33e-6d292e3cdf15 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:00.003069 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-826a7b0e-6c67-4e70-b33e-6d292e3cdf15 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:00.003498 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-826a7b0e-6c67-4e70-b33e-6d292e3cdf15 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:00.065738 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-826a7b0e-6c67-4e70-b33e-6d292e3cdf15 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:00.073923 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-826a7b0e-6c67-4e70-b33e-6d292e3cdf15 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.087415 Apr 05 12:17:00.074503 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1768/3559] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:16:59 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:01.094966 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9befe353-a28f-423f-b5c4-0925644e173b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:01.095932 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9befe353-a28f-423f-b5c4-0925644e173b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:01.106479 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9befe353-a28f-423f-b5c4-0925644e173b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:01.106926 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9befe353-a28f-423f-b5c4-0925644e173b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:01.107684 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9befe353-a28f-423f-b5c4-0925644e173b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:01.108107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9befe353-a28f-423f-b5c4-0925644e173b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:01.177914 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9befe353-a28f-423f-b5c4-0925644e173b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:01.185885 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9befe353-a28f-423f-b5c4-0925644e173b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.097499 Apr 05 12:17:01.186446 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1792/3560] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:01 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:02.208042 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8db5a17e-f1d7-4b2f-b0c5-f7c4725b2057 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:02.209017 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8db5a17e-f1d7-4b2f-b0c5-f7c4725b2057 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:02.218691 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8db5a17e-f1d7-4b2f-b0c5-f7c4725b2057 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:02.219139 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8db5a17e-f1d7-4b2f-b0c5-f7c4725b2057 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:02.219888 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8db5a17e-f1d7-4b2f-b0c5-f7c4725b2057 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:02.220358 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8db5a17e-f1d7-4b2f-b0c5-f7c4725b2057 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:02.281198 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8db5a17e-f1d7-4b2f-b0c5-f7c4725b2057 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:02.289604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8db5a17e-f1d7-4b2f-b0c5-f7c4725b2057 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.088538 Apr 05 12:17:02.290167 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1769/3561] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:02 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:03.310943 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f745bae3-115a-4217-a0bd-73bb72b6b66b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:03.311991 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f745bae3-115a-4217-a0bd-73bb72b6b66b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:03.322029 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f745bae3-115a-4217-a0bd-73bb72b6b66b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:03.322767 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f745bae3-115a-4217-a0bd-73bb72b6b66b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:03.324012 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f745bae3-115a-4217-a0bd-73bb72b6b66b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:03.324767 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f745bae3-115a-4217-a0bd-73bb72b6b66b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:03.388255 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f745bae3-115a-4217-a0bd-73bb72b6b66b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:03.397237 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f745bae3-115a-4217-a0bd-73bb72b6b66b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.092915 Apr 05 12:17:03.397807 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1793/3562] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:03 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:04.418487 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d70258b6-85ec-4c5b-a706-382c4c82853b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:04.419498 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d70258b6-85ec-4c5b-a706-382c4c82853b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:04.429865 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d70258b6-85ec-4c5b-a706-382c4c82853b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:04.430599 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d70258b6-85ec-4c5b-a706-382c4c82853b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:04.431833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d70258b6-85ec-4c5b-a706-382c4c82853b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:04.432589 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d70258b6-85ec-4c5b-a706-382c4c82853b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:04.496353 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d70258b6-85ec-4c5b-a706-382c4c82853b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:04.505375 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d70258b6-85ec-4c5b-a706-382c4c82853b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.093477 Apr 05 12:17:04.505943 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1770/3563] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:04 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:05.524649 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-20918b89-7b2a-457e-b945-bf7e6501600c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:05.525296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-20918b89-7b2a-457e-b945-bf7e6501600c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:05.532434 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-20918b89-7b2a-457e-b945-bf7e6501600c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:05.532880 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-20918b89-7b2a-457e-b945-bf7e6501600c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:05.533651 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-20918b89-7b2a-457e-b945-bf7e6501600c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:05.534068 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-20918b89-7b2a-457e-b945-bf7e6501600c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:05.605696 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-20918b89-7b2a-457e-b945-bf7e6501600c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:05.618579 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-20918b89-7b2a-457e-b945-bf7e6501600c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.098842 Apr 05 12:17:05.619459 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1794/3564] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:05 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:06.643865 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e2129e81-bc5f-49f3-b074-e98c5c1b6466 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:06.644935 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e2129e81-bc5f-49f3-b074-e98c5c1b6466 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:06.655844 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e2129e81-bc5f-49f3-b074-e98c5c1b6466 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:06.656609 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e2129e81-bc5f-49f3-b074-e98c5c1b6466 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:06.657862 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e2129e81-bc5f-49f3-b074-e98c5c1b6466 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:06.658582 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e2129e81-bc5f-49f3-b074-e98c5c1b6466 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:06.721322 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e2129e81-bc5f-49f3-b074-e98c5c1b6466 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:06.733431 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e2129e81-bc5f-49f3-b074-e98c5c1b6466 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.095726 Apr 05 12:17:06.734243 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1771/3565] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:06 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:07.757556 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-081cab5c-02fe-4756-8557-dd11bcaedd3c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:07.758564 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-081cab5c-02fe-4756-8557-dd11bcaedd3c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:07.769162 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-081cab5c-02fe-4756-8557-dd11bcaedd3c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:07.769897 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-081cab5c-02fe-4756-8557-dd11bcaedd3c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:07.771132 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-081cab5c-02fe-4756-8557-dd11bcaedd3c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:07.771835 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-081cab5c-02fe-4756-8557-dd11bcaedd3c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:07.832251 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-081cab5c-02fe-4756-8557-dd11bcaedd3c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:07.840448 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-081cab5c-02fe-4756-8557-dd11bcaedd3c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.089392 Apr 05 12:17:07.841110 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1795/3566] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:07 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:08.861435 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6b2b0bbe-1354-49a4-8fc9-24f3ba056fd8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:08.862316 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6b2b0bbe-1354-49a4-8fc9-24f3ba056fd8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:08.873232 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6b2b0bbe-1354-49a4-8fc9-24f3ba056fd8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:08.874025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6b2b0bbe-1354-49a4-8fc9-24f3ba056fd8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:08.875609 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6b2b0bbe-1354-49a4-8fc9-24f3ba056fd8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:08.876386 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6b2b0bbe-1354-49a4-8fc9-24f3ba056fd8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:08.938060 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6b2b0bbe-1354-49a4-8fc9-24f3ba056fd8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:08.946435 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6b2b0bbe-1354-49a4-8fc9-24f3ba056fd8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.091586 Apr 05 12:17:08.947016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1772/3567] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:08 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:09.967936 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3f8c5723-b8fb-4f51-8aa7-20f2f01721c8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:09.968934 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3f8c5723-b8fb-4f51-8aa7-20f2f01721c8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:09.979170 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f8c5723-b8fb-4f51-8aa7-20f2f01721c8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:09.979926 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f8c5723-b8fb-4f51-8aa7-20f2f01721c8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:09.981241 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f8c5723-b8fb-4f51-8aa7-20f2f01721c8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:09.981970 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f8c5723-b8fb-4f51-8aa7-20f2f01721c8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:10.051352 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3f8c5723-b8fb-4f51-8aa7-20f2f01721c8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:10.059677 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3f8c5723-b8fb-4f51-8aa7-20f2f01721c8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.098544 Apr 05 12:17:10.060267 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1796/3568] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:09 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:11.076797 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3bfd9903-83de-4c12-a647-6dc992a42e84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:11.077325 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3bfd9903-83de-4c12-a647-6dc992a42e84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:11.083921 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3bfd9903-83de-4c12-a647-6dc992a42e84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:11.084410 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3bfd9903-83de-4c12-a647-6dc992a42e84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:11.085175 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3bfd9903-83de-4c12-a647-6dc992a42e84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:11.085615 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3bfd9903-83de-4c12-a647-6dc992a42e84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:11.144331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3bfd9903-83de-4c12-a647-6dc992a42e84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:11.152276 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3bfd9903-83de-4c12-a647-6dc992a42e84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.079355 Apr 05 12:17:11.152843 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1773/3569] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:11 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:12.173260 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e2127980-7d8a-4ea2-b03c-958aeb0b7946 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:12.174283 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e2127980-7d8a-4ea2-b03c-958aeb0b7946 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:12.183011 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e2127980-7d8a-4ea2-b03c-958aeb0b7946 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:12.183454 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e2127980-7d8a-4ea2-b03c-958aeb0b7946 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:12.184229 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e2127980-7d8a-4ea2-b03c-958aeb0b7946 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:12.184663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e2127980-7d8a-4ea2-b03c-958aeb0b7946 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:12.245254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e2127980-7d8a-4ea2-b03c-958aeb0b7946 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:12.253367 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e2127980-7d8a-4ea2-b03c-958aeb0b7946 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.086599 Apr 05 12:17:12.253925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1797/3570] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:12 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:13.275674 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-00b6978b-0d9d-4ef1-9998-b4007ad65a43 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:13.276677 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-00b6978b-0d9d-4ef1-9998-b4007ad65a43 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:13.287324 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00b6978b-0d9d-4ef1-9998-b4007ad65a43 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:13.288116 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00b6978b-0d9d-4ef1-9998-b4007ad65a43 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:13.289458 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00b6978b-0d9d-4ef1-9998-b4007ad65a43 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:13.289891 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00b6978b-0d9d-4ef1-9998-b4007ad65a43 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:13.350690 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-00b6978b-0d9d-4ef1-9998-b4007ad65a43 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:13.358814 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-00b6978b-0d9d-4ef1-9998-b4007ad65a43 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.089563 Apr 05 12:17:13.359398 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1774/3571] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:13 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:14.380261 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-071063d2-a980-4f66-b109-e707feedf0e3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:14.381230 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-071063d2-a980-4f66-b109-e707feedf0e3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:14.391633 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-071063d2-a980-4f66-b109-e707feedf0e3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:14.392430 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-071063d2-a980-4f66-b109-e707feedf0e3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:14.393671 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-071063d2-a980-4f66-b109-e707feedf0e3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:14.394376 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-071063d2-a980-4f66-b109-e707feedf0e3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:14.454669 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-071063d2-a980-4f66-b109-e707feedf0e3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:14.463012 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-071063d2-a980-4f66-b109-e707feedf0e3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.089589 Apr 05 12:17:14.463586 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1798/3572] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:14 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:15.481575 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-416edce7-f05d-4943-86e1-8a88c1b27601 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:15.482228 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-416edce7-f05d-4943-86e1-8a88c1b27601 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:15.490148 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-416edce7-f05d-4943-86e1-8a88c1b27601 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:15.490687 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-416edce7-f05d-4943-86e1-8a88c1b27601 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:15.491629 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-416edce7-f05d-4943-86e1-8a88c1b27601 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:15.492204 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-416edce7-f05d-4943-86e1-8a88c1b27601 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:15.554467 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-416edce7-f05d-4943-86e1-8a88c1b27601 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:15.562643 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-416edce7-f05d-4943-86e1-8a88c1b27601 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.085875 Apr 05 12:17:15.563220 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1775/3573] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:15 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:16.583739 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b9e4a496-39a5-4210-b920-398f1fd9f0c4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:16.584787 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b9e4a496-39a5-4210-b920-398f1fd9f0c4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:16.592291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9e4a496-39a5-4210-b920-398f1fd9f0c4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:16.592765 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9e4a496-39a5-4210-b920-398f1fd9f0c4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:16.593565 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9e4a496-39a5-4210-b920-398f1fd9f0c4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:16.594017 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b9e4a496-39a5-4210-b920-398f1fd9f0c4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:16.658375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b9e4a496-39a5-4210-b920-398f1fd9f0c4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:16.667817 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b9e4a496-39a5-4210-b920-398f1fd9f0c4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.090243 Apr 05 12:17:16.668450 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1799/3574] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:16 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:17.688865 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-610b318f-a6c0-43d4-ac79-c606aa84c990 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:17.689715 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-610b318f-a6c0-43d4-ac79-c606aa84c990 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:17.698365 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-610b318f-a6c0-43d4-ac79-c606aa84c990 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:17.698818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-610b318f-a6c0-43d4-ac79-c606aa84c990 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:17.699604 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-610b318f-a6c0-43d4-ac79-c606aa84c990 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:17.700098 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-610b318f-a6c0-43d4-ac79-c606aa84c990 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:17.769922 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-610b318f-a6c0-43d4-ac79-c606aa84c990 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:17.778046 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-610b318f-a6c0-43d4-ac79-c606aa84c990 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.095778 Apr 05 12:17:17.778620 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1776/3575] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:17 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:18.799281 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fd231096-8194-41e8-81df-a04bbb2a44e6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:18.800221 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fd231096-8194-41e8-81df-a04bbb2a44e6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:18.808588 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fd231096-8194-41e8-81df-a04bbb2a44e6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:18.809041 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fd231096-8194-41e8-81df-a04bbb2a44e6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:18.809802 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fd231096-8194-41e8-81df-a04bbb2a44e6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:18.810244 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fd231096-8194-41e8-81df-a04bbb2a44e6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:18.870238 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fd231096-8194-41e8-81df-a04bbb2a44e6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:18.878417 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fd231096-8194-41e8-81df-a04bbb2a44e6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.085966 Apr 05 12:17:18.878979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1800/3576] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:18 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:19.895382 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fecec34b-4e0d-42a6-b0bd-07349bea3a5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:19.896113 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fecec34b-4e0d-42a6-b0bd-07349bea3a5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:19.902528 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fecec34b-4e0d-42a6-b0bd-07349bea3a5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:19.902966 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fecec34b-4e0d-42a6-b0bd-07349bea3a5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:19.903703 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fecec34b-4e0d-42a6-b0bd-07349bea3a5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:19.904166 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fecec34b-4e0d-42a6-b0bd-07349bea3a5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:19.967894 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fecec34b-4e0d-42a6-b0bd-07349bea3a5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:19.976164 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fecec34b-4e0d-42a6-b0bd-07349bea3a5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.084685 Apr 05 12:17:19.976880 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1777/3577] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:19 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:20.994628 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-583192b0-61f8-488a-9e5c-9b390940d00c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:20.995429 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-583192b0-61f8-488a-9e5c-9b390940d00c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:21.004443 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-583192b0-61f8-488a-9e5c-9b390940d00c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:21.005044 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-583192b0-61f8-488a-9e5c-9b390940d00c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:21.006058 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-583192b0-61f8-488a-9e5c-9b390940d00c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:21.006638 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-583192b0-61f8-488a-9e5c-9b390940d00c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:21.068921 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-583192b0-61f8-488a-9e5c-9b390940d00c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:21.076864 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-583192b0-61f8-488a-9e5c-9b390940d00c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.086824 Apr 05 12:17:21.077430 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1801/3578] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:20 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:22.101112 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ffbfa9d7-3bf9-428e-bca0-7b8e2ba50180 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:22.102142 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ffbfa9d7-3bf9-428e-bca0-7b8e2ba50180 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:22.109817 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ffbfa9d7-3bf9-428e-bca0-7b8e2ba50180 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:22.110335 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ffbfa9d7-3bf9-428e-bca0-7b8e2ba50180 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:22.111203 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ffbfa9d7-3bf9-428e-bca0-7b8e2ba50180 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:22.111705 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ffbfa9d7-3bf9-428e-bca0-7b8e2ba50180 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:22.181677 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ffbfa9d7-3bf9-428e-bca0-7b8e2ba50180 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:22.190003 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ffbfa9d7-3bf9-428e-bca0-7b8e2ba50180 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.095619 Apr 05 12:17:22.190613 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1778/3579] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:22 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:23.210819 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a59da999-384e-4d18-9a43-d885afa11e46 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:23.211837 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a59da999-384e-4d18-9a43-d885afa11e46 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:23.218876 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a59da999-384e-4d18-9a43-d885afa11e46 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:23.219324 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a59da999-384e-4d18-9a43-d885afa11e46 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:23.220096 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a59da999-384e-4d18-9a43-d885afa11e46 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:23.220536 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a59da999-384e-4d18-9a43-d885afa11e46 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:23.281040 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a59da999-384e-4d18-9a43-d885afa11e46 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:23.289155 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a59da999-384e-4d18-9a43-d885afa11e46 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.084841 Apr 05 12:17:23.289721 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1802/3580] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:23 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:24.310457 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bce40814-9b17-4974-ae10-3a99c5b3ec5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:24.311441 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bce40814-9b17-4974-ae10-3a99c5b3ec5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:24.321979 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bce40814-9b17-4974-ae10-3a99c5b3ec5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:24.322434 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bce40814-9b17-4974-ae10-3a99c5b3ec5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:24.323203 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bce40814-9b17-4974-ae10-3a99c5b3ec5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:24.323638 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bce40814-9b17-4974-ae10-3a99c5b3ec5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:24.383514 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-bce40814-9b17-4974-ae10-3a99c5b3ec5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:24.391380 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bce40814-9b17-4974-ae10-3a99c5b3ec5d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.087645 Apr 05 12:17:24.391982 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1779/3581] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:24 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:25.413429 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a227ae20-5aed-4548-afe6-8d5674b0f162 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:25.414433 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a227ae20-5aed-4548-afe6-8d5674b0f162 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:25.425248 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a227ae20-5aed-4548-afe6-8d5674b0f162 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:25.426004 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a227ae20-5aed-4548-afe6-8d5674b0f162 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:25.427255 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a227ae20-5aed-4548-afe6-8d5674b0f162 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:25.427935 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a227ae20-5aed-4548-afe6-8d5674b0f162 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:25.489292 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a227ae20-5aed-4548-afe6-8d5674b0f162 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:25.497847 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a227ae20-5aed-4548-afe6-8d5674b0f162 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.091044 Apr 05 12:17:25.498422 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1803/3582] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:25 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:26.515372 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9e3b664d-d13e-47ce-bf9a-2f9174a4145f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:26.516066 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9e3b664d-d13e-47ce-bf9a-2f9174a4145f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:26.523581 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9e3b664d-d13e-47ce-bf9a-2f9174a4145f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:26.524103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9e3b664d-d13e-47ce-bf9a-2f9174a4145f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:26.525088 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9e3b664d-d13e-47ce-bf9a-2f9174a4145f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:26.525525 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9e3b664d-d13e-47ce-bf9a-2f9174a4145f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:26.596223 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9e3b664d-d13e-47ce-bf9a-2f9174a4145f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:26.606676 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9e3b664d-d13e-47ce-bf9a-2f9174a4145f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.095636 Apr 05 12:17:26.607241 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1780/3583] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:26 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:27.628750 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d7f475bb-7de6-46ad-8a62-a310ba7d81dc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:27.629311 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d7f475bb-7de6-46ad-8a62-a310ba7d81dc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:27.638118 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d7f475bb-7de6-46ad-8a62-a310ba7d81dc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:27.638841 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d7f475bb-7de6-46ad-8a62-a310ba7d81dc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:27.640122 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d7f475bb-7de6-46ad-8a62-a310ba7d81dc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:27.640723 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d7f475bb-7de6-46ad-8a62-a310ba7d81dc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:27.705543 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d7f475bb-7de6-46ad-8a62-a310ba7d81dc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:27.713596 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d7f475bb-7de6-46ad-8a62-a310ba7d81dc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.090487 Apr 05 12:17:27.714159 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1804/3584] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:27 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:28.734821 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4a069c71-451e-4676-be04-9818ad1fddf8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:28.735769 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4a069c71-451e-4676-be04-9818ad1fddf8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:28.746101 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4a069c71-451e-4676-be04-9818ad1fddf8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:28.746488 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4a069c71-451e-4676-be04-9818ad1fddf8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:28.747267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4a069c71-451e-4676-be04-9818ad1fddf8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:28.747703 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4a069c71-451e-4676-be04-9818ad1fddf8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:28.807851 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4a069c71-451e-4676-be04-9818ad1fddf8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:28.815947 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4a069c71-451e-4676-be04-9818ad1fddf8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.087662 Apr 05 12:17:28.816785 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1781/3585] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:28 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:29.838889 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c07cf062-4d33-4c64-80fd-226a10eb7198 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:29.839902 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c07cf062-4d33-4c64-80fd-226a10eb7198 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:29.850836 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c07cf062-4d33-4c64-80fd-226a10eb7198 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:29.851579 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c07cf062-4d33-4c64-80fd-226a10eb7198 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:29.852984 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c07cf062-4d33-4c64-80fd-226a10eb7198 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:29.853747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c07cf062-4d33-4c64-80fd-226a10eb7198 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:29.916917 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c07cf062-4d33-4c64-80fd-226a10eb7198 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:29.925107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c07cf062-4d33-4c64-80fd-226a10eb7198 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.092674 Apr 05 12:17:29.925664 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1805/3586] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:29 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:30.946804 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8608a72a-b557-42c3-b40d-30c9c11bdac2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:30.947728 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8608a72a-b557-42c3-b40d-30c9c11bdac2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:30.960983 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8608a72a-b557-42c3-b40d-30c9c11bdac2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:30.961741 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8608a72a-b557-42c3-b40d-30c9c11bdac2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:30.962998 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8608a72a-b557-42c3-b40d-30c9c11bdac2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:30.963751 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8608a72a-b557-42c3-b40d-30c9c11bdac2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:31.027701 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8608a72a-b557-42c3-b40d-30c9c11bdac2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:31.039469 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8608a72a-b557-42c3-b40d-30c9c11bdac2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.099273 Apr 05 12:17:31.040315 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1782/3587] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:30 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:32.061174 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7c8ce84a-6504-411d-9d9f-62929733a54e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:32.062152 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7c8ce84a-6504-411d-9d9f-62929733a54e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:32.073165 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7c8ce84a-6504-411d-9d9f-62929733a54e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:32.073607 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7c8ce84a-6504-411d-9d9f-62929733a54e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:32.074364 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7c8ce84a-6504-411d-9d9f-62929733a54e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:32.074786 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7c8ce84a-6504-411d-9d9f-62929733a54e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:32.141093 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7c8ce84a-6504-411d-9d9f-62929733a54e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:32.149231 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7c8ce84a-6504-411d-9d9f-62929733a54e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.094584 Apr 05 12:17:32.149804 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1806/3588] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:32 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:33.170543 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-000dd844-1dd6-4037-843e-d1d2f14b53a2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:33.171508 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-000dd844-1dd6-4037-843e-d1d2f14b53a2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:33.182379 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-000dd844-1dd6-4037-843e-d1d2f14b53a2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:33.182823 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-000dd844-1dd6-4037-843e-d1d2f14b53a2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:33.183582 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-000dd844-1dd6-4037-843e-d1d2f14b53a2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:33.184016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-000dd844-1dd6-4037-843e-d1d2f14b53a2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:33.244500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-000dd844-1dd6-4037-843e-d1d2f14b53a2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:33.252826 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-000dd844-1dd6-4037-843e-d1d2f14b53a2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.088948 Apr 05 12:17:33.253390 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1783/3589] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:33 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:33.780770 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:17:33.781127 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Tue Apr 5 12:17:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:17:34.274014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2d29a1f6-a24f-4ce4-991c-41e6c0af216e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:34.274673 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2d29a1f6-a24f-4ce4-991c-41e6c0af216e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:34.282177 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2d29a1f6-a24f-4ce4-991c-41e6c0af216e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:34.282624 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2d29a1f6-a24f-4ce4-991c-41e6c0af216e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:34.283380 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2d29a1f6-a24f-4ce4-991c-41e6c0af216e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:34.283805 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2d29a1f6-a24f-4ce4-991c-41e6c0af216e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:34.482118 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2d29a1f6-a24f-4ce4-991c-41e6c0af216e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:34.490166 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2d29a1f6-a24f-4ce4-991c-41e6c0af216e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.220626 Apr 05 12:17:34.490737 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1807/3590] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:34 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:35.514001 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9dbd39f9-8a59-4eba-9a33-961cb153a132 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:35.514829 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9dbd39f9-8a59-4eba-9a33-961cb153a132 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:35.521547 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9dbd39f9-8a59-4eba-9a33-961cb153a132 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:35.521997 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9dbd39f9-8a59-4eba-9a33-961cb153a132 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:35.522755 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9dbd39f9-8a59-4eba-9a33-961cb153a132 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:35.523184 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9dbd39f9-8a59-4eba-9a33-961cb153a132 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:35.638440 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9dbd39f9-8a59-4eba-9a33-961cb153a132 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:35.646605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9dbd39f9-8a59-4eba-9a33-961cb153a132 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.139303 Apr 05 12:17:35.647156 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1784/3591] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:35 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:36.667655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-13260e54-73b9-45e4-a3f5-c3264006990e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:36.668732 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-13260e54-73b9-45e4-a3f5-c3264006990e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:36.679374 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-13260e54-73b9-45e4-a3f5-c3264006990e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:36.680163 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-13260e54-73b9-45e4-a3f5-c3264006990e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:36.681429 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-13260e54-73b9-45e4-a3f5-c3264006990e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:36.682149 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-13260e54-73b9-45e4-a3f5-c3264006990e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:36.750296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-13260e54-73b9-45e4-a3f5-c3264006990e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:36.761617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-13260e54-73b9-45e4-a3f5-c3264006990e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.100302 Apr 05 12:17:36.762411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1808/3592] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:36 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:37.787998 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-58440ada-d52c-45e3-a53a-6c9378777866 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:37.789059 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-58440ada-d52c-45e3-a53a-6c9378777866 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:37.798533 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-58440ada-d52c-45e3-a53a-6c9378777866 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:37.798988 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-58440ada-d52c-45e3-a53a-6c9378777866 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:37.799758 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-58440ada-d52c-45e3-a53a-6c9378777866 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:37.800236 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-58440ada-d52c-45e3-a53a-6c9378777866 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:37.860752 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-58440ada-d52c-45e3-a53a-6c9378777866 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:37.869254 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-58440ada-d52c-45e3-a53a-6c9378777866 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.087749 Apr 05 12:17:37.869834 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1785/3593] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:37 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:38.891395 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ba0ab8b7-5327-45fb-bfbc-16a2ade89f7c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:38.892371 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ba0ab8b7-5327-45fb-bfbc-16a2ade89f7c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:38.902285 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ba0ab8b7-5327-45fb-bfbc-16a2ade89f7c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:38.903019 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ba0ab8b7-5327-45fb-bfbc-16a2ade89f7c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:38.904310 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ba0ab8b7-5327-45fb-bfbc-16a2ade89f7c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:38.905022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ba0ab8b7-5327-45fb-bfbc-16a2ade89f7c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:38.964426 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ba0ab8b7-5327-45fb-bfbc-16a2ade89f7c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:38.972547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ba0ab8b7-5327-45fb-bfbc-16a2ade89f7c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.088321 Apr 05 12:17:38.973107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1809/3594] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:38 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:39.993705 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-27214169-b44d-40a7-ae1e-49b73b0b655b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:39.994752 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-27214169-b44d-40a7-ae1e-49b73b0b655b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:40.005777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-27214169-b44d-40a7-ae1e-49b73b0b655b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:40.006516 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-27214169-b44d-40a7-ae1e-49b73b0b655b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:40.007751 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-27214169-b44d-40a7-ae1e-49b73b0b655b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:40.008608 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-27214169-b44d-40a7-ae1e-49b73b0b655b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:40.073748 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-27214169-b44d-40a7-ae1e-49b73b0b655b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:40.082325 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-27214169-b44d-40a7-ae1e-49b73b0b655b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.095099 Apr 05 12:17:40.082903 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1786/3595] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:39 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:41.103020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-927b7d7f-3f6d-4632-871a-2c0125577c17 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:41.104169 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-927b7d7f-3f6d-4632-871a-2c0125577c17 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:41.114918 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-927b7d7f-3f6d-4632-871a-2c0125577c17 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:41.115667 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-927b7d7f-3f6d-4632-871a-2c0125577c17 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:41.116986 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-927b7d7f-3f6d-4632-871a-2c0125577c17 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:41.117708 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-927b7d7f-3f6d-4632-871a-2c0125577c17 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:41.183457 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-927b7d7f-3f6d-4632-871a-2c0125577c17 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:41.191748 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-927b7d7f-3f6d-4632-871a-2c0125577c17 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.095391 Apr 05 12:17:41.192600 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1810/3596] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:41 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:42.213346 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-96e00d44-7273-4825-ac85-fd18b52ee947 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:42.214005 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-96e00d44-7273-4825-ac85-fd18b52ee947 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:42.222612 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-96e00d44-7273-4825-ac85-fd18b52ee947 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:42.223071 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-96e00d44-7273-4825-ac85-fd18b52ee947 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:42.223833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-96e00d44-7273-4825-ac85-fd18b52ee947 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:42.224300 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-96e00d44-7273-4825-ac85-fd18b52ee947 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:42.289866 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-96e00d44-7273-4825-ac85-fd18b52ee947 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:42.298087 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-96e00d44-7273-4825-ac85-fd18b52ee947 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.091067 Apr 05 12:17:42.298720 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1787/3597] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:42 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:43.319121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0560f594-4558-4c30-ac4d-194e0fd1e3d3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:43.320066 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0560f594-4558-4c30-ac4d-194e0fd1e3d3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:43.330934 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0560f594-4558-4c30-ac4d-194e0fd1e3d3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:43.331730 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0560f594-4558-4c30-ac4d-194e0fd1e3d3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:43.333026 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0560f594-4558-4c30-ac4d-194e0fd1e3d3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:43.333761 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0560f594-4558-4c30-ac4d-194e0fd1e3d3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:43.401650 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0560f594-4558-4c30-ac4d-194e0fd1e3d3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:43.409846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0560f594-4558-4c30-ac4d-194e0fd1e3d3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.097386 Apr 05 12:17:43.410402 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1811/3598] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:43 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:44.430930 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a8befd8f-6977-4081-96ea-9861b2066fb1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:44.431930 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a8befd8f-6977-4081-96ea-9861b2066fb1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:44.442658 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a8befd8f-6977-4081-96ea-9861b2066fb1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:44.443366 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a8befd8f-6977-4081-96ea-9861b2066fb1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:44.444696 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a8befd8f-6977-4081-96ea-9861b2066fb1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:44.445406 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a8befd8f-6977-4081-96ea-9861b2066fb1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:44.508171 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a8befd8f-6977-4081-96ea-9861b2066fb1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:44.516484 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a8befd8f-6977-4081-96ea-9861b2066fb1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.092084 Apr 05 12:17:44.519351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1788/3599] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:44 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:44.705394 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:17:44.705784 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Tue Apr 5 12:17:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:17:45.539090 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b89ad568-f1f7-4dc6-b90a-c71dc6be3172 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:45.540134 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b89ad568-f1f7-4dc6-b90a-c71dc6be3172 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:45.550805 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b89ad568-f1f7-4dc6-b90a-c71dc6be3172 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:45.551551 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b89ad568-f1f7-4dc6-b90a-c71dc6be3172 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:45.552896 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b89ad568-f1f7-4dc6-b90a-c71dc6be3172 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:45.553616 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b89ad568-f1f7-4dc6-b90a-c71dc6be3172 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:45.618642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b89ad568-f1f7-4dc6-b90a-c71dc6be3172 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:45.627018 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b89ad568-f1f7-4dc6-b90a-c71dc6be3172 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.094690 Apr 05 12:17:45.627598 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1812/3600] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:45 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:46.646942 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cc46bd08-c865-4df8-bc53-a08d2c9f3ad8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:46.647954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cc46bd08-c865-4df8-bc53-a08d2c9f3ad8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:46.658639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cc46bd08-c865-4df8-bc53-a08d2c9f3ad8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:46.659382 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cc46bd08-c865-4df8-bc53-a08d2c9f3ad8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:46.660695 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cc46bd08-c865-4df8-bc53-a08d2c9f3ad8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:46.661418 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cc46bd08-c865-4df8-bc53-a08d2c9f3ad8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:46.724799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-cc46bd08-c865-4df8-bc53-a08d2c9f3ad8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:46.732601 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cc46bd08-c865-4df8-bc53-a08d2c9f3ad8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.091428 Apr 05 12:17:46.733161 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1789/3601] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:46 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:47.753861 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8db5f642-fcca-48d8-9830-a654fbbae790 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:47.754768 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8db5f642-fcca-48d8-9830-a654fbbae790 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:47.765612 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8db5f642-fcca-48d8-9830-a654fbbae790 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:47.766405 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8db5f642-fcca-48d8-9830-a654fbbae790 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:47.767673 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8db5f642-fcca-48d8-9830-a654fbbae790 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:47.768482 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8db5f642-fcca-48d8-9830-a654fbbae790 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:47.834265 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8db5f642-fcca-48d8-9830-a654fbbae790 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:47.842245 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8db5f642-fcca-48d8-9830-a654fbbae790 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.095635 Apr 05 12:17:47.842820 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1813/3602] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:47 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:48.862682 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-256aa87f-9fde-4cbc-bde9-1aaf900f5669 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:48.863360 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-256aa87f-9fde-4cbc-bde9-1aaf900f5669 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:48.870993 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-256aa87f-9fde-4cbc-bde9-1aaf900f5669 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:48.871509 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-256aa87f-9fde-4cbc-bde9-1aaf900f5669 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:48.872424 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-256aa87f-9fde-4cbc-bde9-1aaf900f5669 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:48.872930 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-256aa87f-9fde-4cbc-bde9-1aaf900f5669 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:48.952065 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-256aa87f-9fde-4cbc-bde9-1aaf900f5669 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:48.963281 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-256aa87f-9fde-4cbc-bde9-1aaf900f5669 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.106750 Apr 05 12:17:48.963895 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1790/3603] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:48 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:49.981788 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ea8a0de2-e018-443c-b281-a0eff51205f7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:49.982550 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ea8a0de2-e018-443c-b281-a0eff51205f7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:49.990315 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea8a0de2-e018-443c-b281-a0eff51205f7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:49.990841 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea8a0de2-e018-443c-b281-a0eff51205f7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:49.991730 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea8a0de2-e018-443c-b281-a0eff51205f7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:49.992362 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ea8a0de2-e018-443c-b281-a0eff51205f7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:50.052991 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ea8a0de2-e018-443c-b281-a0eff51205f7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:50.060903 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ea8a0de2-e018-443c-b281-a0eff51205f7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.083773 Apr 05 12:17:50.061490 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1814/3604] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:49 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:51.081695 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-84b94416-66bd-4863-9864-a3c7a192b3e7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:51.082292 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-84b94416-66bd-4863-9864-a3c7a192b3e7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:51.088894 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-84b94416-66bd-4863-9864-a3c7a192b3e7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:51.089343 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-84b94416-66bd-4863-9864-a3c7a192b3e7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:51.090101 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-84b94416-66bd-4863-9864-a3c7a192b3e7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:51.090536 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-84b94416-66bd-4863-9864-a3c7a192b3e7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:51.151942 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-84b94416-66bd-4863-9864-a3c7a192b3e7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:51.163991 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-84b94416-66bd-4863-9864-a3c7a192b3e7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.088064 Apr 05 12:17:51.164776 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1791/3605] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:51 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:52.185305 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b1515323-1f97-4efc-8823-a5b7e6cfa5f4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:52.186262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b1515323-1f97-4efc-8823-a5b7e6cfa5f4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:52.194099 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b1515323-1f97-4efc-8823-a5b7e6cfa5f4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:52.194541 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b1515323-1f97-4efc-8823-a5b7e6cfa5f4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:52.195294 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b1515323-1f97-4efc-8823-a5b7e6cfa5f4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:52.195719 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b1515323-1f97-4efc-8823-a5b7e6cfa5f4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:52.256442 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b1515323-1f97-4efc-8823-a5b7e6cfa5f4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:52.264358 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b1515323-1f97-4efc-8823-a5b7e6cfa5f4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.085801 Apr 05 12:17:52.264951 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1815/3606] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:52 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:53.285097 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f98e3d52-7f28-4b1c-8b0d-aff01896c3ab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:53.285811 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f98e3d52-7f28-4b1c-8b0d-aff01896c3ab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:53.294383 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f98e3d52-7f28-4b1c-8b0d-aff01896c3ab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:53.294976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f98e3d52-7f28-4b1c-8b0d-aff01896c3ab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:53.295971 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f98e3d52-7f28-4b1c-8b0d-aff01896c3ab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:53.296585 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f98e3d52-7f28-4b1c-8b0d-aff01896c3ab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:53.363435 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f98e3d52-7f28-4b1c-8b0d-aff01896c3ab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:53.371710 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f98e3d52-7f28-4b1c-8b0d-aff01896c3ab tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.092911 Apr 05 12:17:53.372314 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1792/3607] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:53 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:54.392947 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a25adca4-c632-48b8-8ef8-680830e42869 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:54.393581 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a25adca4-c632-48b8-8ef8-680830e42869 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:54.400633 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a25adca4-c632-48b8-8ef8-680830e42869 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:54.401142 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a25adca4-c632-48b8-8ef8-680830e42869 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:54.401913 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a25adca4-c632-48b8-8ef8-680830e42869 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:54.402343 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a25adca4-c632-48b8-8ef8-680830e42869 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:54.466095 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a25adca4-c632-48b8-8ef8-680830e42869 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:54.474580 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a25adca4-c632-48b8-8ef8-680830e42869 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.088115 Apr 05 12:17:54.475139 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1816/3608] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:54 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:55.492545 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-654c7ca5-bf18-4bdd-b00e-3b8a512e3067 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:55.493231 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-654c7ca5-bf18-4bdd-b00e-3b8a512e3067 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:55.500940 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-654c7ca5-bf18-4bdd-b00e-3b8a512e3067 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:55.501461 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-654c7ca5-bf18-4bdd-b00e-3b8a512e3067 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:55.502428 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-654c7ca5-bf18-4bdd-b00e-3b8a512e3067 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:55.502853 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-654c7ca5-bf18-4bdd-b00e-3b8a512e3067 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:55.575920 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-654c7ca5-bf18-4bdd-b00e-3b8a512e3067 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:55.585442 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-654c7ca5-bf18-4bdd-b00e-3b8a512e3067 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.097528 Apr 05 12:17:55.586019 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1793/3609] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:55 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:56.606253 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b92d6c80-0ef2-4883-bf53-e2dc95b1bccd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:56.607261 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b92d6c80-0ef2-4883-bf53-e2dc95b1bccd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:56.617887 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b92d6c80-0ef2-4883-bf53-e2dc95b1bccd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:56.618580 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b92d6c80-0ef2-4883-bf53-e2dc95b1bccd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:56.619874 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b92d6c80-0ef2-4883-bf53-e2dc95b1bccd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:56.620632 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b92d6c80-0ef2-4883-bf53-e2dc95b1bccd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:56.688942 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b92d6c80-0ef2-4883-bf53-e2dc95b1bccd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:56.697608 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b92d6c80-0ef2-4883-bf53-e2dc95b1bccd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.097868 Apr 05 12:17:56.698162 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1817/3610] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:56 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:57.718768 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-dc741c0c-0235-4d02-a336-ec4411a87777 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:57.719747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-dc741c0c-0235-4d02-a336-ec4411a87777 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:57.730523 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dc741c0c-0235-4d02-a336-ec4411a87777 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:57.731266 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dc741c0c-0235-4d02-a336-ec4411a87777 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:57.732567 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dc741c0c-0235-4d02-a336-ec4411a87777 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:57.733287 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-dc741c0c-0235-4d02-a336-ec4411a87777 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:57.795329 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-dc741c0c-0235-4d02-a336-ec4411a87777 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:57.803681 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-dc741c0c-0235-4d02-a336-ec4411a87777 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.091465 Apr 05 12:17:57.804267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1794/3611] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:57 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:58.825942 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-11d774c0-e48a-455a-8fa9-f36e4b9a5791 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:58.826865 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-11d774c0-e48a-455a-8fa9-f36e4b9a5791 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:58.834740 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-11d774c0-e48a-455a-8fa9-f36e4b9a5791 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:58.835182 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-11d774c0-e48a-455a-8fa9-f36e4b9a5791 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:58.835926 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-11d774c0-e48a-455a-8fa9-f36e4b9a5791 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:58.836376 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-11d774c0-e48a-455a-8fa9-f36e4b9a5791 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:58.903794 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-11d774c0-e48a-455a-8fa9-f36e4b9a5791 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:17:58.912050 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-11d774c0-e48a-455a-8fa9-f36e4b9a5791 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.092717 Apr 05 12:17:58.912641 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1818/3612] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:58 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:59.929235 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a95b6fc2-154f-4d55-8ed3-ff867b959e14 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:17:59.929909 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a95b6fc2-154f-4d55-8ed3-ff867b959e14 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:17:59.936532 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a95b6fc2-154f-4d55-8ed3-ff867b959e14 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:59.936966 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a95b6fc2-154f-4d55-8ed3-ff867b959e14 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:59.937713 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a95b6fc2-154f-4d55-8ed3-ff867b959e14 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:17:59.938136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a95b6fc2-154f-4d55-8ed3-ff867b959e14 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:17:59.998831 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a95b6fc2-154f-4d55-8ed3-ff867b959e14 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:00.006946 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a95b6fc2-154f-4d55-8ed3-ff867b959e14 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.081709 Apr 05 12:18:00.007511 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1795/3613] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:17:59 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:01.027300 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-eaf56445-fe40-4573-98cc-a1d2d990d7f7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:01.028310 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-eaf56445-fe40-4573-98cc-a1d2d990d7f7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:01.036911 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eaf56445-fe40-4573-98cc-a1d2d990d7f7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:01.037367 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eaf56445-fe40-4573-98cc-a1d2d990d7f7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:01.038134 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eaf56445-fe40-4573-98cc-a1d2d990d7f7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:01.038571 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-eaf56445-fe40-4573-98cc-a1d2d990d7f7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:01.107907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-eaf56445-fe40-4573-98cc-a1d2d990d7f7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:01.115874 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-eaf56445-fe40-4573-98cc-a1d2d990d7f7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.095119 Apr 05 12:18:01.116478 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1819/3614] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:01 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:01.710305 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:18:01.711184 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Tue Apr 5 12:18:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:18:02.137523 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-63a5fade-3eca-47ee-99e1-4f86fc96e27b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:02.138432 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-63a5fade-3eca-47ee-99e1-4f86fc96e27b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:02.146765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63a5fade-3eca-47ee-99e1-4f86fc96e27b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:02.147208 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63a5fade-3eca-47ee-99e1-4f86fc96e27b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:02.147964 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63a5fade-3eca-47ee-99e1-4f86fc96e27b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:02.148423 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-63a5fade-3eca-47ee-99e1-4f86fc96e27b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:02.207321 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-63a5fade-3eca-47ee-99e1-4f86fc96e27b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:02.215111 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-63a5fade-3eca-47ee-99e1-4f86fc96e27b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.084152 Apr 05 12:18:02.215669 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1796/3615] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:02 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:03.235293 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e336ab56-c930-4312-98aa-5b45f75b9394 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:03.236311 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e336ab56-c930-4312-98aa-5b45f75b9394 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:03.247435 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e336ab56-c930-4312-98aa-5b45f75b9394 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:03.248297 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e336ab56-c930-4312-98aa-5b45f75b9394 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:03.249928 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e336ab56-c930-4312-98aa-5b45f75b9394 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:03.250642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e336ab56-c930-4312-98aa-5b45f75b9394 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:03.321839 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e336ab56-c930-4312-98aa-5b45f75b9394 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:03.334583 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e336ab56-c930-4312-98aa-5b45f75b9394 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.105523 Apr 05 12:18:03.335494 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1820/3616] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:03 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:04.359679 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bc40d0a5-e094-4510-a920-a8caba27ec0a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:04.360679 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bc40d0a5-e094-4510-a920-a8caba27ec0a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:04.368289 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bc40d0a5-e094-4510-a920-a8caba27ec0a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:04.368730 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bc40d0a5-e094-4510-a920-a8caba27ec0a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:04.369485 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bc40d0a5-e094-4510-a920-a8caba27ec0a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:04.369906 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bc40d0a5-e094-4510-a920-a8caba27ec0a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:04.429753 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-bc40d0a5-e094-4510-a920-a8caba27ec0a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:04.439591 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bc40d0a5-e094-4510-a920-a8caba27ec0a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.086277 Apr 05 12:18:04.440190 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1797/3617] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:04 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:05.460765 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b5209e43-687c-4c59-8cac-283041fa6185 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:05.461784 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b5209e43-687c-4c59-8cac-283041fa6185 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:05.472195 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b5209e43-687c-4c59-8cac-283041fa6185 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:05.472640 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b5209e43-687c-4c59-8cac-283041fa6185 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:05.473400 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b5209e43-687c-4c59-8cac-283041fa6185 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:05.473833 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b5209e43-687c-4c59-8cac-283041fa6185 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:05.533172 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b5209e43-687c-4c59-8cac-283041fa6185 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:05.541590 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b5209e43-687c-4c59-8cac-283041fa6185 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.087402 Apr 05 12:18:05.542174 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1821/3618] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:05 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:06.562525 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e865c445-b287-4bfa-871b-ade300c6ba37 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:06.563493 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e865c445-b287-4bfa-871b-ade300c6ba37 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:06.574310 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e865c445-b287-4bfa-871b-ade300c6ba37 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:06.575047 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e865c445-b287-4bfa-871b-ade300c6ba37 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:06.576364 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e865c445-b287-4bfa-871b-ade300c6ba37 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:06.577086 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e865c445-b287-4bfa-871b-ade300c6ba37 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:06.639889 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e865c445-b287-4bfa-871b-ade300c6ba37 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:06.650030 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e865c445-b287-4bfa-871b-ade300c6ba37 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.093588 Apr 05 12:18:06.651152 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1798/3619] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:06 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:07.677082 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-41d69c56-035a-4e69-a16b-23dc7260db34 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:07.677952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-41d69c56-035a-4e69-a16b-23dc7260db34 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:07.688545 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-41d69c56-035a-4e69-a16b-23dc7260db34 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:07.689280 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-41d69c56-035a-4e69-a16b-23dc7260db34 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:07.690522 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-41d69c56-035a-4e69-a16b-23dc7260db34 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:07.691143 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-41d69c56-035a-4e69-a16b-23dc7260db34 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:07.758853 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-41d69c56-035a-4e69-a16b-23dc7260db34 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:07.767015 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-41d69c56-035a-4e69-a16b-23dc7260db34 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.096549 Apr 05 12:18:07.767588 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1822/3620] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:07 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:08.787484 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4296137b-e60e-4dd1-b687-d6a554857703 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:08.788493 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4296137b-e60e-4dd1-b687-d6a554857703 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:08.799027 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4296137b-e60e-4dd1-b687-d6a554857703 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:08.799758 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4296137b-e60e-4dd1-b687-d6a554857703 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:08.800716 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4296137b-e60e-4dd1-b687-d6a554857703 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:08.801150 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4296137b-e60e-4dd1-b687-d6a554857703 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:08.868329 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4296137b-e60e-4dd1-b687-d6a554857703 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:08.880598 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4296137b-e60e-4dd1-b687-d6a554857703 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.099285 Apr 05 12:18:08.881318 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1799/3621] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:08 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:09.906673 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-604d1d11-d440-488c-80c3-247f4bb734f4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:09.907867 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-604d1d11-d440-488c-80c3-247f4bb734f4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:09.915399 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-604d1d11-d440-488c-80c3-247f4bb734f4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:09.915854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-604d1d11-d440-488c-80c3-247f4bb734f4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:09.916663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-604d1d11-d440-488c-80c3-247f4bb734f4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:09.917094 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-604d1d11-d440-488c-80c3-247f4bb734f4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:09.979620 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-604d1d11-d440-488c-80c3-247f4bb734f4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:09.987821 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-604d1d11-d440-488c-80c3-247f4bb734f4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.087966 Apr 05 12:18:09.988450 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1823/3622] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:09 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:11.009235 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a1e54e38-f8d0-4b5d-87ed-824b2748282c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:11.010194 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a1e54e38-f8d0-4b5d-87ed-824b2748282c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:11.020109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a1e54e38-f8d0-4b5d-87ed-824b2748282c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:11.020598 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a1e54e38-f8d0-4b5d-87ed-824b2748282c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:11.021330 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a1e54e38-f8d0-4b5d-87ed-824b2748282c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:11.021765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a1e54e38-f8d0-4b5d-87ed-824b2748282c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:11.088649 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a1e54e38-f8d0-4b5d-87ed-824b2748282c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:11.096661 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a1e54e38-f8d0-4b5d-87ed-824b2748282c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.093923 Apr 05 12:18:11.097258 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1800/3623] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:11 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:12.114362 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-63670ac9-e241-4258-a9f1-35f70998ff61 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:12.115364 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-63670ac9-e241-4258-a9f1-35f70998ff61 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:12.123145 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-63670ac9-e241-4258-a9f1-35f70998ff61 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:12.124245 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-63670ac9-e241-4258-a9f1-35f70998ff61 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:12.125412 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-63670ac9-e241-4258-a9f1-35f70998ff61 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:12.125854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-63670ac9-e241-4258-a9f1-35f70998ff61 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:12.212670 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-63670ac9-e241-4258-a9f1-35f70998ff61 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:12.220548 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-63670ac9-e241-4258-a9f1-35f70998ff61 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.110303 Apr 05 12:18:12.221114 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1824/3624] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:12 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:13.241141 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7857d375-d820-4882-9910-933aee8119d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:13.242115 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7857d375-d820-4882-9910-933aee8119d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:13.253237 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7857d375-d820-4882-9910-933aee8119d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:13.253980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7857d375-d820-4882-9910-933aee8119d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:13.255226 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7857d375-d820-4882-9910-933aee8119d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:13.255939 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7857d375-d820-4882-9910-933aee8119d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:13.319049 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7857d375-d820-4882-9910-933aee8119d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:13.326875 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7857d375-d820-4882-9910-933aee8119d0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.092377 Apr 05 12:18:13.327443 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1801/3625] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:13 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:14.348333 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0f865865-9136-4524-b745-98768c7a982e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:14.349428 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0f865865-9136-4524-b745-98768c7a982e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:14.360130 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0f865865-9136-4524-b745-98768c7a982e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:14.360877 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0f865865-9136-4524-b745-98768c7a982e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:14.362149 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0f865865-9136-4524-b745-98768c7a982e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:14.362874 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0f865865-9136-4524-b745-98768c7a982e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:14.428304 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0f865865-9136-4524-b745-98768c7a982e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:14.436360 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0f865865-9136-4524-b745-98768c7a982e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.094612 Apr 05 12:18:14.436918 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1825/3626] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:14 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:15.456934 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c3087371-0a3f-4f7c-a3df-b3b69a5c5cb7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:15.457523 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c3087371-0a3f-4f7c-a3df-b3b69a5c5cb7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:15.464108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3087371-0a3f-4f7c-a3df-b3b69a5c5cb7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:15.464600 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3087371-0a3f-4f7c-a3df-b3b69a5c5cb7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:15.465321 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3087371-0a3f-4f7c-a3df-b3b69a5c5cb7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:15.465749 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3087371-0a3f-4f7c-a3df-b3b69a5c5cb7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:15.531817 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c3087371-0a3f-4f7c-a3df-b3b69a5c5cb7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:15.541452 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c3087371-0a3f-4f7c-a3df-b3b69a5c5cb7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.090692 Apr 05 12:18:15.542088 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1802/3627] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:15 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:16.564722 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3f4a6965-ee2a-4b92-ad35-09375869a6e9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:16.565829 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3f4a6965-ee2a-4b92-ad35-09375869a6e9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:16.572662 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f4a6965-ee2a-4b92-ad35-09375869a6e9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:16.573115 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f4a6965-ee2a-4b92-ad35-09375869a6e9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:16.573875 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f4a6965-ee2a-4b92-ad35-09375869a6e9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:16.574308 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f4a6965-ee2a-4b92-ad35-09375869a6e9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:16.639726 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3f4a6965-ee2a-4b92-ad35-09375869a6e9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:16.648337 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3f4a6965-ee2a-4b92-ad35-09375869a6e9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.090368 Apr 05 12:18:16.648911 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1826/3628] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:16 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:17.670090 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cc3cb7c7-25a8-4583-98d3-7379466998b1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:17.671070 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cc3cb7c7-25a8-4583-98d3-7379466998b1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:17.679828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cc3cb7c7-25a8-4583-98d3-7379466998b1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:17.680309 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cc3cb7c7-25a8-4583-98d3-7379466998b1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:17.681037 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cc3cb7c7-25a8-4583-98d3-7379466998b1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:17.681483 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cc3cb7c7-25a8-4583-98d3-7379466998b1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:17.739983 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-cc3cb7c7-25a8-4583-98d3-7379466998b1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:17.748504 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cc3cb7c7-25a8-4583-98d3-7379466998b1 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.084720 Apr 05 12:18:17.749072 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1803/3629] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:17 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:18.770099 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d60cb0d6-4cfb-4daa-bfb1-d1e07ff6982f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:18.770866 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d60cb0d6-4cfb-4daa-bfb1-d1e07ff6982f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:18.778050 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d60cb0d6-4cfb-4daa-bfb1-d1e07ff6982f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:18.778542 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d60cb0d6-4cfb-4daa-bfb1-d1e07ff6982f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:18.779372 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d60cb0d6-4cfb-4daa-bfb1-d1e07ff6982f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:18.779841 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d60cb0d6-4cfb-4daa-bfb1-d1e07ff6982f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:18.866583 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d60cb0d6-4cfb-4daa-bfb1-d1e07ff6982f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:18.875602 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d60cb0d6-4cfb-4daa-bfb1-d1e07ff6982f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.112258 Apr 05 12:18:18.876199 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1827/3630] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:18 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:19.896573 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c249dedc-931c-4d2a-8bdb-e33d3b511109 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:19.897213 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c249dedc-931c-4d2a-8bdb-e33d3b511109 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:19.903776 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c249dedc-931c-4d2a-8bdb-e33d3b511109 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:19.904250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c249dedc-931c-4d2a-8bdb-e33d3b511109 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:19.905009 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c249dedc-931c-4d2a-8bdb-e33d3b511109 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:19.905434 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c249dedc-931c-4d2a-8bdb-e33d3b511109 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:19.968532 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c249dedc-931c-4d2a-8bdb-e33d3b511109 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:19.976850 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c249dedc-931c-4d2a-8bdb-e33d3b511109 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.086306 Apr 05 12:18:19.977486 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1804/3631] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:19 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:20.994004 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-86f5c812-c289-4787-80cc-98dc0548c121 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:20.994623 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-86f5c812-c289-4787-80cc-98dc0548c121 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:21.001556 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-86f5c812-c289-4787-80cc-98dc0548c121 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:21.001998 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-86f5c812-c289-4787-80cc-98dc0548c121 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:21.002740 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-86f5c812-c289-4787-80cc-98dc0548c121 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:21.003163 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-86f5c812-c289-4787-80cc-98dc0548c121 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:21.062265 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-86f5c812-c289-4787-80cc-98dc0548c121 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:21.070617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-86f5c812-c289-4787-80cc-98dc0548c121 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.080489 Apr 05 12:18:21.071174 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1828/3632] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:20 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:22.091157 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e97face3-95e9-4176-89c6-52190d2e45b8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:22.092153 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e97face3-95e9-4176-89c6-52190d2e45b8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:22.102738 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e97face3-95e9-4176-89c6-52190d2e45b8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:22.103483 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e97face3-95e9-4176-89c6-52190d2e45b8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:22.104781 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e97face3-95e9-4176-89c6-52190d2e45b8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:22.105490 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e97face3-95e9-4176-89c6-52190d2e45b8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:22.170754 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e97face3-95e9-4176-89c6-52190d2e45b8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:22.179260 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e97face3-95e9-4176-89c6-52190d2e45b8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.094459 Apr 05 12:18:22.179777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1805/3633] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:22 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:23.204572 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-51ec7e1b-9043-4158-a1b2-b502d841c970 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:23.205510 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-51ec7e1b-9043-4158-a1b2-b502d841c970 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:23.216162 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-51ec7e1b-9043-4158-a1b2-b502d841c970 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:23.216882 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-51ec7e1b-9043-4158-a1b2-b502d841c970 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:23.218110 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-51ec7e1b-9043-4158-a1b2-b502d841c970 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:23.218819 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-51ec7e1b-9043-4158-a1b2-b502d841c970 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:23.279658 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-51ec7e1b-9043-4158-a1b2-b502d841c970 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:23.288577 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-51ec7e1b-9043-4158-a1b2-b502d841c970 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.090363 Apr 05 12:18:23.289169 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1829/3634] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:23 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:24.309720 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c145bf08-3fb5-4849-9a50-eead6909bd7e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:24.310689 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c145bf08-3fb5-4849-9a50-eead6909bd7e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:24.320825 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c145bf08-3fb5-4849-9a50-eead6909bd7e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:24.321570 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c145bf08-3fb5-4849-9a50-eead6909bd7e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:24.322813 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c145bf08-3fb5-4849-9a50-eead6909bd7e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:24.323541 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c145bf08-3fb5-4849-9a50-eead6909bd7e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:24.388945 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c145bf08-3fb5-4849-9a50-eead6909bd7e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:24.398927 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c145bf08-3fb5-4849-9a50-eead6909bd7e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.095094 Apr 05 12:18:24.399164 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1806/3635] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:24 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:18:25.417829 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c4f1d20c-8b01-49fe-924c-b24f71ced872 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:25.418846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c4f1d20c-8b01-49fe-924c-b24f71ced872 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:25.429581 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c4f1d20c-8b01-49fe-924c-b24f71ced872 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:25.430269 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c4f1d20c-8b01-49fe-924c-b24f71ced872 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:25.431513 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c4f1d20c-8b01-49fe-924c-b24f71ced872 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:25.432144 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c4f1d20c-8b01-49fe-924c-b24f71ced872 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:25.495353 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c4f1d20c-8b01-49fe-924c-b24f71ced872 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:25.504025 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c4f1d20c-8b01-49fe-924c-b24f71ced872 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.092146 Apr 05 12:18:25.504612 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1830/3636] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:25 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:26.523480 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2611fc76-6d12-4947-9eab-2294de52bf0d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:26.524171 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2611fc76-6d12-4947-9eab-2294de52bf0d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:26.531563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2611fc76-6d12-4947-9eab-2294de52bf0d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:26.532063 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2611fc76-6d12-4947-9eab-2294de52bf0d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:26.532939 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2611fc76-6d12-4947-9eab-2294de52bf0d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:26.533427 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2611fc76-6d12-4947-9eab-2294de52bf0d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:26.595247 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2611fc76-6d12-4947-9eab-2294de52bf0d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:26.603465 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2611fc76-6d12-4947-9eab-2294de52bf0d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.084975 Apr 05 12:18:26.604058 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1807/3637] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:26 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:27.622310 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-61145fbc-7669-41a4-bca7-2ef96d94b6ba tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:27.623396 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-61145fbc-7669-41a4-bca7-2ef96d94b6ba tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:27.631474 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-61145fbc-7669-41a4-bca7-2ef96d94b6ba tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:27.632185 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-61145fbc-7669-41a4-bca7-2ef96d94b6ba tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:27.632944 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-61145fbc-7669-41a4-bca7-2ef96d94b6ba tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:27.633374 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-61145fbc-7669-41a4-bca7-2ef96d94b6ba tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:27.697721 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-61145fbc-7669-41a4-bca7-2ef96d94b6ba tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:27.706103 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-61145fbc-7669-41a4-bca7-2ef96d94b6ba tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.088763 Apr 05 12:18:27.706678 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1831/3638] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:27 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:28.726765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e01a417c-dc77-4ea9-8601-d04ca6cd64ca tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:28.727777 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e01a417c-dc77-4ea9-8601-d04ca6cd64ca tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:28.738098 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e01a417c-dc77-4ea9-8601-d04ca6cd64ca tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:28.738828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e01a417c-dc77-4ea9-8601-d04ca6cd64ca tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:28.740056 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e01a417c-dc77-4ea9-8601-d04ca6cd64ca tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:28.740800 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e01a417c-dc77-4ea9-8601-d04ca6cd64ca tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:28.802462 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e01a417c-dc77-4ea9-8601-d04ca6cd64ca tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:28.810730 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e01a417c-dc77-4ea9-8601-d04ca6cd64ca tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.090472 Apr 05 12:18:28.811287 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1808/3639] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:28 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:29.836153 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-838878d3-e690-4d45-9b92-53e8ff645825 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:29.837171 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-838878d3-e690-4d45-9b92-53e8ff645825 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:29.847725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-838878d3-e690-4d45-9b92-53e8ff645825 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:29.848564 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-838878d3-e690-4d45-9b92-53e8ff645825 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:29.849816 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-838878d3-e690-4d45-9b92-53e8ff645825 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:29.850723 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-838878d3-e690-4d45-9b92-53e8ff645825 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:29.921787 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-838878d3-e690-4d45-9b92-53e8ff645825 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:29.930369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-838878d3-e690-4d45-9b92-53e8ff645825 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.100420 Apr 05 12:18:29.930968 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1832/3640] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:29 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:30.951722 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f0399f13-04b3-43dd-85d0-45712f8f0a9b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:30.952781 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f0399f13-04b3-43dd-85d0-45712f8f0a9b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:30.962272 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f0399f13-04b3-43dd-85d0-45712f8f0a9b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:30.962718 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f0399f13-04b3-43dd-85d0-45712f8f0a9b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:30.963489 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f0399f13-04b3-43dd-85d0-45712f8f0a9b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:30.963914 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f0399f13-04b3-43dd-85d0-45712f8f0a9b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:31.032532 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f0399f13-04b3-43dd-85d0-45712f8f0a9b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:31.041013 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f0399f13-04b3-43dd-85d0-45712f8f0a9b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.095736 Apr 05 12:18:31.041602 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1809/3641] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:30 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:32.062071 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9114e1d6-bc9e-40fe-9a21-60554c001b93 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:32.063002 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9114e1d6-bc9e-40fe-9a21-60554c001b93 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:32.072421 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9114e1d6-bc9e-40fe-9a21-60554c001b93 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:32.072863 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9114e1d6-bc9e-40fe-9a21-60554c001b93 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:32.073610 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9114e1d6-bc9e-40fe-9a21-60554c001b93 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:32.074035 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9114e1d6-bc9e-40fe-9a21-60554c001b93 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:32.139601 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9114e1d6-bc9e-40fe-9a21-60554c001b93 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:32.148331 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9114e1d6-bc9e-40fe-9a21-60554c001b93 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.092731 Apr 05 12:18:32.148902 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1833/3642] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:32 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:33.169477 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-54498a90-af80-41b1-831a-95bd4e48e05c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:33.170441 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-54498a90-af80-41b1-831a-95bd4e48e05c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:33.180694 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54498a90-af80-41b1-831a-95bd4e48e05c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:33.181136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54498a90-af80-41b1-831a-95bd4e48e05c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:33.181896 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54498a90-af80-41b1-831a-95bd4e48e05c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:33.182327 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54498a90-af80-41b1-831a-95bd4e48e05c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:33.254648 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-54498a90-af80-41b1-831a-95bd4e48e05c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:33.262891 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-54498a90-af80-41b1-831a-95bd4e48e05c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.100007 Apr 05 12:18:33.263457 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1810/3643] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:33 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:34.284052 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9fca9ed3-4756-40e4-8011-4f76f601dd38 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:34.285013 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9fca9ed3-4756-40e4-8011-4f76f601dd38 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:34.293189 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fca9ed3-4756-40e4-8011-4f76f601dd38 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:34.293631 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fca9ed3-4756-40e4-8011-4f76f601dd38 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:34.294371 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fca9ed3-4756-40e4-8011-4f76f601dd38 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:34.294797 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9fca9ed3-4756-40e4-8011-4f76f601dd38 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:34.365249 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9fca9ed3-4756-40e4-8011-4f76f601dd38 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:34.373907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9fca9ed3-4756-40e4-8011-4f76f601dd38 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.096268 Apr 05 12:18:34.374492 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1834/3644] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:34 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:35.395247 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-50b16fde-c58e-45de-b8c6-fcf3eeab0dad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:35.396277 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-50b16fde-c58e-45de-b8c6-fcf3eeab0dad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:35.403725 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-50b16fde-c58e-45de-b8c6-fcf3eeab0dad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:35.404192 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-50b16fde-c58e-45de-b8c6-fcf3eeab0dad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:35.404972 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-50b16fde-c58e-45de-b8c6-fcf3eeab0dad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:35.405396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-50b16fde-c58e-45de-b8c6-fcf3eeab0dad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:35.464436 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-50b16fde-c58e-45de-b8c6-fcf3eeab0dad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:35.472636 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-50b16fde-c58e-45de-b8c6-fcf3eeab0dad tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.083835 Apr 05 12:18:35.473211 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1811/3645] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:35 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:36.494013 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-805332d7-371b-45bb-ad51-5c3cbb789c83 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:36.494972 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-805332d7-371b-45bb-ad51-5c3cbb789c83 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:36.505854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-805332d7-371b-45bb-ad51-5c3cbb789c83 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:36.506627 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-805332d7-371b-45bb-ad51-5c3cbb789c83 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:36.507895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-805332d7-371b-45bb-ad51-5c3cbb789c83 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:36.508387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-805332d7-371b-45bb-ad51-5c3cbb789c83 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:36.568279 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-805332d7-371b-45bb-ad51-5c3cbb789c83 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:36.576107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-805332d7-371b-45bb-ad51-5c3cbb789c83 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.088521 Apr 05 12:18:36.576692 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1835/3646] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:36 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:37.596065 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3725320c-db9f-4708-b9bf-c8338f0c843f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:37.597027 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3725320c-db9f-4708-b9bf-c8338f0c843f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:37.607168 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3725320c-db9f-4708-b9bf-c8338f0c843f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:37.607876 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3725320c-db9f-4708-b9bf-c8338f0c843f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:37.609094 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3725320c-db9f-4708-b9bf-c8338f0c843f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:37.609774 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3725320c-db9f-4708-b9bf-c8338f0c843f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:37.672833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3725320c-db9f-4708-b9bf-c8338f0c843f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:37.681605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3725320c-db9f-4708-b9bf-c8338f0c843f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.091578 Apr 05 12:18:37.682183 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1812/3647] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:37 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:38.702945 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-851add35-b9bf-427a-b8ec-977b79fe401c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:38.704064 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-851add35-b9bf-427a-b8ec-977b79fe401c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:38.714739 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-851add35-b9bf-427a-b8ec-977b79fe401c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:38.715491 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-851add35-b9bf-427a-b8ec-977b79fe401c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:38.716853 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-851add35-b9bf-427a-b8ec-977b79fe401c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:38.717588 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-851add35-b9bf-427a-b8ec-977b79fe401c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:38.796264 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-851add35-b9bf-427a-b8ec-977b79fe401c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:38.805155 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-851add35-b9bf-427a-b8ec-977b79fe401c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.108752 Apr 05 12:18:38.805738 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1836/3648] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:38 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:39.826401 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3aa4519e-4e27-476b-b831-fba1195f656a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:39.827375 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3aa4519e-4e27-476b-b831-fba1195f656a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:39.837246 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3aa4519e-4e27-476b-b831-fba1195f656a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:39.837698 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3aa4519e-4e27-476b-b831-fba1195f656a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:39.838463 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3aa4519e-4e27-476b-b831-fba1195f656a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:39.838894 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3aa4519e-4e27-476b-b831-fba1195f656a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:39.902969 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3aa4519e-4e27-476b-b831-fba1195f656a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:39.911127 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3aa4519e-4e27-476b-b831-fba1195f656a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.091352 Apr 05 12:18:39.911706 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1813/3649] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:39 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:40.932408 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3f18913e-e106-4278-8058-f31ed654899a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:40.933335 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3f18913e-e106-4278-8058-f31ed654899a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:40.943471 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f18913e-e106-4278-8058-f31ed654899a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:40.944309 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f18913e-e106-4278-8058-f31ed654899a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:40.945477 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f18913e-e106-4278-8058-f31ed654899a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:40.945912 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3f18913e-e106-4278-8058-f31ed654899a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:41.005863 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3f18913e-e106-4278-8058-f31ed654899a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:41.016961 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3f18913e-e106-4278-8058-f31ed654899a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.090766 Apr 05 12:18:41.017840 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1837/3650] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:40 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:42.043080 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2fa4b9d7-7548-4855-8350-e1add6f92ce9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:42.044025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2fa4b9d7-7548-4855-8350-e1add6f92ce9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:42.054685 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2fa4b9d7-7548-4855-8350-e1add6f92ce9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:42.055128 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2fa4b9d7-7548-4855-8350-e1add6f92ce9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:42.055883 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2fa4b9d7-7548-4855-8350-e1add6f92ce9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:42.056350 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2fa4b9d7-7548-4855-8350-e1add6f92ce9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:42.115930 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2fa4b9d7-7548-4855-8350-e1add6f92ce9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:42.124304 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2fa4b9d7-7548-4855-8350-e1add6f92ce9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.087592 Apr 05 12:18:42.124867 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1814/3651] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:42 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:43.145281 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2d8bd399-a3c5-4024-aaf5-76e83f6a57aa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:43.146301 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2d8bd399-a3c5-4024-aaf5-76e83f6a57aa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:43.156857 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2d8bd399-a3c5-4024-aaf5-76e83f6a57aa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:43.157599 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2d8bd399-a3c5-4024-aaf5-76e83f6a57aa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:43.158826 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2d8bd399-a3c5-4024-aaf5-76e83f6a57aa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:43.159530 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2d8bd399-a3c5-4024-aaf5-76e83f6a57aa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:43.232620 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-2d8bd399-a3c5-4024-aaf5-76e83f6a57aa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:43.243044 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2d8bd399-a3c5-4024-aaf5-76e83f6a57aa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.104012 Apr 05 12:18:43.243733 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1838/3652] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:43 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:44.266554 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7ff8411e-23c8-45bd-88e7-ba44beb8c7cd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:44.267526 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7ff8411e-23c8-45bd-88e7-ba44beb8c7cd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:44.276391 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7ff8411e-23c8-45bd-88e7-ba44beb8c7cd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:44.276841 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7ff8411e-23c8-45bd-88e7-ba44beb8c7cd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:44.277606 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7ff8411e-23c8-45bd-88e7-ba44beb8c7cd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:44.278041 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7ff8411e-23c8-45bd-88e7-ba44beb8c7cd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:44.346179 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7ff8411e-23c8-45bd-88e7-ba44beb8c7cd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:44.354377 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7ff8411e-23c8-45bd-88e7-ba44beb8c7cd tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.094619 Apr 05 12:18:44.354953 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1815/3653] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:44 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:45.376023 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-148e47e0-9c17-4559-a1b9-90f8602ca24b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:45.377123 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-148e47e0-9c17-4559-a1b9-90f8602ca24b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:45.385478 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-148e47e0-9c17-4559-a1b9-90f8602ca24b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:45.385932 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-148e47e0-9c17-4559-a1b9-90f8602ca24b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:45.386689 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-148e47e0-9c17-4559-a1b9-90f8602ca24b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:45.387130 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-148e47e0-9c17-4559-a1b9-90f8602ca24b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:45.452981 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-148e47e0-9c17-4559-a1b9-90f8602ca24b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:45.461459 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-148e47e0-9c17-4559-a1b9-90f8602ca24b tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.092387 Apr 05 12:18:45.462034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1839/3654] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:45 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:46.479728 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-61907281-6591-4e62-bb4b-0c93f2454400 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:46.480462 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-61907281-6591-4e62-bb4b-0c93f2454400 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:46.488387 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-61907281-6591-4e62-bb4b-0c93f2454400 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:46.488912 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-61907281-6591-4e62-bb4b-0c93f2454400 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:46.489760 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-61907281-6591-4e62-bb4b-0c93f2454400 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:46.490264 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-61907281-6591-4e62-bb4b-0c93f2454400 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:46.552375 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-61907281-6591-4e62-bb4b-0c93f2454400 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:46.560569 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-61907281-6591-4e62-bb4b-0c93f2454400 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.085582 Apr 05 12:18:46.561137 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1816/3655] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:46 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:47.581880 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0c62cd0f-0ee1-4caf-b3a8-5843b6d7c6e9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:47.582876 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0c62cd0f-0ee1-4caf-b3a8-5843b6d7c6e9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:47.590598 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0c62cd0f-0ee1-4caf-b3a8-5843b6d7c6e9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:47.591048 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0c62cd0f-0ee1-4caf-b3a8-5843b6d7c6e9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:47.591794 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0c62cd0f-0ee1-4caf-b3a8-5843b6d7c6e9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:47.592261 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0c62cd0f-0ee1-4caf-b3a8-5843b6d7c6e9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:47.651601 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0c62cd0f-0ee1-4caf-b3a8-5843b6d7c6e9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:47.659665 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0c62cd0f-0ee1-4caf-b3a8-5843b6d7c6e9 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.084498 Apr 05 12:18:47.660269 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1840/3656] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:47 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:48.680783 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b93bcdae-a4e1-4fcd-89be-09365f2d3d89 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:48.681729 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b93bcdae-a4e1-4fcd-89be-09365f2d3d89 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:48.691279 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b93bcdae-a4e1-4fcd-89be-09365f2d3d89 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:48.692003 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b93bcdae-a4e1-4fcd-89be-09365f2d3d89 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:48.693157 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b93bcdae-a4e1-4fcd-89be-09365f2d3d89 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:48.693849 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b93bcdae-a4e1-4fcd-89be-09365f2d3d89 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:48.755406 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b93bcdae-a4e1-4fcd-89be-09365f2d3d89 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:48.766944 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b93bcdae-a4e1-4fcd-89be-09365f2d3d89 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.092307 Apr 05 12:18:48.767535 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1817/3657] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:48 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:49.788129 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ed229d07-d32d-44b2-a32d-f67ba07d66ee tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:49.789128 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ed229d07-d32d-44b2-a32d-f67ba07d66ee tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:49.799736 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ed229d07-d32d-44b2-a32d-f67ba07d66ee tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:49.800630 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ed229d07-d32d-44b2-a32d-f67ba07d66ee tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:49.801868 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ed229d07-d32d-44b2-a32d-f67ba07d66ee tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:49.802643 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ed229d07-d32d-44b2-a32d-f67ba07d66ee tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:49.864683 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ed229d07-d32d-44b2-a32d-f67ba07d66ee tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:49.873210 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ed229d07-d32d-44b2-a32d-f67ba07d66ee tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.091438 Apr 05 12:18:49.873788 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1841/3658] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:49 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:50.893500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7962b70a-c00d-4672-9551-ccbba04061b3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:50.894400 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7962b70a-c00d-4672-9551-ccbba04061b3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:50.904262 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7962b70a-c00d-4672-9551-ccbba04061b3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:50.904956 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7962b70a-c00d-4672-9551-ccbba04061b3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:50.906112 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7962b70a-c00d-4672-9551-ccbba04061b3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:50.906783 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7962b70a-c00d-4672-9551-ccbba04061b3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:50.969198 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7962b70a-c00d-4672-9551-ccbba04061b3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:50.977290 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7962b70a-c00d-4672-9551-ccbba04061b3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.089869 Apr 05 12:18:50.977858 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1818/3659] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:50 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:51.995380 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c50abb0d-028f-4fe9-9c9b-50444740588e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:51.996113 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c50abb0d-028f-4fe9-9c9b-50444740588e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:52.004403 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c50abb0d-028f-4fe9-9c9b-50444740588e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:52.004925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c50abb0d-028f-4fe9-9c9b-50444740588e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:52.005814 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c50abb0d-028f-4fe9-9c9b-50444740588e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:52.006316 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c50abb0d-028f-4fe9-9c9b-50444740588e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:52.068270 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c50abb0d-028f-4fe9-9c9b-50444740588e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:52.076494 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c50abb0d-028f-4fe9-9c9b-50444740588e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.085730 Apr 05 12:18:52.077036 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1842/3660] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:51 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:53.097552 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3799eb2c-2208-47aa-8fc2-8df577f47f60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:53.098564 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3799eb2c-2208-47aa-8fc2-8df577f47f60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:53.106516 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3799eb2c-2208-47aa-8fc2-8df577f47f60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:53.106965 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3799eb2c-2208-47aa-8fc2-8df577f47f60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:53.107721 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3799eb2c-2208-47aa-8fc2-8df577f47f60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:53.108181 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3799eb2c-2208-47aa-8fc2-8df577f47f60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:53.167772 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3799eb2c-2208-47aa-8fc2-8df577f47f60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:53.175664 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3799eb2c-2208-47aa-8fc2-8df577f47f60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.084636 Apr 05 12:18:53.176262 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1819/3661] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:53 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:54.197102 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-577e6b8a-1470-4d6b-a39d-d61aa930039f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:54.198164 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-577e6b8a-1470-4d6b-a39d-d61aa930039f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:54.209640 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-577e6b8a-1470-4d6b-a39d-d61aa930039f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:54.210360 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-577e6b8a-1470-4d6b-a39d-d61aa930039f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:54.211556 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-577e6b8a-1470-4d6b-a39d-d61aa930039f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:54.211981 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-577e6b8a-1470-4d6b-a39d-d61aa930039f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:54.274156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-577e6b8a-1470-4d6b-a39d-d61aa930039f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:54.282359 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-577e6b8a-1470-4d6b-a39d-d61aa930039f tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.092222 Apr 05 12:18:54.282940 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1843/3662] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:54 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:55.304033 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e421f9bf-e2f3-40cc-a307-9242684cc2b3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:55.305091 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e421f9bf-e2f3-40cc-a307-9242684cc2b3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:55.315198 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e421f9bf-e2f3-40cc-a307-9242684cc2b3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:55.315946 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e421f9bf-e2f3-40cc-a307-9242684cc2b3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:55.317268 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e421f9bf-e2f3-40cc-a307-9242684cc2b3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:55.318032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e421f9bf-e2f3-40cc-a307-9242684cc2b3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:55.393187 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e421f9bf-e2f3-40cc-a307-9242684cc2b3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:55.401387 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e421f9bf-e2f3-40cc-a307-9242684cc2b3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.103738 Apr 05 12:18:55.401966 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1820/3663] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:55 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:56.418934 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-96abecaf-ea17-4802-ad51-6f00909bc0f6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:56.419660 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-96abecaf-ea17-4802-ad51-6f00909bc0f6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:56.427094 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-96abecaf-ea17-4802-ad51-6f00909bc0f6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:56.427602 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-96abecaf-ea17-4802-ad51-6f00909bc0f6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:56.428484 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-96abecaf-ea17-4802-ad51-6f00909bc0f6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:56.428974 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-96abecaf-ea17-4802-ad51-6f00909bc0f6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:56.490765 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-96abecaf-ea17-4802-ad51-6f00909bc0f6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:56.499370 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-96abecaf-ea17-4802-ad51-6f00909bc0f6 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.084839 Apr 05 12:18:56.499954 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1844/3664] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:56 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:57.520814 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a129c817-b579-41f1-a7ec-64bac25e38cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:57.521887 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a129c817-b579-41f1-a7ec-64bac25e38cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:57.532380 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a129c817-b579-41f1-a7ec-64bac25e38cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:57.533073 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a129c817-b579-41f1-a7ec-64bac25e38cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:57.534311 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a129c817-b579-41f1-a7ec-64bac25e38cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:57.534972 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a129c817-b579-41f1-a7ec-64bac25e38cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:57.597230 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a129c817-b579-41f1-a7ec-64bac25e38cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:57.605234 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a129c817-b579-41f1-a7ec-64bac25e38cb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.091109 Apr 05 12:18:57.605820 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1821/3665] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:57 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:58.627171 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-95b215ac-e180-40e7-95a4-dbd5759d6b89 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:58.628173 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-95b215ac-e180-40e7-95a4-dbd5759d6b89 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:58.638785 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95b215ac-e180-40e7-95a4-dbd5759d6b89 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:58.639537 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95b215ac-e180-40e7-95a4-dbd5759d6b89 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:58.640855 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95b215ac-e180-40e7-95a4-dbd5759d6b89 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:58.641578 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-95b215ac-e180-40e7-95a4-dbd5759d6b89 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:58.705805 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-95b215ac-e180-40e7-95a4-dbd5759d6b89 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:58.713847 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-95b215ac-e180-40e7-95a4-dbd5759d6b89 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.093654 Apr 05 12:18:58.714415 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1845/3666] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:58 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:59.734899 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9cf32109-0108-4218-92ef-be3e7c7e7dc2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:18:59.735822 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9cf32109-0108-4218-92ef-be3e7c7e7dc2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:18:59.746283 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9cf32109-0108-4218-92ef-be3e7c7e7dc2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:59.747017 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9cf32109-0108-4218-92ef-be3e7c7e7dc2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:59.748636 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9cf32109-0108-4218-92ef-be3e7c7e7dc2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:18:59.749351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9cf32109-0108-4218-92ef-be3e7c7e7dc2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:18:59.815352 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9cf32109-0108-4218-92ef-be3e7c7e7dc2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:18:59.823712 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9cf32109-0108-4218-92ef-be3e7c7e7dc2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.095313 Apr 05 12:18:59.824374 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1822/3667] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:18:59 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:00.841156 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b0044e81-c6cf-4e53-af94-fb818cefccbe tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:00.841743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b0044e81-c6cf-4e53-af94-fb818cefccbe tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:00.849974 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b0044e81-c6cf-4e53-af94-fb818cefccbe tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:00.850739 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b0044e81-c6cf-4e53-af94-fb818cefccbe tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:00.851979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b0044e81-c6cf-4e53-af94-fb818cefccbe tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:00.852755 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b0044e81-c6cf-4e53-af94-fb818cefccbe tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:00.918367 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b0044e81-c6cf-4e53-af94-fb818cefccbe tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:00.926576 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b0044e81-c6cf-4e53-af94-fb818cefccbe tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.089430 Apr 05 12:19:00.927153 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1846/3668] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:00 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:01.948011 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-246f7b27-a2ad-49a2-b550-8b7b81eec030 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:01.948980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-246f7b27-a2ad-49a2-b550-8b7b81eec030 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:01.959513 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-246f7b27-a2ad-49a2-b550-8b7b81eec030 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:01.960317 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-246f7b27-a2ad-49a2-b550-8b7b81eec030 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:01.961572 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-246f7b27-a2ad-49a2-b550-8b7b81eec030 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:01.962289 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-246f7b27-a2ad-49a2-b550-8b7b81eec030 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:02.026533 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-246f7b27-a2ad-49a2-b550-8b7b81eec030 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:02.034406 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-246f7b27-a2ad-49a2-b550-8b7b81eec030 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.093088 Apr 05 12:19:02.034983 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1823/3669] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:01 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:03.054897 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f26deaee-e581-4095-883a-bfa5ca739e6d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:03.055879 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f26deaee-e581-4095-883a-bfa5ca739e6d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:03.064265 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f26deaee-e581-4095-883a-bfa5ca739e6d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:03.064898 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f26deaee-e581-4095-883a-bfa5ca739e6d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:03.065872 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f26deaee-e581-4095-883a-bfa5ca739e6d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:03.066396 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f26deaee-e581-4095-883a-bfa5ca739e6d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:03.135636 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f26deaee-e581-4095-883a-bfa5ca739e6d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:03.143645 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f26deaee-e581-4095-883a-bfa5ca739e6d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.095191 Apr 05 12:19:03.144238 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1847/3670] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:03 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:04.164806 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-39b519b2-e079-4452-a357-4db93edb7b66 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:04.165455 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-39b519b2-e079-4452-a357-4db93edb7b66 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:04.172443 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-39b519b2-e079-4452-a357-4db93edb7b66 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:04.172895 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-39b519b2-e079-4452-a357-4db93edb7b66 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:04.173661 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-39b519b2-e079-4452-a357-4db93edb7b66 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:04.174092 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-39b519b2-e079-4452-a357-4db93edb7b66 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:04.241729 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-39b519b2-e079-4452-a357-4db93edb7b66 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:04.249911 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-39b519b2-e079-4452-a357-4db93edb7b66 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.091733 Apr 05 12:19:04.250488 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1824/3671] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:04 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:05.273775 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-61d77ac9-db2d-47e1-a615-ca83bccefc84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:05.274687 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-61d77ac9-db2d-47e1-a615-ca83bccefc84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:05.281871 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-61d77ac9-db2d-47e1-a615-ca83bccefc84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:05.282363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-61d77ac9-db2d-47e1-a615-ca83bccefc84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:05.283202 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-61d77ac9-db2d-47e1-a615-ca83bccefc84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:05.283675 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-61d77ac9-db2d-47e1-a615-ca83bccefc84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:05.351006 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-61d77ac9-db2d-47e1-a615-ca83bccefc84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:05.358956 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-61d77ac9-db2d-47e1-a615-ca83bccefc84 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.091694 Apr 05 12:19:05.359521 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1848/3672] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:05 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:06.380238 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-135579f6-901f-4de3-b213-010dab6ddec5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:06.381160 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-135579f6-901f-4de3-b213-010dab6ddec5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:06.388901 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-135579f6-901f-4de3-b213-010dab6ddec5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:06.389366 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-135579f6-901f-4de3-b213-010dab6ddec5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:06.390183 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-135579f6-901f-4de3-b213-010dab6ddec5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:06.390627 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-135579f6-901f-4de3-b213-010dab6ddec5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:06.455230 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-135579f6-901f-4de3-b213-010dab6ddec5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:06.463610 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-135579f6-901f-4de3-b213-010dab6ddec5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.089827 Apr 05 12:19:06.464201 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1825/3673] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:06 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:07.484687 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8db263ec-0813-45f4-a83e-23ea5dc1a4fa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:07.485623 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8db263ec-0813-45f4-a83e-23ea5dc1a4fa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:07.495547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8db263ec-0813-45f4-a83e-23ea5dc1a4fa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:07.495547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8db263ec-0813-45f4-a83e-23ea5dc1a4fa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:07.496347 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8db263ec-0813-45f4-a83e-23ea5dc1a4fa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:07.496768 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8db263ec-0813-45f4-a83e-23ea5dc1a4fa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:07.556271 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8db263ec-0813-45f4-a83e-23ea5dc1a4fa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:07.564450 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8db263ec-0813-45f4-a83e-23ea5dc1a4fa tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.086388 Apr 05 12:19:07.565022 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1849/3674] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:07 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:08.585553 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d79cf74a-392e-4d8b-a8c6-6371db873e48 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:08.586616 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d79cf74a-392e-4d8b-a8c6-6371db873e48 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:08.597613 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d79cf74a-392e-4d8b-a8c6-6371db873e48 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:08.598390 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d79cf74a-392e-4d8b-a8c6-6371db873e48 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:08.599609 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d79cf74a-392e-4d8b-a8c6-6371db873e48 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:08.600378 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d79cf74a-392e-4d8b-a8c6-6371db873e48 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:08.659749 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d79cf74a-392e-4d8b-a8c6-6371db873e48 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:08.668034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d79cf74a-392e-4d8b-a8c6-6371db873e48 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.089000 Apr 05 12:19:08.668644 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1826/3675] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:08 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:09.689362 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d4f60736-b20e-4398-9fa9-27615256b37c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:09.690266 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d4f60736-b20e-4398-9fa9-27615256b37c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:09.698798 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d4f60736-b20e-4398-9fa9-27615256b37c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:09.699217 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d4f60736-b20e-4398-9fa9-27615256b37c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:09.699966 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d4f60736-b20e-4398-9fa9-27615256b37c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:09.700426 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d4f60736-b20e-4398-9fa9-27615256b37c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:09.761830 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d4f60736-b20e-4398-9fa9-27615256b37c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:09.769839 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d4f60736-b20e-4398-9fa9-27615256b37c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.087234 Apr 05 12:19:09.770367 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1850/3676] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:09 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:10.791380 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f164ecc0-55ef-49d9-9b22-e377763c5a33 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:10.792305 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f164ecc0-55ef-49d9-9b22-e377763c5a33 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:10.802815 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f164ecc0-55ef-49d9-9b22-e377763c5a33 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:10.803563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f164ecc0-55ef-49d9-9b22-e377763c5a33 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:10.804864 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f164ecc0-55ef-49d9-9b22-e377763c5a33 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:10.805568 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f164ecc0-55ef-49d9-9b22-e377763c5a33 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:10.863606 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f164ecc0-55ef-49d9-9b22-e377763c5a33 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:10.871654 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f164ecc0-55ef-49d9-9b22-e377763c5a33 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.086891 Apr 05 12:19:10.872587 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1827/3677] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:10 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:11.889198 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5a86f3b9-13e0-4f70-a8eb-2aba7571b0f3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:11.889827 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5a86f3b9-13e0-4f70-a8eb-2aba7571b0f3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:11.897073 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5a86f3b9-13e0-4f70-a8eb-2aba7571b0f3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:11.897519 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5a86f3b9-13e0-4f70-a8eb-2aba7571b0f3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:11.898306 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5a86f3b9-13e0-4f70-a8eb-2aba7571b0f3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:11.898733 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5a86f3b9-13e0-4f70-a8eb-2aba7571b0f3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:11.963087 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5a86f3b9-13e0-4f70-a8eb-2aba7571b0f3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:11.971456 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5a86f3b9-13e0-4f70-a8eb-2aba7571b0f3 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.086133 Apr 05 12:19:11.972026 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1851/3678] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:11 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:12.992586 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5556dbb9-8dfe-4dbf-809e-3192bf506ff7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:12.993602 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5556dbb9-8dfe-4dbf-809e-3192bf506ff7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:13.001968 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5556dbb9-8dfe-4dbf-809e-3192bf506ff7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:13.002533 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5556dbb9-8dfe-4dbf-809e-3192bf506ff7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:13.003472 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5556dbb9-8dfe-4dbf-809e-3192bf506ff7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:13.004020 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5556dbb9-8dfe-4dbf-809e-3192bf506ff7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:13.307908 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5556dbb9-8dfe-4dbf-809e-3192bf506ff7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:13.321470 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5556dbb9-8dfe-4dbf-809e-3192bf506ff7 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.334937 Apr 05 12:19:13.322045 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1828/3679] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:12 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:14.341720 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4ee9be65-b2be-4bbb-af05-6a9d41cf967d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:14.342401 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4ee9be65-b2be-4bbb-af05-6a9d41cf967d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:14.351613 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4ee9be65-b2be-4bbb-af05-6a9d41cf967d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:14.352310 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4ee9be65-b2be-4bbb-af05-6a9d41cf967d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:14.353498 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4ee9be65-b2be-4bbb-af05-6a9d41cf967d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:14.354132 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4ee9be65-b2be-4bbb-af05-6a9d41cf967d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:14.422984 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4ee9be65-b2be-4bbb-af05-6a9d41cf967d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:14.431088 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4ee9be65-b2be-4bbb-af05-6a9d41cf967d tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.094679 Apr 05 12:19:14.431655 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1852/3680] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:14 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:15.450715 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b65c8e14-0f3b-4130-a7c9-6b811999cddc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:15.451308 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b65c8e14-0f3b-4130-a7c9-6b811999cddc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:15.458468 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b65c8e14-0f3b-4130-a7c9-6b811999cddc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:15.458913 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b65c8e14-0f3b-4130-a7c9-6b811999cddc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:15.459673 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b65c8e14-0f3b-4130-a7c9-6b811999cddc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:15.460109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b65c8e14-0f3b-4130-a7c9-6b811999cddc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:15.520298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b65c8e14-0f3b-4130-a7c9-6b811999cddc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:15.528505 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b65c8e14-0f3b-4130-a7c9-6b811999cddc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.082632 Apr 05 12:19:15.529076 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1829/3681] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:15 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:16.549548 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e858222d-37fa-4a31-92be-f1190e62cf39 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:16.550551 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e858222d-37fa-4a31-92be-f1190e62cf39 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:16.559664 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e858222d-37fa-4a31-92be-f1190e62cf39 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:16.560113 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e858222d-37fa-4a31-92be-f1190e62cf39 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:16.560904 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e858222d-37fa-4a31-92be-f1190e62cf39 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:16.561344 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e858222d-37fa-4a31-92be-f1190e62cf39 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:16.630094 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e858222d-37fa-4a31-92be-f1190e62cf39 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:16.638789 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e858222d-37fa-4a31-92be-f1190e62cf39 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.095750 Apr 05 12:19:16.639367 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1853/3682] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:16 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:17.659925 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b772d60a-5a22-4fae-9636-9490c64ecfb0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:17.660877 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b772d60a-5a22-4fae-9636-9490c64ecfb0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:17.669101 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b772d60a-5a22-4fae-9636-9490c64ecfb0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:17.669546 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b772d60a-5a22-4fae-9636-9490c64ecfb0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:17.670296 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b772d60a-5a22-4fae-9636-9490c64ecfb0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:17.670724 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-b772d60a-5a22-4fae-9636-9490c64ecfb0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:17.731326 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b772d60a-5a22-4fae-9636-9490c64ecfb0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:17.739458 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b772d60a-5a22-4fae-9636-9490c64ecfb0 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.086254 Apr 05 12:19:17.740050 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1830/3683] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:17 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:18.761063 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7a3323cb-f6ab-4e88-a1e7-2551f54483c5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:18.761931 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7a3323cb-f6ab-4e88-a1e7-2551f54483c5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:18.772645 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a3323cb-f6ab-4e88-a1e7-2551f54483c5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:18.773398 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a3323cb-f6ab-4e88-a1e7-2551f54483c5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:18.774666 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a3323cb-f6ab-4e88-a1e7-2551f54483c5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:18.775408 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7a3323cb-f6ab-4e88-a1e7-2551f54483c5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:18.836042 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7a3323cb-f6ab-4e88-a1e7-2551f54483c5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:18.844369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7a3323cb-f6ab-4e88-a1e7-2551f54483c5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.090066 Apr 05 12:19:18.844936 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1854/3684] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:18 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:19.864286 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-39f9fe0f-dfe5-4136-aee5-e3f4cfa819ce tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:19.864918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-39f9fe0f-dfe5-4136-aee5-e3f4cfa819ce tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:19.874760 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-39f9fe0f-dfe5-4136-aee5-e3f4cfa819ce tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:19.875375 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-39f9fe0f-dfe5-4136-aee5-e3f4cfa819ce tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:19.876475 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-39f9fe0f-dfe5-4136-aee5-e3f4cfa819ce tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:19.877095 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-39f9fe0f-dfe5-4136-aee5-e3f4cfa819ce tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:19.938714 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-39f9fe0f-dfe5-4136-aee5-e3f4cfa819ce tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:19.946541 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-39f9fe0f-dfe5-4136-aee5-e3f4cfa819ce tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.088588 Apr 05 12:19:19.947103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1831/3685] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:19 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:20.969423 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-81da464f-9e9e-4c39-a94d-dda6323f7e92 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:20.970039 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-81da464f-9e9e-4c39-a94d-dda6323f7e92 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:20.976735 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-81da464f-9e9e-4c39-a94d-dda6323f7e92 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:20.977182 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-81da464f-9e9e-4c39-a94d-dda6323f7e92 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:20.977938 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-81da464f-9e9e-4c39-a94d-dda6323f7e92 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:20.978365 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-81da464f-9e9e-4c39-a94d-dda6323f7e92 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:21.040877 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-81da464f-9e9e-4c39-a94d-dda6323f7e92 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:21.049081 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-81da464f-9e9e-4c39-a94d-dda6323f7e92 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.088699 Apr 05 12:19:21.049642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1855/3686] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:20 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:22.070313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a1ada7e7-0e94-4888-96ab-c0bfb0138f60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:22.071377 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a1ada7e7-0e94-4888-96ab-c0bfb0138f60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:22.078909 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a1ada7e7-0e94-4888-96ab-c0bfb0138f60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:22.079358 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a1ada7e7-0e94-4888-96ab-c0bfb0138f60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:22.080114 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a1ada7e7-0e94-4888-96ab-c0bfb0138f60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:22.080578 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a1ada7e7-0e94-4888-96ab-c0bfb0138f60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:22.151504 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a1ada7e7-0e94-4888-96ab-c0bfb0138f60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:22.159906 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a1ada7e7-0e94-4888-96ab-c0bfb0138f60 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.096198 Apr 05 12:19:22.160512 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1832/3687] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:22 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:23.181154 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d97f0c05-cbf5-4054-9a64-a214b4d1f031 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:23.182159 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d97f0c05-cbf5-4054-9a64-a214b4d1f031 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:23.189833 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d97f0c05-cbf5-4054-9a64-a214b4d1f031 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:23.190341 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d97f0c05-cbf5-4054-9a64-a214b4d1f031 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:23.191169 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d97f0c05-cbf5-4054-9a64-a214b4d1f031 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:23.191646 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d97f0c05-cbf5-4054-9a64-a214b4d1f031 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:23.252503 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d97f0c05-cbf5-4054-9a64-a214b4d1f031 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:23.260440 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d97f0c05-cbf5-4054-9a64-a214b4d1f031 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.085750 Apr 05 12:19:23.260930 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1856/3688] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:23 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:24.286514 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9db8b0d2-f911-4dee-b85a-2bc2d3fae716 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:24.287509 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9db8b0d2-f911-4dee-b85a-2bc2d3fae716 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:24.295735 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9db8b0d2-f911-4dee-b85a-2bc2d3fae716 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:24.296244 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9db8b0d2-f911-4dee-b85a-2bc2d3fae716 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:24.296991 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9db8b0d2-f911-4dee-b85a-2bc2d3fae716 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:24.297416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-9db8b0d2-f911-4dee-b85a-2bc2d3fae716 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:24.356410 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9db8b0d2-f911-4dee-b85a-2bc2d3fae716 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:24.364682 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9db8b0d2-f911-4dee-b85a-2bc2d3fae716 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.084955 Apr 05 12:19:24.365244 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1833/3689] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:24 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:25.385939 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-91efac3b-47ce-4a3f-a468-54fc43737545 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:25.386907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-91efac3b-47ce-4a3f-a468-54fc43737545 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:25.397459 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-91efac3b-47ce-4a3f-a468-54fc43737545 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:25.398190 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-91efac3b-47ce-4a3f-a468-54fc43737545 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:25.399419 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-91efac3b-47ce-4a3f-a468-54fc43737545 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:25.400138 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-91efac3b-47ce-4a3f-a468-54fc43737545 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:25.463729 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-91efac3b-47ce-4a3f-a468-54fc43737545 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:25.472754 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-91efac3b-47ce-4a3f-a468-54fc43737545 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 200 len: 1368 microversion: 2.1 time: 0.093317 Apr 05 12:19:25.473330 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1857/3690] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:25 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:25.489631 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e9fe4d12-3488-4e09-8e6d-5f05fb79fc21 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '.version_select at 0x7f161c321820>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:25.514274 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e9fe4d12-3488-4e09-8e6d-5f05fb79fc21 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508803354" status: 202 len: 0 microversion: 2.1 time: 0.028532 Apr 05 12:19:25.514847 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1834/3691] 10.222.0.61 () {58 vars in 1220 bytes} [Tue Apr 5 12:19:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508803354 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 12:19:26.434071 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6cc024fa-2c00-4873-860e-965ce459e772 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Action: 'create', calling method: .version_select at 0x7f161c440ee0>, body: {"keypair": {"name": "tempest-keypair-1991657516"}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:19:26.450592 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-6cc024fa-2c00-4873-860e-965ce459e772 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Getting quotas for project b7234d9802a44102946fc7fcb9b9a502. Resources: {'key_pairs'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 12:19:26.454839 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-6cc024fa-2c00-4873-860e-965ce459e772 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Getting quotas for user 1f5873fd4faf41e98bd9123b44dabb0b and project b7234d9802a44102946fc7fcb9b9a502. Resources: {'key_pairs'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 12:19:26.467908 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6cc024fa-2c00-4873-860e-965ce459e772 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [7573541a-9397-4faf-90a4-8bd8940d8345] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 05 12:19:27.479665 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [None req-6cc024fa-2c00-4873-860e-965ce459e772 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [7573541a-9397-4faf-90a4-8bd8940d8345] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 57766. Apr 05 12:19:27.864852 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-6cc024fa-2c00-4873-860e-965ce459e772 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Getting quotas for project b7234d9802a44102946fc7fcb9b9a502. Resources: {'key_pairs'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 12:19:27.868498 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-6cc024fa-2c00-4873-860e-965ce459e772 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Getting quotas for user 1f5873fd4faf41e98bd9123b44dabb0b and project b7234d9802a44102946fc7fcb9b9a502. Resources: {'key_pairs'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 12:19:27.881777 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6cc024fa-2c00-4873-860e-965ce459e772 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.452019 Apr 05 12:19:27.882375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1858/3692] 10.222.0.61 () {60 vars in 1157 bytes} [Tue Apr 5 12:19:26 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:29.190717 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c3d80c9a-1c60-4326-8d0f-aa34f5e6948c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1030636162", "imageRef": "2b657785-cb0b-43ba-956c-1564c27fd10a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "74281bd4-2cd1-4cd5-90f9-3eec19d74c11"}], "security_groups": [{"name": "tempest-securitygroup--1321034916"}], "key_name": "tempest-keypair-1991657516", "user_data": "}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:19:29.293629 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.network.neutron [None req-c3d80c9a-1c60-4326-8d0f-aa34f5e6948c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] validate_networks() for [('74281bd4-2cd1-4cd5-90f9-3eec19d74c11', None, None, None, None, None)] {{(pid=123357) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 12:19:29.706530 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-c3d80c9a-1c60-4326-8d0f-aa34f5e6948c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Flavor limits 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 12:19:29.707025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-c3d80c9a-1c60-4326-8d0f-aa34f5e6948c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Image limits 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:19:29.707532 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-c3d80c9a-1c60-4326-8d0f-aa34f5e6948c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Flavor pref 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 12:19:29.708145 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-c3d80c9a-1c60-4326-8d0f-aa34f5e6948c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Image pref 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:19:29.708840 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-c3d80c9a-1c60-4326-8d0f-aa34f5e6948c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 12:19:29.721719 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3d80c9a-1c60-4326-8d0f-aa34f5e6948c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:29.722285 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3d80c9a-1c60-4326-8d0f-aa34f5e6948c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:29.723509 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3d80c9a-1c60-4326-8d0f-aa34f5e6948c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:29.724193 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c3d80c9a-1c60-4326-8d0f-aa34f5e6948c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:29.742211 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-c3d80c9a-1c60-4326-8d0f-aa34f5e6948c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Getting quotas for project b7234d9802a44102946fc7fcb9b9a502. Resources: {'ram', 'instances', 'cores'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 12:19:29.746109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-c3d80c9a-1c60-4326-8d0f-aa34f5e6948c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Getting quotas for user 1f5873fd4faf41e98bd9123b44dabb0b and project b7234d9802a44102946fc7fcb9b9a502. Resources: {'ram', 'instances', 'cores'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 12:19:29.757386 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c3d80c9a-1c60-4326-8d0f-aa34f5e6948c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Going to run 1 instances... {{(pid=123357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 12:19:29.759624 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c3d80c9a-1c60-4326-8d0f-aa34f5e6948c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b657785-cb0b-43ba-956c-1564c27fd10a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 12:19:29.810912 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c3d80c9a-1c60-4326-8d0f-aa34f5e6948c tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.624509 Apr 05 12:19:29.811512 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1835/3693] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Apr 5 12:19:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 12:19:29.822051 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-20f40b7b-8787-4198-b849-d38ac5334c34 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:29.822757 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-20f40b7b-8787-4198-b849-d38ac5334c34 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:29.877543 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-20f40b7b-8787-4198-b849-d38ac5334c34 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:29.884901 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-20f40b7b-8787-4198-b849-d38ac5334c34 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931" status: 200 len: 1238 microversion: 2.1 time: 0.066589 Apr 05 12:19:29.885474 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1859/3694] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:29 2022] GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:19:30.906773 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f6f1bdc8-d190-4d05-83d9-731d783a7168 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:30.907661 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f6f1bdc8-d190-4d05-83d9-731d783a7168 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:30.970663 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f6f1bdc8-d190-4d05-83d9-731d783a7168 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:30.977618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f6f1bdc8-d190-4d05-83d9-731d783a7168 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931" status: 200 len: 1238 microversion: 2.1 time: 0.078315 Apr 05 12:19:30.978178 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1836/3695] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:30 2022] GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 => generated 1238 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:31.997798 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-da7ea353-bb17-404c-8865-2c08b8419235 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:31.998468 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-da7ea353-bb17-404c-8865-2c08b8419235 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:32.005103 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-da7ea353-bb17-404c-8865-2c08b8419235 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:32.005541 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-da7ea353-bb17-404c-8865-2c08b8419235 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:32.006302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-da7ea353-bb17-404c-8865-2c08b8419235 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:32.006723 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-da7ea353-bb17-404c-8865-2c08b8419235 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:32.071972 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-da7ea353-bb17-404c-8865-2c08b8419235 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:32.079662 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-da7ea353-bb17-404c-8865-2c08b8419235 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931" status: 200 len: 1296 microversion: 2.1 time: 0.088029 Apr 05 12:19:32.080371 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1860/3696] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:31 2022] GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 => generated 1296 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:33.097343 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8c96949c-7926-4a76-9818-6cd34d28a81e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:33.097993 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8c96949c-7926-4a76-9818-6cd34d28a81e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:33.104633 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c96949c-7926-4a76-9818-6cd34d28a81e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:33.105086 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c96949c-7926-4a76-9818-6cd34d28a81e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:33.105862 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c96949c-7926-4a76-9818-6cd34d28a81e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:33.106332 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8c96949c-7926-4a76-9818-6cd34d28a81e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:33.238981 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8c96949c-7926-4a76-9818-6cd34d28a81e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:33.246561 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8c96949c-7926-4a76-9818-6cd34d28a81e tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931" status: 200 len: 1364 microversion: 2.1 time: 0.153143 Apr 05 12:19:33.247653 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1837/3697] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:33 2022] GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:33.514350 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-d0631abc-7b0e-4d5b-b1d8-2ad955553fff req-7b51f9e5-be1a-4061-89e0-220e8198447b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931", "tag": "9535d833-1050-423b-b0fe-c8f083a075e6"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:19:33.523067 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-d0631abc-7b0e-4d5b-b1d8-2ad955553fff req-7b51f9e5-be1a-4061-89e0-220e8198447b service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:33.523668 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-d0631abc-7b0e-4d5b-b1d8-2ad955553fff req-7b51f9e5-be1a-4061-89e0-220e8198447b service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:33.535320 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-d0631abc-7b0e-4d5b-b1d8-2ad955553fff req-7b51f9e5-be1a-4061-89e0-220e8198447b service nova] Creating event network-changed:9535d833-1050-423b-b0fe-c8f083a075e6 for instance fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 on hv-cinder-82956 Apr 05 12:19:33.538790 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: ERROR oslo.messaging._drivers.impl_rabbit [req-d0631abc-7b0e-4d5b-b1d8-2ad955553fff req-7b51f9e5-be1a-4061-89e0-220e8198447b service nova] [e6265317-2d2a-45c5-bd88-0f448f04f9de] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 05 12:19:34.268034 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c1c7840b-b655-446e-86b7-c48e5f0005b2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:34.269248 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c1c7840b-b655-446e-86b7-c48e5f0005b2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:34.279987 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1c7840b-b655-446e-86b7-c48e5f0005b2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:34.280794 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1c7840b-b655-446e-86b7-c48e5f0005b2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:34.282041 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1c7840b-b655-446e-86b7-c48e5f0005b2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:34.282832 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1c7840b-b655-446e-86b7-c48e5f0005b2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:34.434782 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c1c7840b-b655-446e-86b7-c48e5f0005b2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:34.442616 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c1c7840b-b655-446e-86b7-c48e5f0005b2 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931" status: 200 len: 1364 microversion: 2.1 time: 0.181257 Apr 05 12:19:34.443166 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1838/3698] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:34 2022] GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:34.550867 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [req-d0631abc-7b0e-4d5b-b1d8-2ad955553fff req-7b51f9e5-be1a-4061-89e0-220e8198447b service nova] [e6265317-2d2a-45c5-bd88-0f448f04f9de] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 57832. Apr 05 12:19:34.556732 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-d0631abc-7b0e-4d5b-b1d8-2ad955553fff req-7b51f9e5-be1a-4061-89e0-220e8198447b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.115381 Apr 05 12:19:34.558040 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1861/3699] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:19:35.459625 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fbe41a74-bf9e-4809-ab73-5692e3a27b86 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:35.460253 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fbe41a74-bf9e-4809-ab73-5692e3a27b86 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:35.466520 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fbe41a74-bf9e-4809-ab73-5692e3a27b86 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:35.466971 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fbe41a74-bf9e-4809-ab73-5692e3a27b86 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:35.467757 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fbe41a74-bf9e-4809-ab73-5692e3a27b86 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:35.468226 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fbe41a74-bf9e-4809-ab73-5692e3a27b86 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:35.597715 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fbe41a74-bf9e-4809-ab73-5692e3a27b86 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:35.605024 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fbe41a74-bf9e-4809-ab73-5692e3a27b86 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931" status: 200 len: 1364 microversion: 2.1 time: 0.149334 Apr 05 12:19:35.605776 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1839/3700] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:35 2022] GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:36.628666 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6368339c-3721-40eb-9707-9b5d90b4a2e5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:36.629806 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6368339c-3721-40eb-9707-9b5d90b4a2e5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:36.640427 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6368339c-3721-40eb-9707-9b5d90b4a2e5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:36.641185 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6368339c-3721-40eb-9707-9b5d90b4a2e5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:36.642445 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6368339c-3721-40eb-9707-9b5d90b4a2e5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:36.643171 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6368339c-3721-40eb-9707-9b5d90b4a2e5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:36.790174 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6368339c-3721-40eb-9707-9b5d90b4a2e5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:36.798217 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6368339c-3721-40eb-9707-9b5d90b4a2e5 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931" status: 200 len: 1364 microversion: 2.1 time: 0.177908 Apr 05 12:19:36.798792 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1862/3701] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:36 2022] GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:37.654895 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-2593668b-744c-46d1-8a68-e16443ef6ef9 req-800df68b-f125-4c73-aa9e-a16a25427426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931", "name": "network-vif-plugged", "status": "completed", "tag": "9535d833-1050-423b-b0fe-c8f083a075e6"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:19:37.663859 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-2593668b-744c-46d1-8a68-e16443ef6ef9 req-800df68b-f125-4c73-aa9e-a16a25427426 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:37.664267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-2593668b-744c-46d1-8a68-e16443ef6ef9 req-800df68b-f125-4c73-aa9e-a16a25427426 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:37.676328 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-2593668b-744c-46d1-8a68-e16443ef6ef9 req-800df68b-f125-4c73-aa9e-a16a25427426 service nova] Creating event network-vif-plugged:9535d833-1050-423b-b0fe-c8f083a075e6 for instance fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 on hv-cinder-82956 Apr 05 12:19:37.682331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-2593668b-744c-46d1-8a68-e16443ef6ef9 req-800df68b-f125-4c73-aa9e-a16a25427426 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081934 Apr 05 12:19:37.682912 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1840/3702] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:19:37.815048 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8ef5a2c1-719b-40ba-9f89-8c4674b76a74 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:37.815692 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8ef5a2c1-719b-40ba-9f89-8c4674b76a74 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:37.822337 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8ef5a2c1-719b-40ba-9f89-8c4674b76a74 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:37.822809 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8ef5a2c1-719b-40ba-9f89-8c4674b76a74 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:37.823553 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8ef5a2c1-719b-40ba-9f89-8c4674b76a74 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:37.824098 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8ef5a2c1-719b-40ba-9f89-8c4674b76a74 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:37.994063 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8ef5a2c1-719b-40ba-9f89-8c4674b76a74 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:38.001846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8ef5a2c1-719b-40ba-9f89-8c4674b76a74 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931" status: 200 len: 1364 microversion: 2.1 time: 0.190738 Apr 05 12:19:38.002445 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1863/3703] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:37 2022] GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:39.019474 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0e334ca2-839f-491f-b598-8149a79df334 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:39.020229 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0e334ca2-839f-491f-b598-8149a79df334 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:39.027244 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0e334ca2-839f-491f-b598-8149a79df334 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:39.027707 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0e334ca2-839f-491f-b598-8149a79df334 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:39.028519 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0e334ca2-839f-491f-b598-8149a79df334 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:39.028953 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0e334ca2-839f-491f-b598-8149a79df334 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:39.172939 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0e334ca2-839f-491f-b598-8149a79df334 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:39.181179 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0e334ca2-839f-491f-b598-8149a79df334 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931" status: 200 len: 1364 microversion: 2.1 time: 0.166186 Apr 05 12:19:39.181750 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1841/3704] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:39 2022] GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:40.200795 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c9f7d04e-16a0-43e1-9a8a-4ea25dcc65bb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:40.201405 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c9f7d04e-16a0-43e1-9a8a-4ea25dcc65bb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:40.207882 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9f7d04e-16a0-43e1-9a8a-4ea25dcc65bb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:40.208360 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9f7d04e-16a0-43e1-9a8a-4ea25dcc65bb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:40.209116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9f7d04e-16a0-43e1-9a8a-4ea25dcc65bb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:40.209549 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c9f7d04e-16a0-43e1-9a8a-4ea25dcc65bb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:40.348509 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c9f7d04e-16a0-43e1-9a8a-4ea25dcc65bb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:19:40.358903 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c9f7d04e-16a0-43e1-9a8a-4ea25dcc65bb tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931" status: 200 len: 1550 microversion: 2.1 time: 0.163218 Apr 05 12:19:40.359440 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1864/3705] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:19:40 2022] GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 => generated 1550 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:40.375387 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0880eaf1-5e6e-4354-9e5b-07223c48e604 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:19:40.375947 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0880eaf1-5e6e-4354-9e5b-07223c48e604 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:19:40.382250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0880eaf1-5e6e-4354-9e5b-07223c48e604 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:40.382690 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0880eaf1-5e6e-4354-9e5b-07223c48e604 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:40.383430 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0880eaf1-5e6e-4354-9e5b-07223c48e604 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:40.383852 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0880eaf1-5e6e-4354-9e5b-07223c48e604 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:40.487165 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0880eaf1-5e6e-4354-9e5b-07223c48e604 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115873 Apr 05 12:19:40.487733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1842/3706] 10.222.0.61 () {58 vars in 1274 bytes} [Tue Apr 5 12:19:40 2022] GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:19:41.501395 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-272b7aec-ec98-44dc-be28-e94e398c9641 req-5dbd52d7-db1c-480b-bd78-005e478e25d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931", "tag": "9535d833-1050-423b-b0fe-c8f083a075e6"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:19:41.509422 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-272b7aec-ec98-44dc-be28-e94e398c9641 req-5dbd52d7-db1c-480b-bd78-005e478e25d3 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:19:41.509854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-272b7aec-ec98-44dc-be28-e94e398c9641 req-5dbd52d7-db1c-480b-bd78-005e478e25d3 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:19:41.521264 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-272b7aec-ec98-44dc-be28-e94e398c9641 req-5dbd52d7-db1c-480b-bd78-005e478e25d3 service nova] Creating event network-changed:9535d833-1050-423b-b0fe-c8f083a075e6 for instance fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 on hv-cinder-82956 Apr 05 12:19:41.526684 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-272b7aec-ec98-44dc-be28-e94e398c9641 req-5dbd52d7-db1c-480b-bd78-005e478e25d3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079431 Apr 05 12:19:41.527381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1865/3707] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:19:44.323256 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:19:44.324636 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Tue Apr 5 12:19:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:20:17.699273 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6f1e32cc-b88c-4fe9-8502-32ce31899d3a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:20:17.700487 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6f1e32cc-b88c-4fe9-8502-32ce31899d3a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:20:17.706867 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6f1e32cc-b88c-4fe9-8502-32ce31899d3a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:20:17.707320 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6f1e32cc-b88c-4fe9-8502-32ce31899d3a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:20:17.708110 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6f1e32cc-b88c-4fe9-8502-32ce31899d3a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:20:17.708557 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6f1e32cc-b88c-4fe9-8502-32ce31899d3a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:20:17.731269 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6f1e32cc-b88c-4fe9-8502-32ce31899d3a tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931/ips" status: 200 len: 146 microversion: 2.1 time: 0.040172 Apr 05 12:20:17.731877 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1843/3708] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Apr 5 12:20:17 2022] GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:21:17.884957 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-63ee83ee-3ed5-49f9-a9e8-2ac39fb5d619 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:21:17.885642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-63ee83ee-3ed5-49f9-a9e8-2ac39fb5d619 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:21:17.891718 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-63ee83ee-3ed5-49f9-a9e8-2ac39fb5d619 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:21:17.892199 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-63ee83ee-3ed5-49f9-a9e8-2ac39fb5d619 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:21:17.892951 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-63ee83ee-3ed5-49f9-a9e8-2ac39fb5d619 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:21:17.893485 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-63ee83ee-3ed5-49f9-a9e8-2ac39fb5d619 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:21:17.918920 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-63ee83ee-3ed5-49f9-a9e8-2ac39fb5d619 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931] Going to try to terminate instance {{(pid=123358) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 12:21:18.003127 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-63ee83ee-3ed5-49f9-a9e8-2ac39fb5d619 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931" status: 204 len: 0 microversion: 2.1 time: 0.181205 Apr 05 12:21:18.003709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1866/3709] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 12:21:17 2022] DELETE /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:21:18.013749 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-03475651-ee55-4c64-b13a-cd773e8bf5fc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:21:18.014351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-03475651-ee55-4c64-b13a-cd773e8bf5fc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:21:18.020585 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03475651-ee55-4c64-b13a-cd773e8bf5fc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:21:18.021035 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03475651-ee55-4c64-b13a-cd773e8bf5fc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:21:18.021828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03475651-ee55-4c64-b13a-cd773e8bf5fc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:21:18.022260 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-03475651-ee55-4c64-b13a-cd773e8bf5fc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:21:18.164743 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-03475651-ee55-4c64-b13a-cd773e8bf5fc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:21:18.173051 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-03475651-ee55-4c64-b13a-cd773e8bf5fc tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931" status: 200 len: 1675 microversion: 2.1 time: 0.164856 Apr 05 12:21:18.173645 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1844/3710] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:21:18 2022] GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:21:19.195221 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0203bc6f-98d4-48df-99d2-fc100a0b6583 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:21:19.196396 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0203bc6f-98d4-48df-99d2-fc100a0b6583 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:21:19.206511 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0203bc6f-98d4-48df-99d2-fc100a0b6583 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:21:19.206957 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0203bc6f-98d4-48df-99d2-fc100a0b6583 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:21:19.207708 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0203bc6f-98d4-48df-99d2-fc100a0b6583 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:21:19.208163 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0203bc6f-98d4-48df-99d2-fc100a0b6583 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:21:19.371303 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0203bc6f-98d4-48df-99d2-fc100a0b6583 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:21:19.378950 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0203bc6f-98d4-48df-99d2-fc100a0b6583 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931" status: 200 len: 1675 microversion: 2.1 time: 0.190904 Apr 05 12:21:19.379522 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1867/3711] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:21:19 2022] GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 => generated 1675 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:21:20.237424 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-60b0f252-1142-40b5-a400-6a6b722d515c req-aa1a9b6a-ef8f-48df-bd31-6ff3907d81f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931", "name": "network-vif-deleted", "tag": "9535d833-1050-423b-b0fe-c8f083a075e6"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:21:20.245885 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-60b0f252-1142-40b5-a400-6a6b722d515c req-aa1a9b6a-ef8f-48df-bd31-6ff3907d81f0 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:21:20.246327 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-60b0f252-1142-40b5-a400-6a6b722d515c req-aa1a9b6a-ef8f-48df-bd31-6ff3907d81f0 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:21:20.257669 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-60b0f252-1142-40b5-a400-6a6b722d515c req-aa1a9b6a-ef8f-48df-bd31-6ff3907d81f0 service nova] Creating event network-vif-deleted:9535d833-1050-423b-b0fe-c8f083a075e6 for instance fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 on hv-cinder-82956 Apr 05 12:21:20.263074 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-60b0f252-1142-40b5-a400-6a6b722d515c req-aa1a9b6a-ef8f-48df-bd31-6ff3907d81f0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029618 Apr 05 12:21:20.268229 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1845/3712] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:21:20.397107 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-79d860cf-fe0e-4fdf-9074-7d032019c6b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:21:20.397833 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-79d860cf-fe0e-4fdf-9074-7d032019c6b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:21:20.404572 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79d860cf-fe0e-4fdf-9074-7d032019c6b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:21:20.405024 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79d860cf-fe0e-4fdf-9074-7d032019c6b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:21:20.406014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79d860cf-fe0e-4fdf-9074-7d032019c6b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:21:20.406642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79d860cf-fe0e-4fdf-9074-7d032019c6b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:21:20.442807 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79d860cf-fe0e-4fdf-9074-7d032019c6b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:21:20.443256 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-79d860cf-fe0e-4fdf-9074-7d032019c6b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:21:20.443713 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.objects.instance [None req-79d860cf-fe0e-4fdf-9074-7d032019c6b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lazy-loading 'fault' on Instance uuid fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 {{(pid=123358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 12:21:20.487179 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-79d860cf-fe0e-4fdf-9074-7d032019c6b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5873fd4faf41e98bd9123b44dabb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7234d9802a44102946fc7fcb9b9a502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:21:20.495601 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-79d860cf-fe0e-4fdf-9074-7d032019c6b4 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931" status: 200 len: 1328 microversion: 2.1 time: 0.102798 Apr 05 12:21:20.496214 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1868/3713] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:21:20 2022] GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:21:21.514005 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a007f1f7-a46b-4ab2-a2f8-76422eead043 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:21:21.514701 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a007f1f7-a46b-4ab2-a2f8-76422eead043 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:21:21.521487 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a007f1f7-a46b-4ab2-a2f8-76422eead043 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:21:21.521931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a007f1f7-a46b-4ab2-a2f8-76422eead043 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:21:21.522692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a007f1f7-a46b-4ab2-a2f8-76422eead043 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:21:21.523157 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a007f1f7-a46b-4ab2-a2f8-76422eead043 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:21:21.536599 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-a007f1f7-a46b-4ab2-a2f8-76422eead043 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] HTTP exception thrown: Instance fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 could not be found. Apr 05 12:21:21.537180 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a007f1f7-a46b-4ab2-a2f8-76422eead043 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Returning 404 to user: Instance fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 could not be found. {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:21:21.537980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a007f1f7-a46b-4ab2-a2f8-76422eead043 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931" status: 404 len: 111 microversion: 2.1 time: 0.028725 Apr 05 12:21:21.538503 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1846/3714] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:21:21 2022] GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:21:21.546955 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-94986939-4345-4e4b-9e77-acc50c75ee71 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '.version_select at 0x7f161c260a60>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:21:21.567536 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-94986939-4345-4e4b-9e77-acc50c75ee71 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1991657516" status: 202 len: 0 microversion: 2.1 time: 0.024385 Apr 05 12:21:21.568094 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1869/3715] 10.222.0.61 () {58 vars in 1220 bytes} [Tue Apr 5 12:21:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1991657516 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:21:22.192868 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bf5cd9de-dbe9-407e-ae09-5a48f6a87f20 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:21:22.193365 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bf5cd9de-dbe9-407e-ae09-5a48f6a87f20 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:21:22.199730 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bf5cd9de-dbe9-407e-ae09-5a48f6a87f20 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:21:22.200205 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bf5cd9de-dbe9-407e-ae09-5a48f6a87f20 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:21:22.200964 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bf5cd9de-dbe9-407e-ae09-5a48f6a87f20 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:21:22.201395 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bf5cd9de-dbe9-407e-ae09-5a48f6a87f20 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:21:22.214466 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-bf5cd9de-dbe9-407e-ae09-5a48f6a87f20 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] HTTP exception thrown: Instance fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 could not be found. Apr 05 12:21:22.215040 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bf5cd9de-dbe9-407e-ae09-5a48f6a87f20 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Returning 404 to user: Instance fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 could not be found. {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:21:22.215836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bf5cd9de-dbe9-407e-ae09-5a48f6a87f20 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931" status: 404 len: 111 microversion: 2.1 time: 0.027035 Apr 05 12:21:22.216387 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1847/3716] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 12:21:22 2022] DELETE /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:21:22.224630 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1f296424-9621-484c-85f3-73eb00224027 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:21:22.225230 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1f296424-9621-484c-85f3-73eb00224027 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:21:22.231562 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1f296424-9621-484c-85f3-73eb00224027 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:21:22.232007 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1f296424-9621-484c-85f3-73eb00224027 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:21:22.232784 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1f296424-9621-484c-85f3-73eb00224027 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:21:22.233213 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1f296424-9621-484c-85f3-73eb00224027 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:21:22.247148 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.wsgi [None req-1f296424-9621-484c-85f3-73eb00224027 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] HTTP exception thrown: Instance fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 could not be found. Apr 05 12:21:22.247729 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1f296424-9621-484c-85f3-73eb00224027 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Returning 404 to user: Instance fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 could not be found. {{(pid=123358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:21:22.248669 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1f296424-9621-484c-85f3-73eb00224027 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931" status: 404 len: 111 microversion: 2.1 time: 0.027939 Apr 05 12:21:22.249163 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1870/3717] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:21:22 2022] GET /compute/v2.1/servers/fa75a8b6-7c1f-4d0e-a36b-3e91ce8a6931 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:22:22.591374 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-59719299-0ec9-41e3-a4b4-e3ef3aaa9a2b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:22:22.591969 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-59719299-0ec9-41e3-a4b4-e3ef3aaa9a2b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 64db0811-1092-48cb-b6aa-9018da662bfc] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:22:22.598069 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-59719299-0ec9-41e3-a4b4-e3ef3aaa9a2b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:22.598488 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-59719299-0ec9-41e3-a4b4-e3ef3aaa9a2b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:22.599545 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-59719299-0ec9-41e3-a4b4-e3ef3aaa9a2b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:22.600029 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-59719299-0ec9-41e3-a4b4-e3ef3aaa9a2b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:22.625245 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-59719299-0ec9-41e3-a4b4-e3ef3aaa9a2b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 64db0811-1092-48cb-b6aa-9018da662bfc] Going to try to terminate instance {{(pid=123357) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 12:22:22.667842 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d29b4f98-c904-45f5-bd45-e0707f8a257c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:22:22.668508 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d29b4f98-c904-45f5-bd45-e0707f8a257c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e045d626-74de-4955-85df-c15ce8e5f33d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:22:22.674500 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d29b4f98-c904-45f5-bd45-e0707f8a257c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:22.675225 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d29b4f98-c904-45f5-bd45-e0707f8a257c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:22.675999 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d29b4f98-c904-45f5-bd45-e0707f8a257c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:22.676465 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d29b4f98-c904-45f5-bd45-e0707f8a257c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:22.710167 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d29b4f98-c904-45f5-bd45-e0707f8a257c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e045d626-74de-4955-85df-c15ce8e5f33d] Going to try to terminate instance {{(pid=123358) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 12:22:22.711935 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-59719299-0ec9-41e3-a4b4-e3ef3aaa9a2b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "DELETE /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc" status: 204 len: 0 microversion: 2.20 time: 0.124810 Apr 05 12:22:22.713026 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1848/3718] 10.222.0.61 () {60 vars in 1279 bytes} [Tue Apr 5 12:22:22 2022] DELETE /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 05 12:22:22.721747 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-acd85129-a712-45e7-b7f9-890ea50bd56b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:22:22.722463 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-acd85129-a712-45e7-b7f9-890ea50bd56b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 64db0811-1092-48cb-b6aa-9018da662bfc] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:22:22.729126 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-acd85129-a712-45e7-b7f9-890ea50bd56b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:22.729565 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-acd85129-a712-45e7-b7f9-890ea50bd56b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:22.730583 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-acd85129-a712-45e7-b7f9-890ea50bd56b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:22.731012 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-acd85129-a712-45e7-b7f9-890ea50bd56b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:22.792523 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d29b4f98-c904-45f5-bd45-e0707f8a257c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d" status: 204 len: 0 microversion: 2.1 time: 0.129435 Apr 05 12:22:22.794369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1871/3719] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 12:22:22 2022] DELETE /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:22:22.801686 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-710dd90c-2a83-4a0f-85f1-4e5aba52b757 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:22:22.802642 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-710dd90c-2a83-4a0f-85f1-4e5aba52b757 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e045d626-74de-4955-85df-c15ce8e5f33d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:22:22.808405 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-710dd90c-2a83-4a0f-85f1-4e5aba52b757 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:22.808846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-710dd90c-2a83-4a0f-85f1-4e5aba52b757 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:22.809606 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-710dd90c-2a83-4a0f-85f1-4e5aba52b757 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:22.810033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-710dd90c-2a83-4a0f-85f1-4e5aba52b757 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:22.869248 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-acd85129-a712-45e7-b7f9-890ea50bd56b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:22:22.877190 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-acd85129-a712-45e7-b7f9-890ea50bd56b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:22:22.878703 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-acd85129-a712-45e7-b7f9-890ea50bd56b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:22:22.879869 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-acd85129-a712-45e7-b7f9-890ea50bd56b tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc" status: 200 len: 1724 microversion: 2.20 time: 0.162344 Apr 05 12:22:22.880470 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1849/3720] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:22:22 2022] GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:22:22.941680 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-710dd90c-2a83-4a0f-85f1-4e5aba52b757 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:22:22.949347 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-710dd90c-2a83-4a0f-85f1-4e5aba52b757 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d" status: 200 len: 1679 microversion: 2.1 time: 0.151764 Apr 05 12:22:22.949932 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1872/3721] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:22:22 2022] GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:22:23.899450 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-292079aa-5def-40d3-a8f7-2c7774725a14 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:22:23.900862 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-292079aa-5def-40d3-a8f7-2c7774725a14 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 64db0811-1092-48cb-b6aa-9018da662bfc] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:22:23.907164 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-292079aa-5def-40d3-a8f7-2c7774725a14 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:23.907611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-292079aa-5def-40d3-a8f7-2c7774725a14 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:23.908600 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-292079aa-5def-40d3-a8f7-2c7774725a14 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:23.909203 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-292079aa-5def-40d3-a8f7-2c7774725a14 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:23.967260 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4aebd108-a150-4104-a3e3-19a934005152 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:22:23.968166 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4aebd108-a150-4104-a3e3-19a934005152 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e045d626-74de-4955-85df-c15ce8e5f33d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:22:23.975106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4aebd108-a150-4104-a3e3-19a934005152 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:23.975701 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4aebd108-a150-4104-a3e3-19a934005152 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:23.976606 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4aebd108-a150-4104-a3e3-19a934005152 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:23.977279 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4aebd108-a150-4104-a3e3-19a934005152 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:23.981976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-292079aa-5def-40d3-a8f7-2c7774725a14 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:22:23.994369 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-292079aa-5def-40d3-a8f7-2c7774725a14 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:22:23.997946 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-292079aa-5def-40d3-a8f7-2c7774725a14 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88cd8fe1bb69438bace9d89ee9b5e88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3713b85b0994fa58ad2bc1e17407387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:22:24.000103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-292079aa-5def-40d3-a8f7-2c7774725a14 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc" status: 200 len: 1656 microversion: 2.20 time: 0.104507 Apr 05 12:22:24.011969 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1850/3722] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:22:23 2022] GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc => generated 1656 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:22:24.194119 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-dbd22354-ef2e-498e-ad36-5347fff7f79a req-93684ebf-0f58-41e7-8476-dfbd0805a2cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64db0811-1092-48cb-b6aa-9018da662bfc", "name": "network-vif-deleted", "tag": "311b46f0-2b31-4866-8942-835f4de933e0"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:22:24.208940 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-dbd22354-ef2e-498e-ad36-5347fff7f79a req-93684ebf-0f58-41e7-8476-dfbd0805a2cb service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:24.209689 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-dbd22354-ef2e-498e-ad36-5347fff7f79a req-93684ebf-0f58-41e7-8476-dfbd0805a2cb service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:24.223740 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4aebd108-a150-4104-a3e3-19a934005152 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:22:24.233277 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4aebd108-a150-4104-a3e3-19a934005152 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d" status: 200 len: 1679 microversion: 2.1 time: 0.270133 Apr 05 12:22:24.234590 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1873/3723] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:22:23 2022] GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d => generated 1679 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:22:24.236039 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-dbd22354-ef2e-498e-ad36-5347fff7f79a req-93684ebf-0f58-41e7-8476-dfbd0805a2cb service nova] Creating event network-vif-deleted:311b46f0-2b31-4866-8942-835f4de933e0 for instance 64db0811-1092-48cb-b6aa-9018da662bfc on hv-cinder-82956 Apr 05 12:22:24.241838 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-dbd22354-ef2e-498e-ad36-5347fff7f79a req-93684ebf-0f58-41e7-8476-dfbd0805a2cb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052170 Apr 05 12:22:24.243835 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1851/3724] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:22:24.534461 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-bbdc0cb8-279d-4fe6-a48a-8ef54b316f22 req-b354251f-da10-4be1-9b24-87e6306b1a38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e045d626-74de-4955-85df-c15ce8e5f33d", "name": "network-vif-deleted", "tag": "40af0dc8-4ea4-4c16-86c7-1bcf48b1c93a"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:22:24.548594 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-bbdc0cb8-279d-4fe6-a48a-8ef54b316f22 req-b354251f-da10-4be1-9b24-87e6306b1a38 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:24.549564 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-bbdc0cb8-279d-4fe6-a48a-8ef54b316f22 req-b354251f-da10-4be1-9b24-87e6306b1a38 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:24.565670 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-bbdc0cb8-279d-4fe6-a48a-8ef54b316f22 req-b354251f-da10-4be1-9b24-87e6306b1a38 service nova] Creating event network-vif-deleted:40af0dc8-4ea4-4c16-86c7-1bcf48b1c93a for instance e045d626-74de-4955-85df-c15ce8e5f33d on hv-cinder-82956 Apr 05 12:22:24.576100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-bbdc0cb8-279d-4fe6-a48a-8ef54b316f22 req-b354251f-da10-4be1-9b24-87e6306b1a38 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046139 Apr 05 12:22:24.582092 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1874/3725] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:22:25.021099 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c1239d1f-ebce-4a68-99bf-6223e4236c6a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:22:25.022807 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c1239d1f-ebce-4a68-99bf-6223e4236c6a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 64db0811-1092-48cb-b6aa-9018da662bfc] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:22:25.031349 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1239d1f-ebce-4a68-99bf-6223e4236c6a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:25.032322 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1239d1f-ebce-4a68-99bf-6223e4236c6a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:25.033180 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1239d1f-ebce-4a68-99bf-6223e4236c6a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:25.033827 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c1239d1f-ebce-4a68-99bf-6223e4236c6a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:25.051935 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-c1239d1f-ebce-4a68-99bf-6223e4236c6a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] HTTP exception thrown: Instance 64db0811-1092-48cb-b6aa-9018da662bfc could not be found. Apr 05 12:22:25.053045 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c1239d1f-ebce-4a68-99bf-6223e4236c6a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Returning 404 to user: Instance 64db0811-1092-48cb-b6aa-9018da662bfc could not be found. {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:22:25.054152 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c1239d1f-ebce-4a68-99bf-6223e4236c6a tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc" status: 404 len: 111 microversion: 2.20 time: 0.038985 Apr 05 12:22:25.055201 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1852/3726] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:22:25 2022] GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 05 12:22:25.065430 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7a68cdea-0aac-4734-adb9-c6a4e36b77f8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '.version_select at 0x7f161c2ea3a0>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:22:25.085830 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7a68cdea-0aac-4734-adb9-c6a4e36b77f8 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1701985553" status: 204 len: 0 microversion: 2.20 time: 0.024781 Apr 05 12:22:25.086808 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1875/3727] 10.222.0.61 () {60 vars in 1261 bytes} [Tue Apr 5 12:22:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1701985553 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 05 12:22:25.251277 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5fd6e635-b18d-466a-a8a9-25cc491c776c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:22:25.251400 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5fd6e635-b18d-466a-a8a9-25cc491c776c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e045d626-74de-4955-85df-c15ce8e5f33d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:22:25.261615 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5fd6e635-b18d-466a-a8a9-25cc491c776c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:25.262056 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5fd6e635-b18d-466a-a8a9-25cc491c776c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:25.264326 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5fd6e635-b18d-466a-a8a9-25cc491c776c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:25.264783 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5fd6e635-b18d-466a-a8a9-25cc491c776c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:25.285663 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-5fd6e635-b18d-466a-a8a9-25cc491c776c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] HTTP exception thrown: Instance e045d626-74de-4955-85df-c15ce8e5f33d could not be found. Apr 05 12:22:25.286448 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5fd6e635-b18d-466a-a8a9-25cc491c776c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Returning 404 to user: Instance e045d626-74de-4955-85df-c15ce8e5f33d could not be found. {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:22:25.287330 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5fd6e635-b18d-466a-a8a9-25cc491c776c tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d" status: 404 len: 111 microversion: 2.1 time: 0.040445 Apr 05 12:22:25.288231 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1853/3728] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:22:25 2022] GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:22:25.296538 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-92cf1bf3-77e6-47ec-bb1d-604f0e5b5e38 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '.version_select at 0x7f161c1a89d0>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:22:25.316458 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-92cf1bf3-77e6-47ec-bb1d-604f0e5b5e38 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1025132166" status: 202 len: 0 microversion: 2.1 time: 0.023879 Apr 05 12:22:25.317050 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1876/3729] 10.222.0.61 () {58 vars in 1220 bytes} [Tue Apr 5 12:22:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1025132166 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:22:26.038815 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8d12509e-4565-4ba4-9d57-0b5bd8d9edb1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Action: 'create', calling method: .version_select at 0x7f16200f11f0>, body: {"keypair": {"name": "tempest-keypair-2111031949"}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:22:26.058217 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-8d12509e-4565-4ba4-9d57-0b5bd8d9edb1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Getting quotas for project 0f6e126c0851462ca2607a90c7581616. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 12:22:26.062262 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-8d12509e-4565-4ba4-9d57-0b5bd8d9edb1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Getting quotas for user e5ae307df96e45ec9ac6d4b383c84abb and project 0f6e126c0851462ca2607a90c7581616. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 12:22:26.074346 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8d12509e-4565-4ba4-9d57-0b5bd8d9edb1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [f198c5f7-bf40-42c4-8c42-9a71271e44e7] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 05 12:22:27.086383 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [None req-8d12509e-4565-4ba4-9d57-0b5bd8d9edb1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [f198c5f7-bf40-42c4-8c42-9a71271e44e7] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 58010. Apr 05 12:22:27.279987 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-8d12509e-4565-4ba4-9d57-0b5bd8d9edb1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Getting quotas for project 0f6e126c0851462ca2607a90c7581616. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 12:22:27.283693 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-8d12509e-4565-4ba4-9d57-0b5bd8d9edb1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Getting quotas for user e5ae307df96e45ec9ac6d4b383c84abb and project 0f6e126c0851462ca2607a90c7581616. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 12:22:27.297167 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8d12509e-4565-4ba4-9d57-0b5bd8d9edb1 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.264307 Apr 05 12:22:27.297771 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1854/3730] 10.222.0.61 () {60 vars in 1157 bytes} [Tue Apr 5 12:22:26 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:22:28.589953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f3f9891f-3c81-43ba-a3ee-b68a682469f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1984770315", "imageRef": "2b657785-cb0b-43ba-956c-1564c27fd10a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "655b7336-f06e-410c-ae4e-8aa6ab359991"}], "security_groups": [{"name": "tempest-securitygroup--153768601"}], "key_name": "tempest-keypair-2111031949", "user_data": "}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:22:28.690119 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.network.neutron [None req-f3f9891f-3c81-43ba-a3ee-b68a682469f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] validate_networks() for [('655b7336-f06e-410c-ae4e-8aa6ab359991', None, None, None, None, None)] {{(pid=123358) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 12:22:29.124997 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-f3f9891f-3c81-43ba-a3ee-b68a682469f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Flavor limits 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 12:22:29.125573 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-f3f9891f-3c81-43ba-a3ee-b68a682469f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Image limits 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:22:29.126319 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-f3f9891f-3c81-43ba-a3ee-b68a682469f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Flavor pref 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 12:22:29.126963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-f3f9891f-3c81-43ba-a3ee-b68a682469f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Image pref 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:22:29.127539 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-f3f9891f-3c81-43ba-a3ee-b68a682469f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 12:22:29.141582 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f3f9891f-3c81-43ba-a3ee-b68a682469f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:29.142209 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f3f9891f-3c81-43ba-a3ee-b68a682469f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:29.143377 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f3f9891f-3c81-43ba-a3ee-b68a682469f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:29.144034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f3f9891f-3c81-43ba-a3ee-b68a682469f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:29.162571 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-f3f9891f-3c81-43ba-a3ee-b68a682469f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Getting quotas for project 0f6e126c0851462ca2607a90c7581616. Resources: {'ram', 'instances', 'cores'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 12:22:29.166725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-f3f9891f-3c81-43ba-a3ee-b68a682469f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Getting quotas for user e5ae307df96e45ec9ac6d4b383c84abb and project 0f6e126c0851462ca2607a90c7581616. Resources: {'ram', 'instances', 'cores'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 12:22:29.178355 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f3f9891f-3c81-43ba-a3ee-b68a682469f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Going to run 1 instances... {{(pid=123358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 12:22:29.180765 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f3f9891f-3c81-43ba-a3ee-b68a682469f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e453f689-9191-4ac9-991c-c5f1d71d1ac7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b657785-cb0b-43ba-956c-1564c27fd10a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 12:22:29.233802 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f3f9891f-3c81-43ba-a3ee-b68a682469f6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.648823 Apr 05 12:22:29.234616 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1877/3731] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Apr 5 12:22:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 12:22:29.245576 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f2f1d618-a240-4f25-a731-c4e7d8bf7975 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:22:29.246188 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f2f1d618-a240-4f25-a731-c4e7d8bf7975 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e453f689-9191-4ac9-991c-c5f1d71d1ac7] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:22:29.297753 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f2f1d618-a240-4f25-a731-c4e7d8bf7975 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:22:29.304425 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f2f1d618-a240-4f25-a731-c4e7d8bf7975 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7" status: 200 len: 1242 microversion: 2.1 time: 0.063538 Apr 05 12:22:29.304953 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1855/3732] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:22:29 2022] GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7 => generated 1242 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:22:30.323393 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6d68aa13-f55a-446d-be2f-a4d722e0e94a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:22:30.323816 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6d68aa13-f55a-446d-be2f-a4d722e0e94a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e453f689-9191-4ac9-991c-c5f1d71d1ac7] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:22:30.330135 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6d68aa13-f55a-446d-be2f-a4d722e0e94a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:30.330812 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6d68aa13-f55a-446d-be2f-a4d722e0e94a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:30.331950 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6d68aa13-f55a-446d-be2f-a4d722e0e94a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:30.332770 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6d68aa13-f55a-446d-be2f-a4d722e0e94a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:30.393359 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6d68aa13-f55a-446d-be2f-a4d722e0e94a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:22:30.400960 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6d68aa13-f55a-446d-be2f-a4d722e0e94a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7" status: 200 len: 1300 microversion: 2.1 time: 0.083179 Apr 05 12:22:30.401492 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1878/3733] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:22:30 2022] GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7 => generated 1300 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:22:31.417999 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c606a7d1-b68a-4c06-966f-5b6f3de31150 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:22:31.418753 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c606a7d1-b68a-4c06-966f-5b6f3de31150 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e453f689-9191-4ac9-991c-c5f1d71d1ac7] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:22:31.425013 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c606a7d1-b68a-4c06-966f-5b6f3de31150 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:31.425462 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c606a7d1-b68a-4c06-966f-5b6f3de31150 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:31.426250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c606a7d1-b68a-4c06-966f-5b6f3de31150 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:31.426660 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c606a7d1-b68a-4c06-966f-5b6f3de31150 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:31.521779 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-3a39c84a-0f6e-4bad-917f-0007b813638b req-d9ce3432-792a-4356-819e-ff84ccf30419 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e453f689-9191-4ac9-991c-c5f1d71d1ac7", "tag": "d726a29a-033a-4bb1-a416-6ff786868089"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:22:31.534154 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-3a39c84a-0f6e-4bad-917f-0007b813638b req-d9ce3432-792a-4356-819e-ff84ccf30419 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:31.534804 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-3a39c84a-0f6e-4bad-917f-0007b813638b req-d9ce3432-792a-4356-819e-ff84ccf30419 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:31.551814 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-3a39c84a-0f6e-4bad-917f-0007b813638b req-d9ce3432-792a-4356-819e-ff84ccf30419 service nova] Creating event network-changed:d726a29a-033a-4bb1-a416-6ff786868089 for instance e453f689-9191-4ac9-991c-c5f1d71d1ac7 on hv-cinder-82956 Apr 05 12:22:31.557504 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-3a39c84a-0f6e-4bad-917f-0007b813638b req-d9ce3432-792a-4356-819e-ff84ccf30419 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041201 Apr 05 12:22:31.558148 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1879/3734] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:22:31.714788 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c606a7d1-b68a-4c06-966f-5b6f3de31150 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:22:31.722687 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c606a7d1-b68a-4c06-966f-5b6f3de31150 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7" status: 200 len: 1367 microversion: 2.1 time: 0.308537 Apr 05 12:22:31.723368 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1856/3735] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:22:31 2022] GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7 => generated 1367 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:22:32.745315 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d722f810-9ee1-4175-b7ce-8d13dc5e39cd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:22:32.746539 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d722f810-9ee1-4175-b7ce-8d13dc5e39cd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e453f689-9191-4ac9-991c-c5f1d71d1ac7] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:22:32.757397 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d722f810-9ee1-4175-b7ce-8d13dc5e39cd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:32.758141 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d722f810-9ee1-4175-b7ce-8d13dc5e39cd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:32.759376 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d722f810-9ee1-4175-b7ce-8d13dc5e39cd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:32.760097 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d722f810-9ee1-4175-b7ce-8d13dc5e39cd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:32.902160 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d722f810-9ee1-4175-b7ce-8d13dc5e39cd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:22:32.909906 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d722f810-9ee1-4175-b7ce-8d13dc5e39cd tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7" status: 200 len: 1367 microversion: 2.1 time: 0.171980 Apr 05 12:22:32.910482 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1880/3736] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:22:32 2022] GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:22:33.796065 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:22:33.796700 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Tue Apr 5 12:22:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:22:33.926967 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-debcd518-8e29-47b2-9106-907623f11196 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:22:33.927577 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-debcd518-8e29-47b2-9106-907623f11196 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e453f689-9191-4ac9-991c-c5f1d71d1ac7] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:22:33.934700 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-debcd518-8e29-47b2-9106-907623f11196 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:33.935176 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-debcd518-8e29-47b2-9106-907623f11196 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:33.935975 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-debcd518-8e29-47b2-9106-907623f11196 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:33.936447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-debcd518-8e29-47b2-9106-907623f11196 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:34.079143 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-debcd518-8e29-47b2-9106-907623f11196 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:22:34.086989 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-debcd518-8e29-47b2-9106-907623f11196 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7" status: 200 len: 1367 microversion: 2.1 time: 0.163918 Apr 05 12:22:34.087561 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1857/3737] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:22:33 2022] GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:22:35.108375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-faca357c-5638-4743-bb55-0f63eb5df943 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:22:35.109293 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-faca357c-5638-4743-bb55-0f63eb5df943 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e453f689-9191-4ac9-991c-c5f1d71d1ac7] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:22:35.119169 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-faca357c-5638-4743-bb55-0f63eb5df943 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:35.119627 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-faca357c-5638-4743-bb55-0f63eb5df943 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:35.120398 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-faca357c-5638-4743-bb55-0f63eb5df943 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:35.120828 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-faca357c-5638-4743-bb55-0f63eb5df943 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:35.303195 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-faca357c-5638-4743-bb55-0f63eb5df943 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:22:35.310990 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-faca357c-5638-4743-bb55-0f63eb5df943 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7" status: 200 len: 1367 microversion: 2.1 time: 0.209291 Apr 05 12:22:35.311555 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1881/3738] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:22:35 2022] GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:22:36.328023 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-91cec264-98f6-44de-b8fd-85958c5d6513 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:22:36.328720 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-91cec264-98f6-44de-b8fd-85958c5d6513 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e453f689-9191-4ac9-991c-c5f1d71d1ac7] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:22:36.335286 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-91cec264-98f6-44de-b8fd-85958c5d6513 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:36.335826 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-91cec264-98f6-44de-b8fd-85958c5d6513 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:36.336655 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-91cec264-98f6-44de-b8fd-85958c5d6513 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:36.337089 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-91cec264-98f6-44de-b8fd-85958c5d6513 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:36.426847 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-b56b49c9-8bed-4efc-8861-641659b73471 req-61e9e578-cf40-4e93-b7fd-c90bf4e04735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e453f689-9191-4ac9-991c-c5f1d71d1ac7", "name": "network-vif-plugged", "status": "completed", "tag": "d726a29a-033a-4bb1-a416-6ff786868089"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:22:36.440221 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-b56b49c9-8bed-4efc-8861-641659b73471 req-61e9e578-cf40-4e93-b7fd-c90bf4e04735 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:36.441110 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-b56b49c9-8bed-4efc-8861-641659b73471 req-61e9e578-cf40-4e93-b7fd-c90bf4e04735 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:36.452616 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-b56b49c9-8bed-4efc-8861-641659b73471 req-61e9e578-cf40-4e93-b7fd-c90bf4e04735 service nova] Creating event network-vif-plugged:d726a29a-033a-4bb1-a416-6ff786868089 for instance e453f689-9191-4ac9-991c-c5f1d71d1ac7 on hv-cinder-82956 Apr 05 12:22:36.457892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-b56b49c9-8bed-4efc-8861-641659b73471 req-61e9e578-cf40-4e93-b7fd-c90bf4e04735 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034891 Apr 05 12:22:36.458953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1882/3739] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:22:36.521250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-91cec264-98f6-44de-b8fd-85958c5d6513 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:22:36.529229 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-91cec264-98f6-44de-b8fd-85958c5d6513 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7" status: 200 len: 1367 microversion: 2.1 time: 0.205066 Apr 05 12:22:36.529814 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1858/3740] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:22:36 2022] GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:22:37.547452 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-43706512-1c7e-4eda-9c5c-f82462c54bce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:22:37.548173 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-43706512-1c7e-4eda-9c5c-f82462c54bce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e453f689-9191-4ac9-991c-c5f1d71d1ac7] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:22:37.554930 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-43706512-1c7e-4eda-9c5c-f82462c54bce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:37.555383 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-43706512-1c7e-4eda-9c5c-f82462c54bce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:37.556173 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-43706512-1c7e-4eda-9c5c-f82462c54bce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:37.556612 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-43706512-1c7e-4eda-9c5c-f82462c54bce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:37.695952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-43706512-1c7e-4eda-9c5c-f82462c54bce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:22:37.705288 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-43706512-1c7e-4eda-9c5c-f82462c54bce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7" status: 200 len: 1367 microversion: 2.1 time: 0.162573 Apr 05 12:22:37.706139 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1883/3741] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:22:37 2022] GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:22:38.726820 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e05199d3-3157-45d7-8f51-743be3fb31ce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:22:38.727808 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e05199d3-3157-45d7-8f51-743be3fb31ce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e453f689-9191-4ac9-991c-c5f1d71d1ac7] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:22:38.738318 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e05199d3-3157-45d7-8f51-743be3fb31ce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:38.739068 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e05199d3-3157-45d7-8f51-743be3fb31ce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:38.740347 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e05199d3-3157-45d7-8f51-743be3fb31ce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:38.741065 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e05199d3-3157-45d7-8f51-743be3fb31ce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:38.884109 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e05199d3-3157-45d7-8f51-743be3fb31ce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:22:38.891936 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e05199d3-3157-45d7-8f51-743be3fb31ce tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7" status: 200 len: 1557 microversion: 2.1 time: 0.171836 Apr 05 12:22:38.892539 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1859/3742] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:22:38 2022] GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7 => generated 1557 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:22:38.911538 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7da62e04-482a-41f1-885f-32e43cc01059 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:22:38.912374 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7da62e04-482a-41f1-885f-32e43cc01059 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e453f689-9191-4ac9-991c-c5f1d71d1ac7] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:22:38.919033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7da62e04-482a-41f1-885f-32e43cc01059 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:38.919548 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7da62e04-482a-41f1-885f-32e43cc01059 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:38.920354 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7da62e04-482a-41f1-885f-32e43cc01059 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:38.920804 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7da62e04-482a-41f1-885f-32e43cc01059 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:39.013368 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7da62e04-482a-41f1-885f-32e43cc01059 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108255 Apr 05 12:22:39.013969 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1884/3743] 10.222.0.61 () {58 vars in 1274 bytes} [Tue Apr 5 12:22:38 2022] GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:22:40.236691 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-4e4ea9a5-8533-44bb-86cd-6f0c1b25fc7d req-665dd96e-e4ec-4e0b-a280-6aa1835a0140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e453f689-9191-4ac9-991c-c5f1d71d1ac7", "tag": "d726a29a-033a-4bb1-a416-6ff786868089"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:22:40.245564 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-4e4ea9a5-8533-44bb-86cd-6f0c1b25fc7d req-665dd96e-e4ec-4e0b-a280-6aa1835a0140 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:22:40.246007 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-4e4ea9a5-8533-44bb-86cd-6f0c1b25fc7d req-665dd96e-e4ec-4e0b-a280-6aa1835a0140 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:22:40.256722 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-4e4ea9a5-8533-44bb-86cd-6f0c1b25fc7d req-665dd96e-e4ec-4e0b-a280-6aa1835a0140 service nova] Creating event network-changed:d726a29a-033a-4bb1-a416-6ff786868089 for instance e453f689-9191-4ac9-991c-c5f1d71d1ac7 on hv-cinder-82956 Apr 05 12:22:40.261985 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-4e4ea9a5-8533-44bb-86cd-6f0c1b25fc7d req-665dd96e-e4ec-4e0b-a280-6aa1835a0140 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028896 Apr 05 12:22:40.262984 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1860/3744] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:23:14.469397 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5016ca94-8e75-48e9-a423-33478e5511d3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:23:14.470068 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5016ca94-8e75-48e9-a423-33478e5511d3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e453f689-9191-4ac9-991c-c5f1d71d1ac7] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:23:14.476369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5016ca94-8e75-48e9-a423-33478e5511d3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:23:14.476805 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5016ca94-8e75-48e9-a423-33478e5511d3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:23:14.477548 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5016ca94-8e75-48e9-a423-33478e5511d3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:23:14.477973 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5016ca94-8e75-48e9-a423-33478e5511d3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:23:14.501428 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5016ca94-8e75-48e9-a423-33478e5511d3 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7/ips" status: 200 len: 149 microversion: 2.1 time: 0.036679 Apr 05 12:23:14.502063 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1885/3745] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Apr 5 12:23:14 2022] GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:24:14.583540 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-71448f33-e407-4239-b7f7-2e24ffa0bcd8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:24:14.584508 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-71448f33-e407-4239-b7f7-2e24ffa0bcd8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e453f689-9191-4ac9-991c-c5f1d71d1ac7] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:24:14.594253 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-71448f33-e407-4239-b7f7-2e24ffa0bcd8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:24:14.594698 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-71448f33-e407-4239-b7f7-2e24ffa0bcd8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:24:14.595454 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-71448f33-e407-4239-b7f7-2e24ffa0bcd8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:24:14.595881 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-71448f33-e407-4239-b7f7-2e24ffa0bcd8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:24:14.622075 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-71448f33-e407-4239-b7f7-2e24ffa0bcd8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e453f689-9191-4ac9-991c-c5f1d71d1ac7] Going to try to terminate instance {{(pid=123357) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 12:24:14.705432 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-71448f33-e407-4239-b7f7-2e24ffa0bcd8 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7" status: 204 len: 0 microversion: 2.1 time: 0.130948 Apr 05 12:24:14.706032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1861/3746] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 12:24:14 2022] DELETE /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:24:14.716748 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bc6860a1-fa42-4614-b63b-94bc35a8ba3a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:24:14.717349 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bc6860a1-fa42-4614-b63b-94bc35a8ba3a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e453f689-9191-4ac9-991c-c5f1d71d1ac7] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:24:14.723662 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bc6860a1-fa42-4614-b63b-94bc35a8ba3a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:24:14.724152 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bc6860a1-fa42-4614-b63b-94bc35a8ba3a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:24:14.724901 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bc6860a1-fa42-4614-b63b-94bc35a8ba3a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:24:14.725330 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bc6860a1-fa42-4614-b63b-94bc35a8ba3a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:24:14.863574 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bc6860a1-fa42-4614-b63b-94bc35a8ba3a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:24:14.874121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bc6860a1-fa42-4614-b63b-94bc35a8ba3a tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7" status: 200 len: 1681 microversion: 2.1 time: 0.162783 Apr 05 12:24:14.874935 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1886/3747] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:24:14 2022] GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:24:15.898115 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-772c42d6-0aa7-4e0c-9a2d-bbe0c04d223f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:24:15.898695 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-772c42d6-0aa7-4e0c-9a2d-bbe0c04d223f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e453f689-9191-4ac9-991c-c5f1d71d1ac7] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:24:15.905380 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-772c42d6-0aa7-4e0c-9a2d-bbe0c04d223f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:24:15.905823 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-772c42d6-0aa7-4e0c-9a2d-bbe0c04d223f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:24:15.906572 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-772c42d6-0aa7-4e0c-9a2d-bbe0c04d223f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:24:15.906999 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-772c42d6-0aa7-4e0c-9a2d-bbe0c04d223f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:24:16.043649 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-772c42d6-0aa7-4e0c-9a2d-bbe0c04d223f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:24:16.051385 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-772c42d6-0aa7-4e0c-9a2d-bbe0c04d223f tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7" status: 200 len: 1681 microversion: 2.1 time: 0.157659 Apr 05 12:24:16.051993 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1862/3748] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:24:15 2022] GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:24:16.932489 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-c201bc63-dac1-4c5d-9fb3-03c73386499f req-360a7c7b-7d73-45e9-ad24-3e78057d2670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e453f689-9191-4ac9-991c-c5f1d71d1ac7", "name": "network-vif-deleted", "tag": "d726a29a-033a-4bb1-a416-6ff786868089"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:24:16.941188 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-c201bc63-dac1-4c5d-9fb3-03c73386499f req-360a7c7b-7d73-45e9-ad24-3e78057d2670 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:24:16.941643 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-c201bc63-dac1-4c5d-9fb3-03c73386499f req-360a7c7b-7d73-45e9-ad24-3e78057d2670 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:24:16.953106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-c201bc63-dac1-4c5d-9fb3-03c73386499f req-360a7c7b-7d73-45e9-ad24-3e78057d2670 service nova] Creating event network-vif-deleted:d726a29a-033a-4bb1-a416-6ff786868089 for instance e453f689-9191-4ac9-991c-c5f1d71d1ac7 on hv-cinder-82956 Apr 05 12:24:16.961361 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-c201bc63-dac1-4c5d-9fb3-03c73386499f req-360a7c7b-7d73-45e9-ad24-3e78057d2670 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030124 Apr 05 12:24:16.962577 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1887/3749] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:24:17.069812 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-37e21fea-e4c0-4330-8ecd-0cd01b1917ee tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:24:17.070409 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-37e21fea-e4c0-4330-8ecd-0cd01b1917ee tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e453f689-9191-4ac9-991c-c5f1d71d1ac7] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:24:17.076828 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37e21fea-e4c0-4330-8ecd-0cd01b1917ee tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:24:17.077355 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37e21fea-e4c0-4330-8ecd-0cd01b1917ee tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:24:17.078126 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37e21fea-e4c0-4330-8ecd-0cd01b1917ee tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:24:17.078566 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37e21fea-e4c0-4330-8ecd-0cd01b1917ee tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:24:17.113733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37e21fea-e4c0-4330-8ecd-0cd01b1917ee tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:24:17.114171 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37e21fea-e4c0-4330-8ecd-0cd01b1917ee tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:24:17.114668 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.objects.instance [None req-37e21fea-e4c0-4330-8ecd-0cd01b1917ee tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lazy-loading 'fault' on Instance uuid e453f689-9191-4ac9-991c-c5f1d71d1ac7 {{(pid=123357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 12:24:17.154647 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-37e21fea-e4c0-4330-8ecd-0cd01b1917ee tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:24:17.161833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-37e21fea-e4c0-4330-8ecd-0cd01b1917ee tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7" status: 200 len: 1332 microversion: 2.1 time: 0.095943 Apr 05 12:24:17.162409 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1863/3750] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:24:17 2022] GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7 => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:24:18.186267 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fb0d1483-399a-4b19-843f-ad31fb9fcefe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:24:18.187626 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fb0d1483-399a-4b19-843f-ad31fb9fcefe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e453f689-9191-4ac9-991c-c5f1d71d1ac7] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:24:18.193658 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fb0d1483-399a-4b19-843f-ad31fb9fcefe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:24:18.194111 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fb0d1483-399a-4b19-843f-ad31fb9fcefe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:24:18.195098 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fb0d1483-399a-4b19-843f-ad31fb9fcefe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:24:18.195592 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fb0d1483-399a-4b19-843f-ad31fb9fcefe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:24:18.209674 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.wsgi [None req-fb0d1483-399a-4b19-843f-ad31fb9fcefe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] HTTP exception thrown: Instance e453f689-9191-4ac9-991c-c5f1d71d1ac7 could not be found. Apr 05 12:24:18.210257 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fb0d1483-399a-4b19-843f-ad31fb9fcefe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Returning 404 to user: Instance e453f689-9191-4ac9-991c-c5f1d71d1ac7 could not be found. {{(pid=123358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:24:18.211085 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fb0d1483-399a-4b19-843f-ad31fb9fcefe tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7" status: 404 len: 111 microversion: 2.1 time: 0.034311 Apr 05 12:24:18.211622 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1888/3751] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:24:18 2022] GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:24:18.220173 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8cbe8e03-37e5-4547-8f93-754ac0c7bfa6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '.version_select at 0x7f16201149d0>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:24:18.240177 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8cbe8e03-37e5-4547-8f93-754ac0c7bfa6 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111031949" status: 202 len: 0 microversion: 2.1 time: 0.023895 Apr 05 12:24:18.240734 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1864/3752] 10.222.0.61 () {58 vars in 1220 bytes} [Tue Apr 5 12:24:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111031949 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:24:19.340133 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8084d897-5abe-4b6d-994f-c3ba811db844 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:24:19.340678 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8084d897-5abe-4b6d-994f-c3ba811db844 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e453f689-9191-4ac9-991c-c5f1d71d1ac7] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:24:19.347283 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8084d897-5abe-4b6d-994f-c3ba811db844 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:24:19.347722 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8084d897-5abe-4b6d-994f-c3ba811db844 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:24:19.348517 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8084d897-5abe-4b6d-994f-c3ba811db844 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:24:19.348943 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8084d897-5abe-4b6d-994f-c3ba811db844 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:24:19.363495 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.wsgi [None req-8084d897-5abe-4b6d-994f-c3ba811db844 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] HTTP exception thrown: Instance e453f689-9191-4ac9-991c-c5f1d71d1ac7 could not be found. Apr 05 12:24:19.364114 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8084d897-5abe-4b6d-994f-c3ba811db844 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Returning 404 to user: Instance e453f689-9191-4ac9-991c-c5f1d71d1ac7 could not be found. {{(pid=123358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:24:19.364992 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8084d897-5abe-4b6d-994f-c3ba811db844 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7" status: 404 len: 111 microversion: 2.1 time: 0.028808 Apr 05 12:24:19.365549 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1889/3753] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 12:24:19 2022] DELETE /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:24:19.374597 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5d732d1f-e7c5-4dc1-96ff-ec70fea82b78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:24:19.375206 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5d732d1f-e7c5-4dc1-96ff-ec70fea82b78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e453f689-9191-4ac9-991c-c5f1d71d1ac7] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:24:19.381872 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d732d1f-e7c5-4dc1-96ff-ec70fea82b78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:24:19.382312 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d732d1f-e7c5-4dc1-96ff-ec70fea82b78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:24:19.383061 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d732d1f-e7c5-4dc1-96ff-ec70fea82b78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:24:19.383489 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d732d1f-e7c5-4dc1-96ff-ec70fea82b78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:24:19.396980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-5d732d1f-e7c5-4dc1-96ff-ec70fea82b78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] HTTP exception thrown: Instance e453f689-9191-4ac9-991c-c5f1d71d1ac7 could not be found. Apr 05 12:24:19.397566 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5d732d1f-e7c5-4dc1-96ff-ec70fea82b78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Returning 404 to user: Instance e453f689-9191-4ac9-991c-c5f1d71d1ac7 could not be found. {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:24:19.398393 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5d732d1f-e7c5-4dc1-96ff-ec70fea82b78 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7" status: 404 len: 111 microversion: 2.1 time: 0.028231 Apr 05 12:24:19.398945 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1865/3754] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:24:19 2022] GET /compute/v2.1/servers/e453f689-9191-4ac9-991c-c5f1d71d1ac7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:24:37.150865 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:24:37.151884 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Tue Apr 5 12:24:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:24:44.339169 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:24:44.340272 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Tue Apr 5 12:24:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:25:53.805522 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:25:53.806172 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Tue Apr 5 12:25:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:26:21.151738 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b6aa60c9-7d15-4945-8663-76bafd8c8d1e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:21.153218 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b6aa60c9-7d15-4945-8663-76bafd8c8d1e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:26:21.160689 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6aa60c9-7d15-4945-8663-76bafd8c8d1e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:21.161197 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6aa60c9-7d15-4945-8663-76bafd8c8d1e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:21.161972 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6aa60c9-7d15-4945-8663-76bafd8c8d1e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:21.162401 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6aa60c9-7d15-4945-8663-76bafd8c8d1e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:21.187179 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b6aa60c9-7d15-4945-8663-76bafd8c8d1e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Going to try to terminate instance {{(pid=123358) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 12:26:21.231833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-50339f4c-9163-4e05-852c-162113fb8b49 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:21.232479 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-50339f4c-9163-4e05-852c-162113fb8b49 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e045d626-74de-4955-85df-c15ce8e5f33d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:26:21.239553 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-50339f4c-9163-4e05-852c-162113fb8b49 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:21.240035 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-50339f4c-9163-4e05-852c-162113fb8b49 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:21.240820 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-50339f4c-9163-4e05-852c-162113fb8b49 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:21.241526 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-50339f4c-9163-4e05-852c-162113fb8b49 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:21.257267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-50339f4c-9163-4e05-852c-162113fb8b49 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] HTTP exception thrown: Instance e045d626-74de-4955-85df-c15ce8e5f33d could not be found. Apr 05 12:26:21.257858 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-50339f4c-9163-4e05-852c-162113fb8b49 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Returning 404 to user: Instance e045d626-74de-4955-85df-c15ce8e5f33d could not be found. {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:26:21.258680 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-50339f4c-9163-4e05-852c-162113fb8b49 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d" status: 404 len: 111 microversion: 2.1 time: 0.031883 Apr 05 12:26:21.259234 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1866/3755] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 12:26:21 2022] DELETE /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:26:21.267257 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-12217b84-a2c2-4329-b26d-bd989d67fc39 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:21.268155 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-12217b84-a2c2-4329-b26d-bd989d67fc39 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: e045d626-74de-4955-85df-c15ce8e5f33d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:26:21.274007 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-12217b84-a2c2-4329-b26d-bd989d67fc39 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:21.274553 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-12217b84-a2c2-4329-b26d-bd989d67fc39 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:21.275417 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-12217b84-a2c2-4329-b26d-bd989d67fc39 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:21.275948 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-12217b84-a2c2-4329-b26d-bd989d67fc39 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:21.281378 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b6aa60c9-7d15-4945-8663-76bafd8c8d1e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "DELETE /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 204 len: 0 microversion: 2.1 time: 0.135566 Apr 05 12:26:21.282091 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1890/3756] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 12:26:21 2022] DELETE /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:26:21.290153 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-12217b84-a2c2-4329-b26d-bd989d67fc39 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] HTTP exception thrown: Instance e045d626-74de-4955-85df-c15ce8e5f33d could not be found. Apr 05 12:26:21.290831 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-12217b84-a2c2-4329-b26d-bd989d67fc39 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Returning 404 to user: Instance e045d626-74de-4955-85df-c15ce8e5f33d could not be found. {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:26:21.291601 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-75e99f2f-bc3d-44c4-9b3e-1b2ef6069729 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:21.291757 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-12217b84-a2c2-4329-b26d-bd989d67fc39 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d" status: 404 len: 111 microversion: 2.1 time: 0.028323 Apr 05 12:26:21.292401 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-75e99f2f-bc3d-44c4-9b3e-1b2ef6069729 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:26:21.292557 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1867/3757] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:26:21 2022] GET /compute/v2.1/servers/e045d626-74de-4955-85df-c15ce8e5f33d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 12:26:21.301373 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-66728fbf-86cd-4a1f-b73a-654402ef1b43 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:21.301741 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-75e99f2f-bc3d-44c4-9b3e-1b2ef6069729 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:21.301994 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-66728fbf-86cd-4a1f-b73a-654402ef1b43 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:26:21.302194 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-75e99f2f-bc3d-44c4-9b3e-1b2ef6069729 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:21.303028 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-75e99f2f-bc3d-44c4-9b3e-1b2ef6069729 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:21.303477 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-75e99f2f-bc3d-44c4-9b3e-1b2ef6069729 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:21.308421 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66728fbf-86cd-4a1f-b73a-654402ef1b43 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:21.308421 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66728fbf-86cd-4a1f-b73a-654402ef1b43 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:21.309175 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66728fbf-86cd-4a1f-b73a-654402ef1b43 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:21.309669 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-66728fbf-86cd-4a1f-b73a-654402ef1b43 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:21.324618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-66728fbf-86cd-4a1f-b73a-654402ef1b43 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] HTTP exception thrown: Instance 26584178-5dc8-4126-93eb-1126296c8e93 could not be found. Apr 05 12:26:21.325287 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-66728fbf-86cd-4a1f-b73a-654402ef1b43 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Returning 404 to user: Instance 26584178-5dc8-4126-93eb-1126296c8e93 could not be found. {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:26:21.326279 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-66728fbf-86cd-4a1f-b73a-654402ef1b43 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "DELETE /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 404 len: 111 microversion: 2.1 time: 0.029233 Apr 05 12:26:21.326838 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1868/3758] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 12:26:21 2022] DELETE /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 12:26:21.335005 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3e942f78-fc6f-4dee-b3bf-70be320e9df5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:21.335682 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3e942f78-fc6f-4dee-b3bf-70be320e9df5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: 26584178-5dc8-4126-93eb-1126296c8e93] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:26:21.342030 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e942f78-fc6f-4dee-b3bf-70be320e9df5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:21.342456 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e942f78-fc6f-4dee-b3bf-70be320e9df5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:21.343231 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e942f78-fc6f-4dee-b3bf-70be320e9df5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:21.343661 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3e942f78-fc6f-4dee-b3bf-70be320e9df5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:21.361862 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-3e942f78-fc6f-4dee-b3bf-70be320e9df5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] HTTP exception thrown: Instance 26584178-5dc8-4126-93eb-1126296c8e93 could not be found. Apr 05 12:26:21.362779 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3e942f78-fc6f-4dee-b3bf-70be320e9df5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Returning 404 to user: Instance 26584178-5dc8-4126-93eb-1126296c8e93 could not be found. {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:26:21.364332 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3e942f78-fc6f-4dee-b3bf-70be320e9df5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93" status: 404 len: 111 microversion: 2.1 time: 0.033244 Apr 05 12:26:21.364883 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1869/3759] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:26:21 2022] GET /compute/v2.1/servers/26584178-5dc8-4126-93eb-1126296c8e93 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:26:21.491681 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-75e99f2f-bc3d-44c4-9b3e-1b2ef6069729 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:26:21.499241 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-75e99f2f-bc3d-44c4-9b3e-1b2ef6069729 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1508 microversion: 2.1 time: 0.212343 Apr 05 12:26:21.499818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1891/3760] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:26:21 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1508 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:26:22.161087 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d15de480-870b-469f-96f2-3b129516a168 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:22.161576 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d15de480-870b-469f-96f2-3b129516a168 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:26:22.167881 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d15de480-870b-469f-96f2-3b129516a168 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:22.168372 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d15de480-870b-469f-96f2-3b129516a168 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:22.169123 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d15de480-870b-469f-96f2-3b129516a168 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:22.169550 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d15de480-870b-469f-96f2-3b129516a168 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:22.183408 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-d15de480-870b-469f-96f2-3b129516a168 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] HTTP exception thrown: Instance c48b77eb-b654-43e4-9551-735bac89d0de could not be found. Apr 05 12:26:22.183976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d15de480-870b-469f-96f2-3b129516a168 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Returning 404 to user: Instance c48b77eb-b654-43e4-9551-735bac89d0de could not be found. {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:26:22.184829 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d15de480-870b-469f-96f2-3b129516a168 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 404 len: 111 microversion: 2.1 time: 0.027763 Apr 05 12:26:22.185342 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1870/3761] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 12:26:22 2022] DELETE /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:26:22.193501 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c7052bf2-2fee-43d2-be7b-6df2394156d8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:22.194106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c7052bf2-2fee-43d2-be7b-6df2394156d8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] [instance: c48b77eb-b654-43e4-9551-735bac89d0de] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:26:22.201674 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c7052bf2-2fee-43d2-be7b-6df2394156d8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:22.202103 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c7052bf2-2fee-43d2-be7b-6df2394156d8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:22.203457 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c7052bf2-2fee-43d2-be7b-6df2394156d8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:22.203837 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c7052bf2-2fee-43d2-be7b-6df2394156d8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:22.217945 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.wsgi [None req-c7052bf2-2fee-43d2-be7b-6df2394156d8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] HTTP exception thrown: Instance c48b77eb-b654-43e4-9551-735bac89d0de could not be found. Apr 05 12:26:22.218507 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c7052bf2-2fee-43d2-be7b-6df2394156d8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] Returning 404 to user: Instance c48b77eb-b654-43e4-9551-735bac89d0de could not be found. {{(pid=123358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:26:22.219555 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c7052bf2-2fee-43d2-be7b-6df2394156d8 tempest-AttachVolumeTestJSON-2138382329 tempest-AttachVolumeTestJSON-2138382329-project] 10.222.0.61 "GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de" status: 404 len: 111 microversion: 2.1 time: 0.030104 Apr 05 12:26:22.220450 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1892/3762] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:26:22 2022] GET /compute/v2.1/servers/c48b77eb-b654-43e4-9551-735bac89d0de => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:26:22.517700 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-91f88272-bb81-4df3-981d-2ae1204b2e36 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:22.523394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5840fd0d-25e4-4cb9-a3b6-0b52c3d11c45 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:22.524267 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5840fd0d-25e4-4cb9-a3b6-0b52c3d11c45 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:26:22.524973 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-91f88272-bb81-4df3-981d-2ae1204b2e36 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:26:22.532657 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5840fd0d-25e4-4cb9-a3b6-0b52c3d11c45 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:22.534458 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5840fd0d-25e4-4cb9-a3b6-0b52c3d11c45 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:22.534743 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-91f88272-bb81-4df3-981d-2ae1204b2e36 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:22.535355 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-91f88272-bb81-4df3-981d-2ae1204b2e36 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:22.535981 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5840fd0d-25e4-4cb9-a3b6-0b52c3d11c45 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:22.536587 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-91f88272-bb81-4df3-981d-2ae1204b2e36 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:22.537373 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5840fd0d-25e4-4cb9-a3b6-0b52c3d11c45 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:22.537766 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-91f88272-bb81-4df3-981d-2ae1204b2e36 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:22.586807 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5840fd0d-25e4-4cb9-a3b6-0b52c3d11c45 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Going to try to terminate instance {{(pid=123358) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 12:26:22.644656 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.compute.api [None req-5840fd0d-25e4-4cb9-a3b6-0b52c3d11c45 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Instance is already in deleting state, ignoring this request Apr 05 12:26:22.645725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5840fd0d-25e4-4cb9-a3b6-0b52c3d11c45 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 204 len: 0 microversion: 2.1 time: 0.126732 Apr 05 12:26:22.646378 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1893/3763] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 12:26:22 2022] DELETE /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:26:22.659303 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ffb6a146-a3c8-4f8a-a5a5-2c5de5fa87f5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:22.660296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ffb6a146-a3c8-4f8a-a5a5-2c5de5fa87f5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:26:22.667461 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ffb6a146-a3c8-4f8a-a5a5-2c5de5fa87f5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:22.668213 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ffb6a146-a3c8-4f8a-a5a5-2c5de5fa87f5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:22.669574 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ffb6a146-a3c8-4f8a-a5a5-2c5de5fa87f5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:22.670170 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ffb6a146-a3c8-4f8a-a5a5-2c5de5fa87f5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:22.746268 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-91f88272-bb81-4df3-981d-2ae1204b2e36 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:26:22.754383 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-91f88272-bb81-4df3-981d-2ae1204b2e36 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1508 microversion: 2.1 time: 0.241369 Apr 05 12:26:22.757815 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1871/3764] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:26:22 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1508 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:26:22.775070 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ffb6a146-a3c8-4f8a-a5a5-2c5de5fa87f5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:26:22.794627 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ffb6a146-a3c8-4f8a-a5a5-2c5de5fa87f5 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1494 microversion: 2.1 time: 0.141256 Apr 05 12:26:22.817937 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1894/3765] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:26:22 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1494 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:26:22.934867 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-2ab10214-23ed-41c2-a185-d6101664e6b3 req-14e23d1a-4dbb-4ab2-afe9-743d4171481a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d507e3-5f14-419a-a3cd-31f36496b2d8", "name": "network-vif-deleted", "tag": "54ad08dc-d08d-49a7-a3d3-ff818ba84298"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:26:22.942861 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-2ab10214-23ed-41c2-a185-d6101664e6b3 req-14e23d1a-4dbb-4ab2-afe9-743d4171481a service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:22.943296 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-2ab10214-23ed-41c2-a185-d6101664e6b3 req-14e23d1a-4dbb-4ab2-afe9-743d4171481a service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:22.954427 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-2ab10214-23ed-41c2-a185-d6101664e6b3 req-14e23d1a-4dbb-4ab2-afe9-743d4171481a service nova] Creating event network-vif-deleted:54ad08dc-d08d-49a7-a3d3-ff818ba84298 for instance f8d507e3-5f14-419a-a3cd-31f36496b2d8 on hv-cinder-82956 Apr 05 12:26:22.963977 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-2ab10214-23ed-41c2-a185-d6101664e6b3 req-14e23d1a-4dbb-4ab2-afe9-743d4171481a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096077 Apr 05 12:26:22.964620 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1872/3766] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:26:23.340143 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-2a12ba48-512e-4f9b-907b-fa69875ddb75 req-a8cff0ad-28ac-4c30-ba61-8943e8b7ffd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159c0fda-d790-488a-bbdc-a3b9ee6174d1", "name": "network-vif-deleted", "tag": "baa72685-1fff-4499-bff9-2ee7cbb1dcf5"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:26:23.349500 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-2a12ba48-512e-4f9b-907b-fa69875ddb75 req-a8cff0ad-28ac-4c30-ba61-8943e8b7ffd3 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:23.350020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-2a12ba48-512e-4f9b-907b-fa69875ddb75 req-a8cff0ad-28ac-4c30-ba61-8943e8b7ffd3 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:23.362245 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-2a12ba48-512e-4f9b-907b-fa69875ddb75 req-a8cff0ad-28ac-4c30-ba61-8943e8b7ffd3 service nova] Creating event network-vif-deleted:baa72685-1fff-4499-bff9-2ee7cbb1dcf5 for instance 159c0fda-d790-488a-bbdc-a3b9ee6174d1 on hv-cinder-82956 Apr 05 12:26:23.368318 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-2a12ba48-512e-4f9b-907b-fa69875ddb75 req-a8cff0ad-28ac-4c30-ba61-8943e8b7ffd3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107603 Apr 05 12:26:23.369185 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1895/3767] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:26:23.777430 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d36feb7c-4da0-4e82-a4d6-30c6209f6f5d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:23.778100 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d36feb7c-4da0-4e82-a4d6-30c6209f6f5d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:26:23.784442 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d36feb7c-4da0-4e82-a4d6-30c6209f6f5d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:23.784894 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d36feb7c-4da0-4e82-a4d6-30c6209f6f5d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:23.785653 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d36feb7c-4da0-4e82-a4d6-30c6209f6f5d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:23.786089 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d36feb7c-4da0-4e82-a4d6-30c6209f6f5d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:23.813833 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-989ec332-c066-4728-a810-6b02dca1c067 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:23.814955 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-989ec332-c066-4728-a810-6b02dca1c067 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:26:23.818173 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d36feb7c-4da0-4e82-a4d6-30c6209f6f5d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:23.818618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d36feb7c-4da0-4e82-a4d6-30c6209f6f5d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:23.819071 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.objects.instance [None req-d36feb7c-4da0-4e82-a4d6-30c6209f6f5d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lazy-loading 'fault' on Instance uuid 159c0fda-d790-488a-bbdc-a3b9ee6174d1 {{(pid=123357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 12:26:23.822092 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-989ec332-c066-4728-a810-6b02dca1c067 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:23.822634 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-989ec332-c066-4728-a810-6b02dca1c067 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:23.823479 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-989ec332-c066-4728-a810-6b02dca1c067 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:23.824364 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-989ec332-c066-4728-a810-6b02dca1c067 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:23.858329 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-989ec332-c066-4728-a810-6b02dca1c067 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:23.858779 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-989ec332-c066-4728-a810-6b02dca1c067 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:23.859229 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.objects.instance [None req-989ec332-c066-4728-a810-6b02dca1c067 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lazy-loading 'fault' on Instance uuid f8d507e3-5f14-419a-a3cd-31f36496b2d8 {{(pid=123358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 12:26:23.864244 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d36feb7c-4da0-4e82-a4d6-30c6209f6f5d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:26:23.873496 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d36feb7c-4da0-4e82-a4d6-30c6209f6f5d tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 200 len: 1312 microversion: 2.1 time: 0.100694 Apr 05 12:26:23.874090 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1873/3768] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:26:23 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:26:23.923546 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-989ec332-c066-4728-a810-6b02dca1c067 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ae307df96e45ec9ac6d4b383c84abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6e126c0851462ca2607a90c7581616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:26:23.932886 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-989ec332-c066-4728-a810-6b02dca1c067 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 200 len: 1331 microversion: 2.1 time: 0.123291 Apr 05 12:26:23.933616 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1896/3769] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:26:23 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 1331 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:26:24.892664 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-54c505f4-9e99-408c-8010-d1e7c2d9b020 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:24.893952 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-54c505f4-9e99-408c-8010-d1e7c2d9b020 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 159c0fda-d790-488a-bbdc-a3b9ee6174d1] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:26:24.901341 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54c505f4-9e99-408c-8010-d1e7c2d9b020 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:24.902426 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54c505f4-9e99-408c-8010-d1e7c2d9b020 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:24.903400 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54c505f4-9e99-408c-8010-d1e7c2d9b020 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:24.904010 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54c505f4-9e99-408c-8010-d1e7c2d9b020 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:24.920225 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-54c505f4-9e99-408c-8010-d1e7c2d9b020 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] HTTP exception thrown: Instance 159c0fda-d790-488a-bbdc-a3b9ee6174d1 could not be found. Apr 05 12:26:24.921128 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-54c505f4-9e99-408c-8010-d1e7c2d9b020 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Returning 404 to user: Instance 159c0fda-d790-488a-bbdc-a3b9ee6174d1 could not be found. {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:26:24.922524 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-54c505f4-9e99-408c-8010-d1e7c2d9b020 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1" status: 404 len: 111 microversion: 2.1 time: 0.035038 Apr 05 12:26:24.923582 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1874/3770] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:26:24 2022] GET /compute/v2.1/servers/159c0fda-d790-488a-bbdc-a3b9ee6174d1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:26:24.933404 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-37476d36-d413-4347-8d9d-858d8758112b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:24.934569 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-37476d36-d413-4347-8d9d-858d8758112b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:26:24.942638 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-37476d36-d413-4347-8d9d-858d8758112b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:24.943112 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-37476d36-d413-4347-8d9d-858d8758112b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:24.945914 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-37476d36-d413-4347-8d9d-858d8758112b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:24.946727 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-37476d36-d413-4347-8d9d-858d8758112b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:24.952902 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8727c112-6914-4fc6-a54f-5554374c2166 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:24.953538 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8727c112-6914-4fc6-a54f-5554374c2166 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] [instance: f8d507e3-5f14-419a-a3cd-31f36496b2d8] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:26:24.965651 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8727c112-6914-4fc6-a54f-5554374c2166 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:24.966119 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8727c112-6914-4fc6-a54f-5554374c2166 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:24.966913 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8727c112-6914-4fc6-a54f-5554374c2166 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:24.967352 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8727c112-6914-4fc6-a54f-5554374c2166 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:24.978272 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-37476d36-d413-4347-8d9d-858d8758112b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Going to try to terminate instance {{(pid=123358) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 12:26:24.985090 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-8727c112-6914-4fc6-a54f-5554374c2166 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] HTTP exception thrown: Instance f8d507e3-5f14-419a-a3cd-31f36496b2d8 could not be found. Apr 05 12:26:24.985954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8727c112-6914-4fc6-a54f-5554374c2166 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] Returning 404 to user: Instance f8d507e3-5f14-419a-a3cd-31f36496b2d8 could not be found. {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:26:24.986975 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8727c112-6914-4fc6-a54f-5554374c2166 tempest-AttachVolumeNegativeTest-1578673242 tempest-AttachVolumeNegativeTest-1578673242-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8" status: 404 len: 111 microversion: 2.1 time: 0.039838 Apr 05 12:26:24.987536 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1875/3771] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:26:24 2022] GET /compute/v2.1/servers/f8d507e3-5f14-419a-a3cd-31f36496b2d8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:26:25.132886 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-37476d36-d413-4347-8d9d-858d8758112b tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "DELETE /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 204 len: 0 microversion: 2.1 time: 0.203799 Apr 05 12:26:25.138560 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1897/3772] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 12:26:24 2022] DELETE /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:26:25.146654 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d045ac57-8964-463b-b554-1b58e00f104e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:25.147509 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d045ac57-8964-463b-b554-1b58e00f104e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:26:25.153893 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d045ac57-8964-463b-b554-1b58e00f104e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:25.154698 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d045ac57-8964-463b-b554-1b58e00f104e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:25.155666 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d045ac57-8964-463b-b554-1b58e00f104e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:25.156308 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d045ac57-8964-463b-b554-1b58e00f104e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:25.221744 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-d389aa50-6357-4686-b0d9-65c0cda3a154 req-89162235-e846-417c-8a69-34cb03654419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2874529b-88ea-4b6d-b42a-a242dc948ccf", "name": "network-vif-deleted", "tag": "9c2e58f4-2c4a-4e00-a60b-5a27ceff33bb"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:26:25.258829 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-d389aa50-6357-4686-b0d9-65c0cda3a154 req-89162235-e846-417c-8a69-34cb03654419 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:25.259290 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-d389aa50-6357-4686-b0d9-65c0cda3a154 req-89162235-e846-417c-8a69-34cb03654419 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:25.281196 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-d389aa50-6357-4686-b0d9-65c0cda3a154 req-89162235-e846-417c-8a69-34cb03654419 service nova] Creating event network-vif-deleted:9c2e58f4-2c4a-4e00-a60b-5a27ceff33bb for instance 2874529b-88ea-4b6d-b42a-a242dc948ccf on hv-cinder-82956 Apr 05 12:26:25.286630 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-d389aa50-6357-4686-b0d9-65c0cda3a154 req-89162235-e846-417c-8a69-34cb03654419 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073423 Apr 05 12:26:25.287849 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1898/3773] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:26:25.531890 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d045ac57-8964-463b-b554-1b58e00f104e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:26:25.539725 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d045ac57-8964-463b-b554-1b58e00f104e tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.398449 Apr 05 12:26:25.549806 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1876/3774] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:26:25 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:26:25.657049 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-33e8b0c2-1a89-4ed3-88f0-535d30cb05ed req-d1f437c3-45e7-4407-b1db-e748cfc47425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99328563-d12a-4ef5-952b-c6c86929a22d", "name": "network-vif-deleted", "tag": "d788cf01-8528-46be-b9ed-aa38fac571ee"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:26:25.665497 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-33e8b0c2-1a89-4ed3-88f0-535d30cb05ed req-d1f437c3-45e7-4407-b1db-e748cfc47425 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:25.666378 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-33e8b0c2-1a89-4ed3-88f0-535d30cb05ed req-d1f437c3-45e7-4407-b1db-e748cfc47425 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:25.680380 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-33e8b0c2-1a89-4ed3-88f0-535d30cb05ed req-d1f437c3-45e7-4407-b1db-e748cfc47425 service nova] Creating event network-vif-deleted:d788cf01-8528-46be-b9ed-aa38fac571ee for instance 99328563-d12a-4ef5-952b-c6c86929a22d on hv-cinder-82956 Apr 05 12:26:25.686084 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-33e8b0c2-1a89-4ed3-88f0-535d30cb05ed req-d1f437c3-45e7-4407-b1db-e748cfc47425 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032996 Apr 05 12:26:25.687122 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1899/3775] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:26:26.559981 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2586273d-ebf2-4e67-aecf-958ce6cfcae2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:26.561281 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2586273d-ebf2-4e67-aecf-958ce6cfcae2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:26:26.570158 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2586273d-ebf2-4e67-aecf-958ce6cfcae2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:26.571617 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2586273d-ebf2-4e67-aecf-958ce6cfcae2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:26.574272 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2586273d-ebf2-4e67-aecf-958ce6cfcae2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:26.574814 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2586273d-ebf2-4e67-aecf-958ce6cfcae2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:27.031968 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2586273d-ebf2-4e67-aecf-958ce6cfcae2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:26:27.044723 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2586273d-ebf2-4e67-aecf-958ce6cfcae2 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1520 microversion: 2.1 time: 0.491273 Apr 05 12:26:27.048270 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1877/3776] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:26:26 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1520 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:26:27.466026 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-6840fbaf-a4c7-474a-bb8c-a1655c9ece58 req-0eba8ac5-e014-4364-a2d9-96ab83c24b95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "590c9148-99a5-4120-8b46-235860f6eca2", "name": "network-vif-deleted", "tag": "55b22dff-98f7-484a-a01e-41c558cf7a2f"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:26:27.475045 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-6840fbaf-a4c7-474a-bb8c-a1655c9ece58 req-0eba8ac5-e014-4364-a2d9-96ab83c24b95 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:27.475774 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-6840fbaf-a4c7-474a-bb8c-a1655c9ece58 req-0eba8ac5-e014-4364-a2d9-96ab83c24b95 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:27.490516 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-6840fbaf-a4c7-474a-bb8c-a1655c9ece58 req-0eba8ac5-e014-4364-a2d9-96ab83c24b95 service nova] Creating event network-vif-deleted:55b22dff-98f7-484a-a01e-41c558cf7a2f for instance 590c9148-99a5-4120-8b46-235860f6eca2 on hv-cinder-82956 Apr 05 12:26:27.496854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-6840fbaf-a4c7-474a-bb8c-a1655c9ece58 req-0eba8ac5-e014-4364-a2d9-96ab83c24b95 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035704 Apr 05 12:26:27.497882 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1900/3777] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:26:28.062310 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-00393cfc-7955-4a4f-8123-d110f90d13d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:28.063649 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-00393cfc-7955-4a4f-8123-d110f90d13d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:26:28.076425 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00393cfc-7955-4a4f-8123-d110f90d13d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:28.077103 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00393cfc-7955-4a4f-8123-d110f90d13d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:28.077903 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00393cfc-7955-4a4f-8123-d110f90d13d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:28.078342 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00393cfc-7955-4a4f-8123-d110f90d13d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:28.133253 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00393cfc-7955-4a4f-8123-d110f90d13d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:28.133706 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00393cfc-7955-4a4f-8123-d110f90d13d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:28.134167 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.objects.instance [None req-00393cfc-7955-4a4f-8123-d110f90d13d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lazy-loading 'fault' on Instance uuid 590c9148-99a5-4120-8b46-235860f6eca2 {{(pid=123357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 12:26:28.224221 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-00393cfc-7955-4a4f-8123-d110f90d13d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947e4bea28244cfb8a2b1be51c639815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d2f825a8f74e66b348121301942a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:26:28.231219 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-00393cfc-7955-4a4f-8123-d110f90d13d9 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 200 len: 1311 microversion: 2.1 time: 0.172873 Apr 05 12:26:28.232198 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1878/3778] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:26:28 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 1311 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:26:29.251080 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c74bccae-f2bb-438d-a454-5c630f35ae59 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:29.251925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c74bccae-f2bb-438d-a454-5c630f35ae59 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] [instance: 590c9148-99a5-4120-8b46-235860f6eca2] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:26:29.267526 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c74bccae-f2bb-438d-a454-5c630f35ae59 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:29.267919 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c74bccae-f2bb-438d-a454-5c630f35ae59 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:29.269812 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c74bccae-f2bb-438d-a454-5c630f35ae59 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:29.271036 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c74bccae-f2bb-438d-a454-5c630f35ae59 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:29.293303 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.wsgi [None req-c74bccae-f2bb-438d-a454-5c630f35ae59 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] HTTP exception thrown: Instance 590c9148-99a5-4120-8b46-235860f6eca2 could not be found. Apr 05 12:26:29.294349 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c74bccae-f2bb-438d-a454-5c630f35ae59 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] Returning 404 to user: Instance 590c9148-99a5-4120-8b46-235860f6eca2 could not be found. {{(pid=123358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:26:29.295633 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c74bccae-f2bb-438d-a454-5c630f35ae59 tempest-ServerRescueNegativeTestJSON-1254891157 tempest-ServerRescueNegativeTestJSON-1254891157-project] 10.222.0.61 "GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2" status: 404 len: 111 microversion: 2.1 time: 0.049797 Apr 05 12:26:29.296560 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1901/3779] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:26:29 2022] GET /compute/v2.1/servers/590c9148-99a5-4120-8b46-235860f6eca2 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:26:35.831835 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b976b279-3700-4438-a1ae-b4e5410f523f tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] Action: 'create', calling method: .version_select at 0x7f1620172dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-889523509"}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:26:36.419028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b976b279-3700-4438-a1ae-b4e5410f523f tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.051226 Apr 05 12:26:36.419799 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1879/3780] 10.222.0.61 () {60 vars in 1154 bytes} [Tue Apr 5 12:26:35 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1053 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 05 12:26:36.431768 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d077afa2-f3a2-4ad1-916e-717dafb70a9e tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] Calling method '.version_select at 0x7f161c384670>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:36.535174 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d077afa2-f3a2-4ad1-916e-717dafb70a9e tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/7d03cbee-27d4-4542-af82-94087df3836c" status: 200 len: 344 microversion: 2.1 time: 0.107773 Apr 05 12:26:36.536021 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1902/3781] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Apr 5 12:26:36 2022] GET /compute/v2.1/os-volumes/7d03cbee-27d4-4542-af82-94087df3836c => generated 344 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:26:37.547765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ca344316-de44-4c8c-be95-2527b8aed5e6 tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] Calling method '.version_select at 0x7f161c321820>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:37.626492 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ca344316-de44-4c8c-be95-2527b8aed5e6 tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/7d03cbee-27d4-4542-af82-94087df3836c" status: 200 len: 345 microversion: 2.1 time: 0.082370 Apr 05 12:26:37.627543 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1880/3782] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Apr 5 12:26:37 2022] GET /compute/v2.1/os-volumes/7d03cbee-27d4-4542-af82-94087df3836c => generated 345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:26:37.641312 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3f91a942-888f-4272-95c7-7fbe4a720a7e tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] Action: 'create', calling method: .version_select at 0x7f16202b08b0>, body: {"snapshot": {"volume_id": "7d03cbee-27d4-4542-af82-94087df3836c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-227896657"}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:26:37.889501 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3f91a942-888f-4272-95c7-7fbe4a720a7e tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] 10.222.0.61 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.253443 Apr 05 12:26:37.890131 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1903/3783] 10.222.0.61 () {60 vars in 1161 bytes} [Tue Apr 5 12:26:37 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:26:37.900688 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-62412d52-dbdd-4879-95f2-9db64b0204a6 tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] Calling method '.version_select at 0x7f1620172430>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:37.935966 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-62412d52-dbdd-4879-95f2-9db64b0204a6 tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/55d02948-d10c-4f68-b18a-52054d20741c" status: 200 len: 286 microversion: 2.1 time: 0.039737 Apr 05 12:26:37.937729 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1881/3784] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Apr 5 12:26:37 2022] GET /compute/v2.1/os-snapshots/55d02948-d10c-4f68-b18a-52054d20741c => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:26:37.947892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6d46aa7e-e422-442e-ac34-70c9975ab06c tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] Calling method '.version_select at 0x7f161c2eaf70>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:37.980399 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6d46aa7e-e422-442e-ac34-70c9975ab06c tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.036366 Apr 05 12:26:37.981522 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1904/3785] 10.222.0.61 () {58 vars in 1139 bytes} [Tue Apr 5 12:26:37 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:26:37.993291 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6372a6f7-d414-42bf-a62e-44809f0f8df8 tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] Calling method '.version_select at 0x7f16200aaee0>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:38.039032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6372a6f7-d414-42bf-a62e-44809f0f8df8 tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/55d02948-d10c-4f68-b18a-52054d20741c" status: 200 len: 286 microversion: 2.1 time: 0.050996 Apr 05 12:26:38.043655 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1882/3786] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Apr 5 12:26:37 2022] GET /compute/v2.1/os-snapshots/55d02948-d10c-4f68-b18a-52054d20741c => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:26:39.050686 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fe8768d2-1060-41aa-a89d-01e97eb3b58f tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] Calling method '.version_select at 0x7f161c384dc0>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:39.114030 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fe8768d2-1060-41aa-a89d-01e97eb3b58f tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/55d02948-d10c-4f68-b18a-52054d20741c" status: 200 len: 286 microversion: 2.1 time: 0.067051 Apr 05 12:26:39.115275 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1905/3787] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Apr 5 12:26:39 2022] GET /compute/v2.1/os-snapshots/55d02948-d10c-4f68-b18a-52054d20741c => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:26:40.126631 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c5105f88-6363-443c-9139-6ba063023f1c tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] Calling method '.version_select at 0x7f16200e29d0>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:40.221924 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c5105f88-6363-443c-9139-6ba063023f1c tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/55d02948-d10c-4f68-b18a-52054d20741c" status: 200 len: 286 microversion: 2.1 time: 0.098986 Apr 05 12:26:40.223121 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1883/3788] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Apr 5 12:26:40 2022] GET /compute/v2.1/os-snapshots/55d02948-d10c-4f68-b18a-52054d20741c => generated 286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:26:41.234792 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4d0b9334-06c5-4b75-8215-727c4d9dd0da tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] Calling method '.version_select at 0x7f16202a0820>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:41.288258 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4d0b9334-06c5-4b75-8215-727c4d9dd0da tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/55d02948-d10c-4f68-b18a-52054d20741c" status: 200 len: 287 microversion: 2.1 time: 0.057857 Apr 05 12:26:41.289618 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1906/3789] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Apr 5 12:26:41 2022] GET /compute/v2.1/os-snapshots/55d02948-d10c-4f68-b18a-52054d20741c => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:26:41.301237 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-16157cab-9de7-4979-bea6-a02aa1105173 tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] Calling method '.version_select at 0x7f161c2733a0>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:41.389845 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-16157cab-9de7-4979-bea6-a02aa1105173 tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] 10.222.0.61 "DELETE /compute/v2.1/os-snapshots/55d02948-d10c-4f68-b18a-52054d20741c" status: 202 len: 0 microversion: 2.1 time: 0.092351 Apr 05 12:26:41.389845 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1884/3790] 10.222.0.61 () {58 vars in 1253 bytes} [Tue Apr 5 12:26:41 2022] DELETE /compute/v2.1/os-snapshots/55d02948-d10c-4f68-b18a-52054d20741c => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:26:41.398686 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7333f3e6-b926-40ac-bd9d-6071ebaffd2c tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] Calling method '.version_select at 0x7f161c3849d0>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:41.447844 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7333f3e6-b926-40ac-bd9d-6071ebaffd2c tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/55d02948-d10c-4f68-b18a-52054d20741c" status: 200 len: 286 microversion: 2.1 time: 0.051640 Apr 05 12:26:41.448467 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1907/3791] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Apr 5 12:26:41 2022] GET /compute/v2.1/os-snapshots/55d02948-d10c-4f68-b18a-52054d20741c => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:26:42.462737 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-47ee99b3-da4f-4e48-b71e-d5c5983cfa9b tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] Calling method '.version_select at 0x7f1620114f70>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:42.499937 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-47ee99b3-da4f-4e48-b71e-d5c5983cfa9b tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] HTTP exception thrown: Snapshot 55d02948-d10c-4f68-b18a-52054d20741c could not be found. Apr 05 12:26:42.500521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-47ee99b3-da4f-4e48-b71e-d5c5983cfa9b tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] Returning 404 to user: Snapshot 55d02948-d10c-4f68-b18a-52054d20741c could not be found. {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:26:42.501347 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-47ee99b3-da4f-4e48-b71e-d5c5983cfa9b tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/55d02948-d10c-4f68-b18a-52054d20741c" status: 404 len: 111 microversion: 2.1 time: 0.045516 Apr 05 12:26:42.502046 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1885/3792] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Apr 5 12:26:42 2022] GET /compute/v2.1/os-snapshots/55d02948-d10c-4f68-b18a-52054d20741c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:26:42.510747 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-dab6cff4-4ef1-44bb-bfac-c6c56857984c tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] Calling method '.version_select at 0x7f161c591af0>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:42.586340 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-dab6cff4-4ef1-44bb-bfac-c6c56857984c tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/7d03cbee-27d4-4542-af82-94087df3836c" status: 202 len: 0 microversion: 2.1 time: 0.079843 Apr 05 12:26:42.587288 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1908/3793] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Apr 5 12:26:42 2022] DELETE /compute/v2.1/os-volumes/7d03cbee-27d4-4542-af82-94087df3836c => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:26:42.595495 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a9ed2b1e-bf46-42f2-ae6a-f9e39d966d79 tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] Calling method '.version_select at 0x7f161c542040>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:42.792559 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a9ed2b1e-bf46-42f2-ae6a-f9e39d966d79 tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/7d03cbee-27d4-4542-af82-94087df3836c" status: 200 len: 344 microversion: 2.1 time: 0.200660 Apr 05 12:26:42.793188 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1886/3794] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Apr 5 12:26:42 2022] GET /compute/v2.1/os-volumes/7d03cbee-27d4-4542-af82-94087df3836c => generated 344 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:26:43.805639 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b268c2b4-7673-42de-b7a3-526c949fd42a tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] Calling method '.version_select at 0x7f161c2cc310>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:43.850320 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.wsgi [None req-b268c2b4-7673-42de-b7a3-526c949fd42a tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] HTTP exception thrown: Volume 7d03cbee-27d4-4542-af82-94087df3836c could not be found. Apr 05 12:26:43.851105 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b268c2b4-7673-42de-b7a3-526c949fd42a tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] Returning 404 to user: Volume 7d03cbee-27d4-4542-af82-94087df3836c could not be found. {{(pid=123358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:26:43.852315 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b268c2b4-7673-42de-b7a3-526c949fd42a tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/7d03cbee-27d4-4542-af82-94087df3836c" status: 404 len: 109 microversion: 2.1 time: 0.050805 Apr 05 12:26:43.857376 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1909/3795] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Apr 5 12:26:43 2022] GET /compute/v2.1/os-volumes/7d03cbee-27d4-4542-af82-94087df3836c => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:26:43.864265 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ad673f11-d760-4cf8-8913-5d6d8d3d35fc tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] Calling method '.version_select at 0x7f1620114f70>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:43.901078 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-ad673f11-d760-4cf8-8913-5d6d8d3d35fc tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] HTTP exception thrown: Volume 7d03cbee-27d4-4542-af82-94087df3836c could not be found. Apr 05 12:26:43.903284 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ad673f11-d760-4cf8-8913-5d6d8d3d35fc tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] Returning 404 to user: Volume 7d03cbee-27d4-4542-af82-94087df3836c could not be found. {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:26:43.906217 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ad673f11-d760-4cf8-8913-5d6d8d3d35fc tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/7d03cbee-27d4-4542-af82-94087df3836c" status: 404 len: 109 microversion: 2.1 time: 0.047182 Apr 05 12:26:43.906959 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1887/3796] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Apr 5 12:26:43 2022] DELETE /compute/v2.1/os-volumes/7d03cbee-27d4-4542-af82-94087df3836c => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:26:43.922894 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6d89d69c-149f-47d3-929b-2a638465baec tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] Calling method '.version_select at 0x7f161c3841f0>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:43.956652 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.wsgi [None req-6d89d69c-149f-47d3-929b-2a638465baec tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] HTTP exception thrown: Volume 7d03cbee-27d4-4542-af82-94087df3836c could not be found. Apr 05 12:26:43.957251 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6d89d69c-149f-47d3-929b-2a638465baec tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] Returning 404 to user: Volume 7d03cbee-27d4-4542-af82-94087df3836c could not be found. {{(pid=123358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:26:43.958121 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6d89d69c-149f-47d3-929b-2a638465baec tempest-VolumesSnapshotsTestJSON-1050162263 tempest-VolumesSnapshotsTestJSON-1050162263-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/7d03cbee-27d4-4542-af82-94087df3836c" status: 404 len: 109 microversion: 2.1 time: 0.039603 Apr 05 12:26:43.958668 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1910/3797] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Apr 5 12:26:43 2022] GET /compute/v2.1/os-volumes/7d03cbee-27d4-4542-af82-94087df3836c => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:26:46.215383 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bb39c655-d3ce-4249-8af9-35dc629c4429 tempest-VolumesGetTestJSON-1745572581 tempest-VolumesGetTestJSON-1745572581-project] Action: 'create', calling method: .version_select at 0x7f161c503d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1937814810", "metadata": {"Type": "work"}}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:26:46.666539 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bb39c655-d3ce-4249-8af9-35dc629c4429 tempest-VolumesGetTestJSON-1745572581 tempest-VolumesGetTestJSON-1745572581-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.609046 Apr 05 12:26:46.667419 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1888/3798] 10.222.0.61 () {60 vars in 1155 bytes} [Tue Apr 5 12:26:46 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 611 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 05 12:26:46.680066 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c4b7e072-f91c-4f68-8b26-f12318af95f0 tempest-VolumesGetTestJSON-1745572581 tempest-VolumesGetTestJSON-1745572581-project] Calling method '.version_select at 0x7f161c3841f0>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:46.751125 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c4b7e072-f91c-4f68-8b26-f12318af95f0 tempest-VolumesGetTestJSON-1745572581 tempest-VolumesGetTestJSON-1745572581-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/237d3e66-45df-492e-98da-bc5ace11f3a6" status: 200 len: 353 microversion: 2.1 time: 0.076305 Apr 05 12:26:46.751836 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1911/3799] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Apr 5 12:26:46 2022] GET /compute/v2.1/os-volumes/237d3e66-45df-492e-98da-bc5ace11f3a6 => generated 353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:26:47.763963 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d80ecfdd-4ee8-4772-8a9e-1442ab8dc3da tempest-VolumesGetTestJSON-1745572581 tempest-VolumesGetTestJSON-1745572581-project] Calling method '.version_select at 0x7f1620129790>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:47.855233 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d80ecfdd-4ee8-4772-8a9e-1442ab8dc3da tempest-VolumesGetTestJSON-1745572581 tempest-VolumesGetTestJSON-1745572581-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/237d3e66-45df-492e-98da-bc5ace11f3a6" status: 200 len: 353 microversion: 2.1 time: 0.095054 Apr 05 12:26:47.855816 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1889/3800] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Apr 5 12:26:47 2022] GET /compute/v2.1/os-volumes/237d3e66-45df-492e-98da-bc5ace11f3a6 => generated 353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:26:48.868507 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3b7b7d71-49c8-49fa-8280-b2322743a531 tempest-VolumesGetTestJSON-1745572581 tempest-VolumesGetTestJSON-1745572581-project] Calling method '.version_select at 0x7f16202a0670>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:48.928013 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3b7b7d71-49c8-49fa-8280-b2322743a531 tempest-VolumesGetTestJSON-1745572581 tempest-VolumesGetTestJSON-1745572581-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/237d3e66-45df-492e-98da-bc5ace11f3a6" status: 200 len: 354 microversion: 2.1 time: 0.063548 Apr 05 12:26:48.928721 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1912/3801] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Apr 5 12:26:48 2022] GET /compute/v2.1/os-volumes/237d3e66-45df-492e-98da-bc5ace11f3a6 => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:26:48.939823 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-be161af2-8ca2-4bf9-a5ef-830875406e94 tempest-VolumesGetTestJSON-1745572581 tempest-VolumesGetTestJSON-1745572581-project] Calling method '.version_select at 0x7f1620107550>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:48.990651 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-be161af2-8ca2-4bf9-a5ef-830875406e94 tempest-VolumesGetTestJSON-1745572581 tempest-VolumesGetTestJSON-1745572581-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/237d3e66-45df-492e-98da-bc5ace11f3a6" status: 200 len: 354 microversion: 2.1 time: 0.054666 Apr 05 12:26:48.991169 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1890/3802] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Apr 5 12:26:48 2022] GET /compute/v2.1/os-volumes/237d3e66-45df-492e-98da-bc5ace11f3a6 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:26:49.009244 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e28faa1c-e5c7-4763-97ee-0ad319129cfe tempest-VolumesGetTestJSON-1745572581 tempest-VolumesGetTestJSON-1745572581-project] Calling method '.version_select at 0x7f161c0ff670>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:49.085218 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e28faa1c-e5c7-4763-97ee-0ad319129cfe tempest-VolumesGetTestJSON-1745572581 tempest-VolumesGetTestJSON-1745572581-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/237d3e66-45df-492e-98da-bc5ace11f3a6" status: 202 len: 0 microversion: 2.1 time: 0.080177 Apr 05 12:26:49.086723 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1913/3803] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Apr 5 12:26:49 2022] DELETE /compute/v2.1/os-volumes/237d3e66-45df-492e-98da-bc5ace11f3a6 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:26:49.097914 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f2d70cd1-b7df-471e-a246-c39e02d7f5d1 tempest-VolumesGetTestJSON-1745572581 tempest-VolumesGetTestJSON-1745572581-project] Calling method '.version_select at 0x7f16200a4310>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:49.200780 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f2d70cd1-b7df-471e-a246-c39e02d7f5d1 tempest-VolumesGetTestJSON-1745572581 tempest-VolumesGetTestJSON-1745572581-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/237d3e66-45df-492e-98da-bc5ace11f3a6" status: 200 len: 353 microversion: 2.1 time: 0.106728 Apr 05 12:26:49.202253 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1891/3804] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Apr 5 12:26:49 2022] GET /compute/v2.1/os-volumes/237d3e66-45df-492e-98da-bc5ace11f3a6 => generated 353 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:26:50.215134 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-035685de-fbd2-462b-b94b-81b54acf790e tempest-VolumesGetTestJSON-1745572581 tempest-VolumesGetTestJSON-1745572581-project] Calling method '.version_select at 0x7f1620284ca0>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:50.248176 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.wsgi [None req-035685de-fbd2-462b-b94b-81b54acf790e tempest-VolumesGetTestJSON-1745572581 tempest-VolumesGetTestJSON-1745572581-project] HTTP exception thrown: Volume 237d3e66-45df-492e-98da-bc5ace11f3a6 could not be found. Apr 05 12:26:50.248875 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-035685de-fbd2-462b-b94b-81b54acf790e tempest-VolumesGetTestJSON-1745572581 tempest-VolumesGetTestJSON-1745572581-project] Returning 404 to user: Volume 237d3e66-45df-492e-98da-bc5ace11f3a6 could not be found. {{(pid=123358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:26:50.249981 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-035685de-fbd2-462b-b94b-81b54acf790e tempest-VolumesGetTestJSON-1745572581 tempest-VolumesGetTestJSON-1745572581-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/237d3e66-45df-492e-98da-bc5ace11f3a6" status: 404 len: 109 microversion: 2.1 time: 0.039749 Apr 05 12:26:50.250603 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1914/3805] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Apr 5 12:26:50 2022] GET /compute/v2.1/os-volumes/237d3e66-45df-492e-98da-bc5ace11f3a6 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:26:54.707529 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-24f532e0-cc56-4490-afeb-3fea72b8a779 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Action: 'create', calling method: .version_select at 0x7f1620107280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1735914795"}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:26:54.723934 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-24f532e0-cc56-4490-afeb-3fea72b8a779 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Getting quotas for project b1ec1a4f50e74ff5929d5ca1b5244926. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 12:26:54.728616 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-24f532e0-cc56-4490-afeb-3fea72b8a779 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Getting quotas for user 7cfacec410f7479ea4c67de6dd530bfc and project b1ec1a4f50e74ff5929d5ca1b5244926. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 12:26:54.999336 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-24f532e0-cc56-4490-afeb-3fea72b8a779 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Getting quotas for project b1ec1a4f50e74ff5929d5ca1b5244926. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 12:26:55.003365 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-24f532e0-cc56-4490-afeb-3fea72b8a779 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Getting quotas for user 7cfacec410f7479ea4c67de6dd530bfc and project b1ec1a4f50e74ff5929d5ca1b5244926. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 12:26:55.017466 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-24f532e0-cc56-4490-afeb-3fea72b8a779 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.314986 Apr 05 12:26:55.018285 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1892/3806] 10.222.0.61 () {60 vars in 1157 bytes} [Tue Apr 5 12:26:54 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:26:55.149043 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f1e5e759-8197-4997-9776-e9004c7b7fce tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1314924629", "imageRef": "d81746db-43fc-4757-8ab5-c07e9ab340ac", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1735914795", "networks": [{"uuid": "fb720aff-db40-40f2-916d-7994cffc1428"}]}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:26:55.208062 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.network.neutron [None req-f1e5e759-8197-4997-9776-e9004c7b7fce tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] validate_networks() for [('fb720aff-db40-40f2-916d-7994cffc1428', None, None, None, None, None)] {{(pid=123358) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 12:26:55.748094 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-f1e5e759-8197-4997-9776-e9004c7b7fce tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Flavor limits 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 12:26:55.748828 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-f1e5e759-8197-4997-9776-e9004c7b7fce tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Image limits 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:26:55.749467 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-f1e5e759-8197-4997-9776-e9004c7b7fce tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Flavor pref 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 12:26:55.750338 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-f1e5e759-8197-4997-9776-e9004c7b7fce tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Image pref 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:26:55.750740 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-f1e5e759-8197-4997-9776-e9004c7b7fce tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 12:26:55.761038 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f1e5e759-8197-4997-9776-e9004c7b7fce tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:55.761830 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f1e5e759-8197-4997-9776-e9004c7b7fce tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:55.763014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f1e5e759-8197-4997-9776-e9004c7b7fce tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:55.763648 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f1e5e759-8197-4997-9776-e9004c7b7fce tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:55.782710 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-f1e5e759-8197-4997-9776-e9004c7b7fce tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Getting quotas for project b1ec1a4f50e74ff5929d5ca1b5244926. Resources: {'ram', 'instances', 'cores'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 12:26:55.788141 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-f1e5e759-8197-4997-9776-e9004c7b7fce tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Getting quotas for user 7cfacec410f7479ea4c67de6dd530bfc and project b1ec1a4f50e74ff5929d5ca1b5244926. Resources: {'ram', 'instances', 'cores'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 12:26:55.802736 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f1e5e759-8197-4997-9776-e9004c7b7fce tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Going to run 1 instances... {{(pid=123358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 12:26:55.806533 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f1e5e759-8197-4997-9776-e9004c7b7fce tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d81746db-43fc-4757-8ab5-c07e9ab340ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 12:26:55.866162 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f1e5e759-8197-4997-9776-e9004c7b7fce tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721008 Apr 05 12:26:55.868591 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1915/3807] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Apr 5 12:26:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 05 12:26:55.879224 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6872e340-f9f5-4875-9b0e-db523c4400d2 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:55.879838 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6872e340-f9f5-4875-9b0e-db523c4400d2 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:26:55.959792 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6872e340-f9f5-4875-9b0e-db523c4400d2 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:26:55.969614 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6872e340-f9f5-4875-9b0e-db523c4400d2 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1259 microversion: 2.1 time: 0.094760 Apr 05 12:26:55.976017 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1893/3808] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:26:55 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1259 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:26:56.986884 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-461fd2d9-756a-4c2c-a298-1e6d486b8593 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:56.987502 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-461fd2d9-756a-4c2c-a298-1e6d486b8593 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:26:57.003488 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-461fd2d9-756a-4c2c-a298-1e6d486b8593 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:57.005740 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-461fd2d9-756a-4c2c-a298-1e6d486b8593 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:57.008684 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-461fd2d9-756a-4c2c-a298-1e6d486b8593 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:57.009821 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-461fd2d9-756a-4c2c-a298-1e6d486b8593 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:57.115311 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-461fd2d9-756a-4c2c-a298-1e6d486b8593 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:26:57.124313 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-461fd2d9-756a-4c2c-a298-1e6d486b8593 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1311 microversion: 2.1 time: 0.141542 Apr 05 12:26:57.134203 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1916/3809] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:26:56 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1311 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:26:58.143622 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0245e74e-f826-44c8-ba57-21b5a6a43c5c tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:58.145049 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0245e74e-f826-44c8-ba57-21b5a6a43c5c tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:26:58.153384 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0245e74e-f826-44c8-ba57-21b5a6a43c5c tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:58.153842 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0245e74e-f826-44c8-ba57-21b5a6a43c5c tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:58.155499 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0245e74e-f826-44c8-ba57-21b5a6a43c5c tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:58.156047 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0245e74e-f826-44c8-ba57-21b5a6a43c5c tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:58.640667 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0245e74e-f826-44c8-ba57-21b5a6a43c5c tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:26:58.660489 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0245e74e-f826-44c8-ba57-21b5a6a43c5c tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1359 microversion: 2.1 time: 0.519469 Apr 05 12:26:58.680344 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1894/3810] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:26:58 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1359 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:26:59.685569 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cbeb9976-1993-4577-aab2-f744380dd585 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:26:59.686256 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-cbeb9976-1993-4577-aab2-f744380dd585 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:26:59.705857 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cbeb9976-1993-4577-aab2-f744380dd585 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:59.707246 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cbeb9976-1993-4577-aab2-f744380dd585 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:59.708991 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cbeb9976-1993-4577-aab2-f744380dd585 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:59.709901 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-cbeb9976-1993-4577-aab2-f744380dd585 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:59.789635 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-c0dfa2b2-9ef0-4b36-92a7-4dd35f9804f5 req-238852c9-7fa6-4e7f-9a9c-8ea9df877e7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f6fa79f-c359-456d-aad4-cbd1e1a50d66", "tag": "55c8dfd7-0c47-40c6-800e-d5e2cfe592e1"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:26:59.808387 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-c0dfa2b2-9ef0-4b36-92a7-4dd35f9804f5 req-238852c9-7fa6-4e7f-9a9c-8ea9df877e7c service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:26:59.814265 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-c0dfa2b2-9ef0-4b36-92a7-4dd35f9804f5 req-238852c9-7fa6-4e7f-9a9c-8ea9df877e7c service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:26:59.867332 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-c0dfa2b2-9ef0-4b36-92a7-4dd35f9804f5 req-238852c9-7fa6-4e7f-9a9c-8ea9df877e7c service nova] Creating event network-changed:55c8dfd7-0c47-40c6-800e-d5e2cfe592e1 for instance 2f6fa79f-c359-456d-aad4-cbd1e1a50d66 on hv-cinder-82956 Apr 05 12:26:59.877495 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-c0dfa2b2-9ef0-4b36-92a7-4dd35f9804f5 req-238852c9-7fa6-4e7f-9a9c-8ea9df877e7c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088941 Apr 05 12:26:59.878492 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1895/3811] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:27:00.102244 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-cbeb9976-1993-4577-aab2-f744380dd585 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:27:00.127621 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cbeb9976-1993-4577-aab2-f744380dd585 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1359 microversion: 2.1 time: 0.445875 Apr 05 12:27:00.140192 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1917/3812] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:26:59 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1359 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:27:01.146863 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-161cba31-c15d-44ad-a04d-73ea08c1ba9a tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:27:01.147866 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-161cba31-c15d-44ad-a04d-73ea08c1ba9a tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:27:01.157776 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-161cba31-c15d-44ad-a04d-73ea08c1ba9a tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:01.164586 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-161cba31-c15d-44ad-a04d-73ea08c1ba9a tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:01.165522 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-161cba31-c15d-44ad-a04d-73ea08c1ba9a tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:01.165842 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-161cba31-c15d-44ad-a04d-73ea08c1ba9a tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:01.438569 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-161cba31-c15d-44ad-a04d-73ea08c1ba9a tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:27:01.447509 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-161cba31-c15d-44ad-a04d-73ea08c1ba9a tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1359 microversion: 2.1 time: 0.305874 Apr 05 12:27:01.453305 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1896/3813] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:27:01 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1359 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:27:02.474958 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-56744630-57ae-4138-85be-56533e13ad41 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:27:02.476720 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-56744630-57ae-4138-85be-56533e13ad41 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:27:02.489798 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-56744630-57ae-4138-85be-56533e13ad41 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:02.490615 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-56744630-57ae-4138-85be-56533e13ad41 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:02.493146 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-56744630-57ae-4138-85be-56533e13ad41 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:02.493591 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-56744630-57ae-4138-85be-56533e13ad41 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:02.795948 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-56744630-57ae-4138-85be-56533e13ad41 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:27:02.804749 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-56744630-57ae-4138-85be-56533e13ad41 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1359 microversion: 2.1 time: 0.334809 Apr 05 12:27:02.807397 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1918/3814] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:27:02 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1359 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:27:03.825065 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-37a0577f-60f0-4d28-a87e-f1f303bddad4 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:27:03.825677 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-37a0577f-60f0-4d28-a87e-f1f303bddad4 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:27:03.833742 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37a0577f-60f0-4d28-a87e-f1f303bddad4 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:03.834256 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37a0577f-60f0-4d28-a87e-f1f303bddad4 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:03.835090 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37a0577f-60f0-4d28-a87e-f1f303bddad4 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:03.835539 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-37a0577f-60f0-4d28-a87e-f1f303bddad4 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:04.065806 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-37a0577f-60f0-4d28-a87e-f1f303bddad4 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:27:04.082199 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-37a0577f-60f0-4d28-a87e-f1f303bddad4 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1359 microversion: 2.1 time: 0.254688 Apr 05 12:27:04.082908 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1897/3815] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:27:03 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1359 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:27:05.100973 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-164f0d8f-2952-43bc-9053-47c1a2cfd4b1 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:27:05.101645 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-164f0d8f-2952-43bc-9053-47c1a2cfd4b1 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:27:05.111632 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-164f0d8f-2952-43bc-9053-47c1a2cfd4b1 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:05.112128 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-164f0d8f-2952-43bc-9053-47c1a2cfd4b1 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:05.113242 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-164f0d8f-2952-43bc-9053-47c1a2cfd4b1 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:05.113673 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-164f0d8f-2952-43bc-9053-47c1a2cfd4b1 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:05.254185 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-164f0d8f-2952-43bc-9053-47c1a2cfd4b1 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:27:05.261764 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-164f0d8f-2952-43bc-9053-47c1a2cfd4b1 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1359 microversion: 2.1 time: 0.164913 Apr 05 12:27:05.262931 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1919/3816] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:27:05 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:27:06.284930 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-f67f5c14-9fe1-415a-a5aa-c97ec0fa33f0 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:27:06.285883 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-f67f5c14-9fe1-415a-a5aa-c97ec0fa33f0 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:27:06.296515 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f67f5c14-9fe1-415a-a5aa-c97ec0fa33f0 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:06.297221 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f67f5c14-9fe1-415a-a5aa-c97ec0fa33f0 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:06.298469 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f67f5c14-9fe1-415a-a5aa-c97ec0fa33f0 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:06.299187 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-f67f5c14-9fe1-415a-a5aa-c97ec0fa33f0 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:06.438290 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-f67f5c14-9fe1-415a-a5aa-c97ec0fa33f0 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:27:06.447046 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-f67f5c14-9fe1-415a-a5aa-c97ec0fa33f0 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1359 microversion: 2.1 time: 0.169152 Apr 05 12:27:06.447731 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1898/3817] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:27:06 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:27:07.468600 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-279a8ee7-6cba-4d80-b2f7-24fc264e9bf2 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:27:07.469256 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-279a8ee7-6cba-4d80-b2f7-24fc264e9bf2 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:27:07.475955 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-279a8ee7-6cba-4d80-b2f7-24fc264e9bf2 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:07.476428 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-279a8ee7-6cba-4d80-b2f7-24fc264e9bf2 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:07.477188 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-279a8ee7-6cba-4d80-b2f7-24fc264e9bf2 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:07.477614 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-279a8ee7-6cba-4d80-b2f7-24fc264e9bf2 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:07.617082 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-279a8ee7-6cba-4d80-b2f7-24fc264e9bf2 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:27:07.627411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-279a8ee7-6cba-4d80-b2f7-24fc264e9bf2 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1359 microversion: 2.1 time: 0.162930 Apr 05 12:27:07.628014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1920/3818] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:27:07 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:27:08.650548 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1ca2244f-d02d-4097-8715-21b9ba1acd5a tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:27:08.651549 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1ca2244f-d02d-4097-8715-21b9ba1acd5a tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:27:08.662082 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ca2244f-d02d-4097-8715-21b9ba1acd5a tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:08.662877 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ca2244f-d02d-4097-8715-21b9ba1acd5a tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:08.664623 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ca2244f-d02d-4097-8715-21b9ba1acd5a tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:08.665346 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ca2244f-d02d-4097-8715-21b9ba1acd5a tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:08.809384 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1ca2244f-d02d-4097-8715-21b9ba1acd5a tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:27:08.817282 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1ca2244f-d02d-4097-8715-21b9ba1acd5a tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1359 microversion: 2.1 time: 0.174711 Apr 05 12:27:08.817846 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1899/3819] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:27:08 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:27:09.834565 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1c0b4de6-7300-46c3-8fdc-9f2dadcd7c48 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:27:09.835243 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1c0b4de6-7300-46c3-8fdc-9f2dadcd7c48 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:27:09.845312 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1c0b4de6-7300-46c3-8fdc-9f2dadcd7c48 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:09.845865 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1c0b4de6-7300-46c3-8fdc-9f2dadcd7c48 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:09.847103 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1c0b4de6-7300-46c3-8fdc-9f2dadcd7c48 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:09.847103 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1c0b4de6-7300-46c3-8fdc-9f2dadcd7c48 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:10.003616 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1c0b4de6-7300-46c3-8fdc-9f2dadcd7c48 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:27:10.012955 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1c0b4de6-7300-46c3-8fdc-9f2dadcd7c48 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1359 microversion: 2.1 time: 0.182277 Apr 05 12:27:10.013325 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1921/3820] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:27:09 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:27:11.030617 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d4cd82e9-f4aa-47ef-9770-c272003b6a78 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:27:11.031882 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d4cd82e9-f4aa-47ef-9770-c272003b6a78 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:27:11.039183 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d4cd82e9-f4aa-47ef-9770-c272003b6a78 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:11.040364 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d4cd82e9-f4aa-47ef-9770-c272003b6a78 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:11.041416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d4cd82e9-f4aa-47ef-9770-c272003b6a78 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:11.042024 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d4cd82e9-f4aa-47ef-9770-c272003b6a78 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:11.194055 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d4cd82e9-f4aa-47ef-9770-c272003b6a78 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:27:11.201729 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d4cd82e9-f4aa-47ef-9770-c272003b6a78 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1359 microversion: 2.1 time: 0.175379 Apr 05 12:27:11.202289 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1900/3821] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:27:11 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:27:12.218947 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6302ab33-3934-4ac2-942b-4d5948e624b0 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:27:12.219561 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6302ab33-3934-4ac2-942b-4d5948e624b0 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:27:12.226972 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6302ab33-3934-4ac2-942b-4d5948e624b0 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:12.227542 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6302ab33-3934-4ac2-942b-4d5948e624b0 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:12.228364 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6302ab33-3934-4ac2-942b-4d5948e624b0 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:12.228804 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6302ab33-3934-4ac2-942b-4d5948e624b0 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:12.379601 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6302ab33-3934-4ac2-942b-4d5948e624b0 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:27:12.389184 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6302ab33-3934-4ac2-942b-4d5948e624b0 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1359 microversion: 2.1 time: 0.174190 Apr 05 12:27:12.392123 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1922/3822] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:27:12 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:27:13.202850 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-fcf2bf63-7ee5-4540-bf42-fa947549b89b req-4f3338d9-085e-4223-b689-511a813c5287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6fa79f-c359-456d-aad4-cbd1e1a50d66", "name": "network-vif-plugged", "status": "completed", "tag": "55c8dfd7-0c47-40c6-800e-d5e2cfe592e1"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:27:13.210803 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-fcf2bf63-7ee5-4540-bf42-fa947549b89b req-4f3338d9-085e-4223-b689-511a813c5287 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:13.211242 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-fcf2bf63-7ee5-4540-bf42-fa947549b89b req-4f3338d9-085e-4223-b689-511a813c5287 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:13.222081 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-fcf2bf63-7ee5-4540-bf42-fa947549b89b req-4f3338d9-085e-4223-b689-511a813c5287 service nova] Creating event network-vif-plugged:55c8dfd7-0c47-40c6-800e-d5e2cfe592e1 for instance 2f6fa79f-c359-456d-aad4-cbd1e1a50d66 on hv-cinder-82956 Apr 05 12:27:13.227896 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-fcf2bf63-7ee5-4540-bf42-fa947549b89b req-4f3338d9-085e-4223-b689-511a813c5287 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.232196 Apr 05 12:27:13.228538 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1901/3823] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:27:13.407245 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-26d38b2d-c80f-405c-96b4-eba5b015f36b tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:27:13.407922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-26d38b2d-c80f-405c-96b4-eba5b015f36b tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:27:13.414354 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-26d38b2d-c80f-405c-96b4-eba5b015f36b tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:13.414812 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-26d38b2d-c80f-405c-96b4-eba5b015f36b tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:13.415586 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-26d38b2d-c80f-405c-96b4-eba5b015f36b tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:13.416020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-26d38b2d-c80f-405c-96b4-eba5b015f36b tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:13.574144 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-26d38b2d-c80f-405c-96b4-eba5b015f36b tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:27:13.582935 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-26d38b2d-c80f-405c-96b4-eba5b015f36b tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1359 microversion: 2.1 time: 0.179979 Apr 05 12:27:13.584916 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1923/3824] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:27:13 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:27:14.602505 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7c619dc6-54ce-40b1-91f1-4de7d8674574 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:27:14.603997 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7c619dc6-54ce-40b1-91f1-4de7d8674574 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:27:14.610909 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7c619dc6-54ce-40b1-91f1-4de7d8674574 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:14.611689 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7c619dc6-54ce-40b1-91f1-4de7d8674574 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:14.613215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7c619dc6-54ce-40b1-91f1-4de7d8674574 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:14.614102 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7c619dc6-54ce-40b1-91f1-4de7d8674574 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:14.824572 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7c619dc6-54ce-40b1-91f1-4de7d8674574 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:27:14.834301 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7c619dc6-54ce-40b1-91f1-4de7d8674574 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1549 microversion: 2.1 time: 0.237533 Apr 05 12:27:14.835194 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1902/3825] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:27:14 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1549 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:27:14.851545 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-dd178407-f20a-4b00-ac60-f3e844571e3d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:27:14.852051 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-dd178407-f20a-4b00-ac60-f3e844571e3d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:27:14.858603 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dd178407-f20a-4b00-ac60-f3e844571e3d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:14.859056 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dd178407-f20a-4b00-ac60-f3e844571e3d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:14.859841 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dd178407-f20a-4b00-ac60-f3e844571e3d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:14.860309 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dd178407-f20a-4b00-ac60-f3e844571e3d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:15.194724 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-dd178407-f20a-4b00-ac60-f3e844571e3d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:27:15.205503 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-dd178407-f20a-4b00-ac60-f3e844571e3d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1549 microversion: 2.1 time: 0.357887 Apr 05 12:27:15.206432 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1924/3826] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:27:14 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1549 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:27:15.225779 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8b2c20ce-1ea1-498d-bc7e-30a9c182b24e tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:27:15.229344 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-8b2c20ce-1ea1-498d-bc7e-30a9c182b24e tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:27:15.230243 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8b2c20ce-1ea1-498d-bc7e-30a9c182b24e tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Searching by: {'deleted': False, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926'} {{(pid=123357) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 05 12:27:15.239892 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8b2c20ce-1ea1-498d-bc7e-30a9c182b24e tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:15.240403 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8b2c20ce-1ea1-498d-bc7e-30a9c182b24e tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:15.241332 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8b2c20ce-1ea1-498d-bc7e-30a9c182b24e tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:15.241736 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8b2c20ce-1ea1-498d-bc7e-30a9c182b24e tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:15.356315 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.multi_cell_list [None req-8b2c20ce-1ea1-498d-bc7e-30a9c182b24e tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123357) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 05 12:27:15.477173 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8b2c20ce-1ea1-498d-bc7e-30a9c182b24e tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.256590 Apr 05 12:27:15.478342 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1903/3827] 10.222.0.61 () {58 vars in 1124 bytes} [Tue Apr 5 12:27:15 2022] GET /compute/v2.1/servers => generated 343 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:27:15.488446 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a786cf36-ad12-410f-af0b-96117192f980 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:27:15.489336 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a786cf36-ad12-410f-af0b-96117192f980 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:27:15.498793 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a786cf36-ad12-410f-af0b-96117192f980 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:15.499310 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a786cf36-ad12-410f-af0b-96117192f980 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:15.500180 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a786cf36-ad12-410f-af0b-96117192f980 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:15.500682 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a786cf36-ad12-410f-af0b-96117192f980 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:16.082907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a786cf36-ad12-410f-af0b-96117192f980 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:27:16.091879 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a786cf36-ad12-410f-af0b-96117192f980 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1549 microversion: 2.1 time: 0.607442 Apr 05 12:27:16.097153 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1925/3828] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:27:15 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1549 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:27:17.884996 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0c75d5a5-32a1-4163-b466-eada598d8e71 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10a3ebf4-16b2-40c2-a1f2-5152a78afa2d"}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:27:17.886205 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0c75d5a5-32a1-4163-b466-eada598d8e71 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:27:17.911869 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0c75d5a5-32a1-4163-b466-eada598d8e71 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:17.912469 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0c75d5a5-32a1-4163-b466-eada598d8e71 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:17.913269 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0c75d5a5-32a1-4163-b466-eada598d8e71 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:17.913692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0c75d5a5-32a1-4163-b466-eada598d8e71 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:18.374996 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0c75d5a5-32a1-4163-b466-eada598d8e71 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "POST /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.497078 Apr 05 12:27:18.377289 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1904/3829] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Apr 5 12:27:17 2022] POST /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66/os-volume_attachments => generated 194 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:27:25.579518 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5685f89d-6c2f-4b79-9dac-83066df6108d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:27:25.581204 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5685f89d-6c2f-4b79-9dac-83066df6108d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:27:25.590956 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5685f89d-6c2f-4b79-9dac-83066df6108d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:25.591863 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5685f89d-6c2f-4b79-9dac-83066df6108d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:25.593150 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5685f89d-6c2f-4b79-9dac-83066df6108d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:25.594896 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5685f89d-6c2f-4b79-9dac-83066df6108d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:25.984744 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5685f89d-6c2f-4b79-9dac-83066df6108d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:27:26.001889 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5685f89d-6c2f-4b79-9dac-83066df6108d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1595 microversion: 2.1 time: 0.426986 Apr 05 12:27:26.002560 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1926/3830] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:27:25 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1595 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:27:26.608658 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5ccd09a2-bd18-4731-8b83-ce4d29f96c60 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Action: 'create', calling method: .version_select at 0x7f1620114550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-800585948"}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:27:26.622789 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-5ccd09a2-bd18-4731-8b83-ce4d29f96c60 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Getting quotas for project ff211be298de4a89afdcf4b57bdbc6bb. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 12:27:26.626560 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-5ccd09a2-bd18-4731-8b83-ce4d29f96c60 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Getting quotas for user d4c19b3319804327be025ce4ae75279e and project ff211be298de4a89afdcf4b57bdbc6bb. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 12:27:26.830645 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-5ccd09a2-bd18-4731-8b83-ce4d29f96c60 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Getting quotas for project ff211be298de4a89afdcf4b57bdbc6bb. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 12:27:26.834409 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-5ccd09a2-bd18-4731-8b83-ce4d29f96c60 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Getting quotas for user d4c19b3319804327be025ce4ae75279e and project ff211be298de4a89afdcf4b57bdbc6bb. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 12:27:26.847511 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5ccd09a2-bd18-4731-8b83-ce4d29f96c60 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.445320 Apr 05 12:27:26.848382 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1905/3831] 10.222.0.61 () {60 vars in 1157 bytes} [Tue Apr 5 12:27:26 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:27:28.649786 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-80a3f2ac-3da1-4e35-b228-22d715f282c7 req-af948214-0dc1-455b-84a8-9b6836c90a01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f6fa79f-c359-456d-aad4-cbd1e1a50d66", "tag": "55c8dfd7-0c47-40c6-800e-d5e2cfe592e1"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:27:28.664984 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-80a3f2ac-3da1-4e35-b228-22d715f282c7 req-af948214-0dc1-455b-84a8-9b6836c90a01 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:28.665427 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-80a3f2ac-3da1-4e35-b228-22d715f282c7 req-af948214-0dc1-455b-84a8-9b6836c90a01 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:28.680035 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-80a3f2ac-3da1-4e35-b228-22d715f282c7 req-af948214-0dc1-455b-84a8-9b6836c90a01 service nova] Creating event network-changed:55c8dfd7-0c47-40c6-800e-d5e2cfe592e1 for instance 2f6fa79f-c359-456d-aad4-cbd1e1a50d66 on hv-cinder-82956 Apr 05 12:27:28.703347 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-80a3f2ac-3da1-4e35-b228-22d715f282c7 req-af948214-0dc1-455b-84a8-9b6836c90a01 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058225 Apr 05 12:27:28.705945 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1927/3832] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:27:30.264819 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-67074200-c2d7-461a-b7fc-d6257f82f92d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2021695725"}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:27:30.266315 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-67074200-c2d7-461a-b7fc-d6257f82f92d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:27:30.280224 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-67074200-c2d7-461a-b7fc-d6257f82f92d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:30.280737 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-67074200-c2d7-461a-b7fc-d6257f82f92d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:30.281538 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-67074200-c2d7-461a-b7fc-d6257f82f92d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:30.281974 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-67074200-c2d7-461a-b7fc-d6257f82f92d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:30.427101 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.network.security_group_api [None req-67074200-c2d7-461a-b7fc-d6257f82f92d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Adding security group 97e93c02-c527-49e7-a9c4-b626c3ba43a3 to port 55c8dfd7-0c47-40c6-800e-d5e2cfe592e1 Apr 05 12:27:30.798098 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-67074200-c2d7-461a-b7fc-d6257f82f92d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "POST /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66/action" status: 202 len: 0 microversion: 2.1 time: 0.539502 Apr 05 12:27:30.798746 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1906/3833] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Apr 5 12:27:30 2022] POST /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:27:30.808301 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-16e8a3cf-fbe9-4bea-b126-f04c2f4d5851 req-c7bbc6a5-a008-4de9-832e-b2f5406dcd8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f6fa79f-c359-456d-aad4-cbd1e1a50d66", "tag": "55c8dfd7-0c47-40c6-800e-d5e2cfe592e1"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:27:30.816473 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-76e16fbe-502e-4b37-bf69-5f9abd23be8e tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:27:30.818083 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-76e16fbe-502e-4b37-bf69-5f9abd23be8e tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:27:30.828017 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-16e8a3cf-fbe9-4bea-b126-f04c2f4d5851 req-c7bbc6a5-a008-4de9-832e-b2f5406dcd8e service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:30.828495 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-16e8a3cf-fbe9-4bea-b126-f04c2f4d5851 req-c7bbc6a5-a008-4de9-832e-b2f5406dcd8e service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:30.833070 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-76e16fbe-502e-4b37-bf69-5f9abd23be8e tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:30.833729 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-76e16fbe-502e-4b37-bf69-5f9abd23be8e tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:30.834678 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-76e16fbe-502e-4b37-bf69-5f9abd23be8e tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:27:30.835257 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-76e16fbe-502e-4b37-bf69-5f9abd23be8e tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:27:30.860667 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-16e8a3cf-fbe9-4bea-b126-f04c2f4d5851 req-c7bbc6a5-a008-4de9-832e-b2f5406dcd8e service nova] Creating event network-changed:55c8dfd7-0c47-40c6-800e-d5e2cfe592e1 for instance 2f6fa79f-c359-456d-aad4-cbd1e1a50d66 on hv-cinder-82956 Apr 05 12:27:30.871995 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-16e8a3cf-fbe9-4bea-b126-f04c2f4d5851 req-c7bbc6a5-a008-4de9-832e-b2f5406dcd8e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062900 Apr 05 12:27:30.873117 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1907/3834] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:27:31.057717 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-76e16fbe-502e-4b37-bf69-5f9abd23be8e tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:27:31.069301 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-76e16fbe-502e-4b37-bf69-5f9abd23be8e tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1761 microversion: 2.1 time: 0.264760 Apr 05 12:27:31.069892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1928/3835] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:27:30 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1761 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:27:57.164975 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:27:57.165979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Tue Apr 5 12:27:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:27:59.312127 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cb9099c4-48e3-4078-a9ff-34049519ea0c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1645570083", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-800585948", "security_groups": [{"name": "tempest-secgroup-smoke-1198763209"}], "block_device_mapping_v2": [{"uuid": "c81bdd52-a070-4b29-996d-f7d7b2403084", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "356d48a5-4799-4934-9c4e-ecbb87dec2b3"}]}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:27:59.589764 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.network.neutron [None req-cb9099c4-48e3-4078-a9ff-34049519ea0c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] validate_networks() for [('356d48a5-4799-4934-9c4e-ecbb87dec2b3', None, None, None, None, None)] {{(pid=123357) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 12:28:00.068703 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-cb9099c4-48e3-4078-a9ff-34049519ea0c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Flavor limits 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 12:28:00.069139 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-cb9099c4-48e3-4078-a9ff-34049519ea0c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Image limits 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:28:00.069600 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-cb9099c4-48e3-4078-a9ff-34049519ea0c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Flavor pref 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 12:28:00.069997 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-cb9099c4-48e3-4078-a9ff-34049519ea0c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Image pref 0:0:0 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:28:00.070397 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.virt.hardware [None req-cb9099c4-48e3-4078-a9ff-34049519ea0c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 12:28:00.079762 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cb9099c4-48e3-4078-a9ff-34049519ea0c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:00.080250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cb9099c4-48e3-4078-a9ff-34049519ea0c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:00.081029 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cb9099c4-48e3-4078-a9ff-34049519ea0c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:00.081458 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cb9099c4-48e3-4078-a9ff-34049519ea0c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:00.098117 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-cb9099c4-48e3-4078-a9ff-34049519ea0c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Getting quotas for project ff211be298de4a89afdcf4b57bdbc6bb. Resources: {'ram', 'instances', 'cores'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 12:28:00.102446 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-cb9099c4-48e3-4078-a9ff-34049519ea0c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Getting quotas for user d4c19b3319804327be025ce4ae75279e and project ff211be298de4a89afdcf4b57bdbc6bb. Resources: {'ram', 'instances', 'cores'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 12:28:00.159039 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cb9099c4-48e3-4078-a9ff-34049519ea0c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Going to run 1 instances... {{(pid=123357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 12:28:00.161218 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cb9099c4-48e3-4078-a9ff-34049519ea0c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c81bdd52-a070-4b29-996d-f7d7b2403084',volume_size=None,volume_type=None)] {{(pid=123357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 12:28:00.287897 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cb9099c4-48e3-4078-a9ff-34049519ea0c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.983556 Apr 05 12:28:00.288578 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1908/3836] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Apr 5 12:27:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 12:28:00.298478 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fdb131b7-697c-4099-87fe-edbb787f7701 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:00.299092 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fdb131b7-697c-4099-87fe-edbb787f7701 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:00.408297 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fdb131b7-697c-4099-87fe-edbb787f7701 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:00.415557 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fdb131b7-697c-4099-87fe-edbb787f7701 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c" status: 200 len: 1094 microversion: 2.1 time: 0.120904 Apr 05 12:28:00.416140 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1929/3837] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:00 2022] GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c => generated 1094 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:01.433027 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-cd8928d9-fdb3-4727-a353-e9019bc95559 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:01.433661 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-cd8928d9-fdb3-4727-a353-e9019bc95559 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:01.441184 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd8928d9-fdb3-4727-a353-e9019bc95559 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:01.441642 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd8928d9-fdb3-4727-a353-e9019bc95559 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:01.442402 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd8928d9-fdb3-4727-a353-e9019bc95559 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:01.442851 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-cd8928d9-fdb3-4727-a353-e9019bc95559 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:01.501486 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-cd8928d9-fdb3-4727-a353-e9019bc95559 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:01.509354 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-cd8928d9-fdb3-4727-a353-e9019bc95559 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c" status: 200 len: 1136 microversion: 2.1 time: 0.080691 Apr 05 12:28:01.509925 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1909/3838] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:01 2022] GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c => generated 1136 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:02.527200 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-90152500-81ef-4315-b590-a32dbcd56fed tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:02.528497 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-90152500-81ef-4315-b590-a32dbcd56fed tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:02.539135 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90152500-81ef-4315-b590-a32dbcd56fed tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:02.539758 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90152500-81ef-4315-b590-a32dbcd56fed tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:02.540703 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90152500-81ef-4315-b590-a32dbcd56fed tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:02.541084 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-90152500-81ef-4315-b590-a32dbcd56fed tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:02.721403 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-90152500-81ef-4315-b590-a32dbcd56fed tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:02.729087 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-90152500-81ef-4315-b590-a32dbcd56fed tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c" status: 200 len: 1278 microversion: 2.1 time: 0.206678 Apr 05 12:28:02.729730 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1930/3839] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:02 2022] GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c => generated 1278 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:03.342050 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-8714b3bc-0588-4d0e-9606-d90d9f8bac88 req-82895d12-8fcd-41b2-96c6-1fdb425dbdd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73459d0a-9074-4cc4-b60c-5d775163d68c", "tag": "b580678a-6fac-4cf2-80a9-30cabaf7530a"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:28:03.369106 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-8714b3bc-0588-4d0e-9606-d90d9f8bac88 req-82895d12-8fcd-41b2-96c6-1fdb425dbdd8 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:03.369751 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-8714b3bc-0588-4d0e-9606-d90d9f8bac88 req-82895d12-8fcd-41b2-96c6-1fdb425dbdd8 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:03.390041 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-8714b3bc-0588-4d0e-9606-d90d9f8bac88 req-82895d12-8fcd-41b2-96c6-1fdb425dbdd8 service nova] Creating event network-changed:b580678a-6fac-4cf2-80a9-30cabaf7530a for instance 73459d0a-9074-4cc4-b60c-5d775163d68c on hv-cinder-82956 Apr 05 12:28:03.396024 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-8714b3bc-0588-4d0e-9606-d90d9f8bac88 req-82895d12-8fcd-41b2-96c6-1fdb425dbdd8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061814 Apr 05 12:28:03.397867 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1910/3840] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:28:03.748465 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f3c18cfd-933c-4d4f-8bd7-b8eae79289b8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:03.749754 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f3c18cfd-933c-4d4f-8bd7-b8eae79289b8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:03.756599 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f3c18cfd-933c-4d4f-8bd7-b8eae79289b8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:03.757054 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f3c18cfd-933c-4d4f-8bd7-b8eae79289b8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:03.758255 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f3c18cfd-933c-4d4f-8bd7-b8eae79289b8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:03.758697 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f3c18cfd-933c-4d4f-8bd7-b8eae79289b8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:04.169830 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f3c18cfd-933c-4d4f-8bd7-b8eae79289b8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:04.177290 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f3c18cfd-933c-4d4f-8bd7-b8eae79289b8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c" status: 200 len: 1266 microversion: 2.1 time: 0.433548 Apr 05 12:28:04.177861 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1931/3841] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:03 2022] GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c => generated 1266 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:05.199659 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4d635229-d2f3-48c5-8a03-498c88e28c48 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:05.200863 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4d635229-d2f3-48c5-8a03-498c88e28c48 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:05.211814 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4d635229-d2f3-48c5-8a03-498c88e28c48 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:05.212600 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4d635229-d2f3-48c5-8a03-498c88e28c48 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:05.213836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4d635229-d2f3-48c5-8a03-498c88e28c48 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:05.214530 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4d635229-d2f3-48c5-8a03-498c88e28c48 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:05.361088 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4d635229-d2f3-48c5-8a03-498c88e28c48 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:05.372381 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4d635229-d2f3-48c5-8a03-498c88e28c48 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c" status: 200 len: 1266 microversion: 2.1 time: 0.179355 Apr 05 12:28:05.373158 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1911/3842] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:05 2022] GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:06.393389 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-94cbdf37-2d1a-4d8e-970d-72fc9f0aba68 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:06.393995 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-94cbdf37-2d1a-4d8e-970d-72fc9f0aba68 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:06.400419 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94cbdf37-2d1a-4d8e-970d-72fc9f0aba68 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:06.400953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94cbdf37-2d1a-4d8e-970d-72fc9f0aba68 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:06.401654 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94cbdf37-2d1a-4d8e-970d-72fc9f0aba68 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:06.402085 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-94cbdf37-2d1a-4d8e-970d-72fc9f0aba68 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:06.548377 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-94cbdf37-2d1a-4d8e-970d-72fc9f0aba68 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:06.556015 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-94cbdf37-2d1a-4d8e-970d-72fc9f0aba68 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c" status: 200 len: 1266 microversion: 2.1 time: 0.166901 Apr 05 12:28:06.556700 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1932/3843] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:06 2022] GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:07.572806 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-87bb0421-c03a-4c1e-ae82-66d415ca6329 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:07.573632 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-87bb0421-c03a-4c1e-ae82-66d415ca6329 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:07.580225 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-87bb0421-c03a-4c1e-ae82-66d415ca6329 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:07.580664 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-87bb0421-c03a-4c1e-ae82-66d415ca6329 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:07.581405 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-87bb0421-c03a-4c1e-ae82-66d415ca6329 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:07.581836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-87bb0421-c03a-4c1e-ae82-66d415ca6329 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:07.715431 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-87bb0421-c03a-4c1e-ae82-66d415ca6329 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:07.722743 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-87bb0421-c03a-4c1e-ae82-66d415ca6329 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c" status: 200 len: 1266 microversion: 2.1 time: 0.153791 Apr 05 12:28:07.723370 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1912/3844] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:07 2022] GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:08.739749 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-786fa52c-5174-47b1-aaa0-8034335b56c9 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:08.740376 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-786fa52c-5174-47b1-aaa0-8034335b56c9 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:08.747221 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-786fa52c-5174-47b1-aaa0-8034335b56c9 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:08.747671 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-786fa52c-5174-47b1-aaa0-8034335b56c9 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:08.748476 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-786fa52c-5174-47b1-aaa0-8034335b56c9 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:08.748931 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-786fa52c-5174-47b1-aaa0-8034335b56c9 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:08.893535 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-786fa52c-5174-47b1-aaa0-8034335b56c9 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:08.901562 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-786fa52c-5174-47b1-aaa0-8034335b56c9 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c" status: 200 len: 1266 microversion: 2.1 time: 0.166126 Apr 05 12:28:08.902137 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1933/3845] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:08 2022] GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:09.922458 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e6bd4e03-32dc-4a86-9626-84120b9cd152 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:09.923422 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e6bd4e03-32dc-4a86-9626-84120b9cd152 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:09.933706 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6bd4e03-32dc-4a86-9626-84120b9cd152 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:09.934147 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6bd4e03-32dc-4a86-9626-84120b9cd152 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:09.934906 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6bd4e03-32dc-4a86-9626-84120b9cd152 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:09.935326 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6bd4e03-32dc-4a86-9626-84120b9cd152 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:10.084382 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e6bd4e03-32dc-4a86-9626-84120b9cd152 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:10.091755 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e6bd4e03-32dc-4a86-9626-84120b9cd152 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c" status: 200 len: 1266 microversion: 2.1 time: 0.175731 Apr 05 12:28:10.092345 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1913/3846] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:09 2022] GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:10.702027 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0516f770-cbb3-4181-966e-ce558887cedb tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:28:10.703708 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0516f770-cbb3-4181-966e-ce558887cedb tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:10.714470 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0516f770-cbb3-4181-966e-ce558887cedb tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:10.715342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0516f770-cbb3-4181-966e-ce558887cedb tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:10.716131 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0516f770-cbb3-4181-966e-ce558887cedb tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:10.716530 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0516f770-cbb3-4181-966e-ce558887cedb tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:10.792487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0516f770-cbb3-4181-966e-ce558887cedb tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "POST /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66/action" status: 202 len: 0 microversion: 2.1 time: 0.096861 Apr 05 12:28:10.793176 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1934/3847] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Apr 5 12:28:10 2022] POST /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:28:10.801302 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0de7608d-0628-457a-a114-b3f8c59d0632 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:10.801898 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0de7608d-0628-457a-a114-b3f8c59d0632 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:10.807659 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0de7608d-0628-457a-a114-b3f8c59d0632 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:10.808133 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0de7608d-0628-457a-a114-b3f8c59d0632 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:10.808936 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0de7608d-0628-457a-a114-b3f8c59d0632 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:10.809363 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0de7608d-0628-457a-a114-b3f8c59d0632 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:11.049967 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0de7608d-0628-457a-a114-b3f8c59d0632 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:11.057991 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0de7608d-0628-457a-a114-b3f8c59d0632 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1753 microversion: 2.1 time: 0.260606 Apr 05 12:28:11.058585 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1914/3848] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:10 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1753 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:11.109879 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3c72457d-6d7b-493d-b8a7-ea5c3e62a723 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:11.111049 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3c72457d-6d7b-493d-b8a7-ea5c3e62a723 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:11.118004 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3c72457d-6d7b-493d-b8a7-ea5c3e62a723 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:11.118461 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3c72457d-6d7b-493d-b8a7-ea5c3e62a723 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:11.119230 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3c72457d-6d7b-493d-b8a7-ea5c3e62a723 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:11.119661 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3c72457d-6d7b-493d-b8a7-ea5c3e62a723 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:11.281728 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3c72457d-6d7b-493d-b8a7-ea5c3e62a723 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:11.295949 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3c72457d-6d7b-493d-b8a7-ea5c3e62a723 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c" status: 200 len: 1266 microversion: 2.1 time: 0.190537 Apr 05 12:28:11.296587 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1935/3849] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:11 2022] GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:12.075686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1d9c1069-489f-4830-b351-23f8b5a96682 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:12.076309 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1d9c1069-489f-4830-b351-23f8b5a96682 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:12.082848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1d9c1069-489f-4830-b351-23f8b5a96682 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:12.083476 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1d9c1069-489f-4830-b351-23f8b5a96682 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:12.084273 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1d9c1069-489f-4830-b351-23f8b5a96682 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:12.084947 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1d9c1069-489f-4830-b351-23f8b5a96682 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:12.251373 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1d9c1069-489f-4830-b351-23f8b5a96682 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:12.259460 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1d9c1069-489f-4830-b351-23f8b5a96682 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1758 microversion: 2.1 time: 0.187537 Apr 05 12:28:12.260104 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1915/3850] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:12 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1758 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:12.313059 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8b4f3db0-ded5-47bc-b519-bf8b19064d93 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:12.313682 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8b4f3db0-ded5-47bc-b519-bf8b19064d93 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:12.320787 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8b4f3db0-ded5-47bc-b519-bf8b19064d93 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:12.321236 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8b4f3db0-ded5-47bc-b519-bf8b19064d93 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:12.322026 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8b4f3db0-ded5-47bc-b519-bf8b19064d93 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:12.322477 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8b4f3db0-ded5-47bc-b519-bf8b19064d93 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:12.460645 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8b4f3db0-ded5-47bc-b519-bf8b19064d93 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:12.468141 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8b4f3db0-ded5-47bc-b519-bf8b19064d93 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c" status: 200 len: 1266 microversion: 2.1 time: 0.159130 Apr 05 12:28:12.468701 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1936/3851] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:12 2022] GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:13.263068 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-8775d41c-fcdd-4519-b613-d80efafc808c req-6d3adcd2-12f0-4282-a2be-8a19d30e56d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73459d0a-9074-4cc4-b60c-5d775163d68c", "name": "network-vif-plugged", "status": "completed", "tag": "b580678a-6fac-4cf2-80a9-30cabaf7530a"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:28:13.273186 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-8775d41c-fcdd-4519-b613-d80efafc808c req-6d3adcd2-12f0-4282-a2be-8a19d30e56d4 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:13.273843 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-8775d41c-fcdd-4519-b613-d80efafc808c req-6d3adcd2-12f0-4282-a2be-8a19d30e56d4 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:13.279989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c3e8ea8a-8885-4fa2-a92a-5423a7690d7e tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:13.280628 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c3e8ea8a-8885-4fa2-a92a-5423a7690d7e tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:13.287163 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c3e8ea8a-8885-4fa2-a92a-5423a7690d7e tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:13.287613 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c3e8ea8a-8885-4fa2-a92a-5423a7690d7e tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:13.288406 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c3e8ea8a-8885-4fa2-a92a-5423a7690d7e tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:13.288834 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c3e8ea8a-8885-4fa2-a92a-5423a7690d7e tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:13.289521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-8775d41c-fcdd-4519-b613-d80efafc808c req-6d3adcd2-12f0-4282-a2be-8a19d30e56d4 service nova] Creating event network-vif-plugged:b580678a-6fac-4cf2-80a9-30cabaf7530a for instance 73459d0a-9074-4cc4-b60c-5d775163d68c on hv-cinder-82956 Apr 05 12:28:13.295125 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-8775d41c-fcdd-4519-b613-d80efafc808c req-6d3adcd2-12f0-4282-a2be-8a19d30e56d4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035800 Apr 05 12:28:13.297026 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1916/3852] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:28:13.474170 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c3e8ea8a-8885-4fa2-a92a-5423a7690d7e tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:13.484659 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c3e8ea8a-8885-4fa2-a92a-5423a7690d7e tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1758 microversion: 2.1 time: 0.210355 Apr 05 12:28:13.485856 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1937/3853] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:13 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1758 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:28:13.492539 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-57e7d5cf-34ea-4cfe-9632-39b007e87ea8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:13.494454 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-57e7d5cf-34ea-4cfe-9632-39b007e87ea8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:13.505678 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-57e7d5cf-34ea-4cfe-9632-39b007e87ea8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:13.506131 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-57e7d5cf-34ea-4cfe-9632-39b007e87ea8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:13.506902 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-57e7d5cf-34ea-4cfe-9632-39b007e87ea8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:13.507375 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-57e7d5cf-34ea-4cfe-9632-39b007e87ea8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:13.708228 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-57e7d5cf-34ea-4cfe-9632-39b007e87ea8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:13.724636 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-57e7d5cf-34ea-4cfe-9632-39b007e87ea8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c" status: 200 len: 1266 microversion: 2.1 time: 0.243052 Apr 05 12:28:13.725416 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1917/3854] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:13 2022] GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:28:14.504966 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fb9aaac2-7559-4de0-9bd9-566cd934bc17 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:14.505676 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fb9aaac2-7559-4de0-9bd9-566cd934bc17 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:14.513498 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fb9aaac2-7559-4de0-9bd9-566cd934bc17 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:14.513944 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fb9aaac2-7559-4de0-9bd9-566cd934bc17 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:14.514760 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fb9aaac2-7559-4de0-9bd9-566cd934bc17 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:14.515184 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fb9aaac2-7559-4de0-9bd9-566cd934bc17 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:14.670541 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fb9aaac2-7559-4de0-9bd9-566cd934bc17 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:14.678669 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fb9aaac2-7559-4de0-9bd9-566cd934bc17 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1758 microversion: 2.1 time: 0.179066 Apr 05 12:28:14.679252 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1938/3855] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:14 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:14.743940 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1e4203f3-b4a5-421b-81de-963293fb9e31 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:14.745505 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1e4203f3-b4a5-421b-81de-963293fb9e31 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:14.753921 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1e4203f3-b4a5-421b-81de-963293fb9e31 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:14.754547 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1e4203f3-b4a5-421b-81de-963293fb9e31 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:14.755602 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1e4203f3-b4a5-421b-81de-963293fb9e31 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:14.756280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1e4203f3-b4a5-421b-81de-963293fb9e31 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:14.903652 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1e4203f3-b4a5-421b-81de-963293fb9e31 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:14.911435 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1e4203f3-b4a5-421b-81de-963293fb9e31 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c" status: 200 len: 1266 microversion: 2.1 time: 0.172800 Apr 05 12:28:14.912061 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1918/3856] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:14 2022] GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:15.700005 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8e9198ae-7c3e-4c41-8043-1874f5383ded tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:15.700714 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8e9198ae-7c3e-4c41-8043-1874f5383ded tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:15.708056 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e9198ae-7c3e-4c41-8043-1874f5383ded tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:15.708578 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e9198ae-7c3e-4c41-8043-1874f5383ded tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:15.709413 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e9198ae-7c3e-4c41-8043-1874f5383ded tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:15.709879 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8e9198ae-7c3e-4c41-8043-1874f5383ded tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:15.860588 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8e9198ae-7c3e-4c41-8043-1874f5383ded tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:15.869123 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8e9198ae-7c3e-4c41-8043-1874f5383ded tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1758 microversion: 2.1 time: 0.175515 Apr 05 12:28:15.869672 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1939/3857] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:15 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:15.930420 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-686269d8-ad3f-4657-8a5e-0b8e50458a35 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:15.931030 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-686269d8-ad3f-4657-8a5e-0b8e50458a35 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:15.937482 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-686269d8-ad3f-4657-8a5e-0b8e50458a35 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:15.937927 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-686269d8-ad3f-4657-8a5e-0b8e50458a35 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:15.938714 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-686269d8-ad3f-4657-8a5e-0b8e50458a35 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:15.939151 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-686269d8-ad3f-4657-8a5e-0b8e50458a35 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:16.078362 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-686269d8-ad3f-4657-8a5e-0b8e50458a35 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:16.086342 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-686269d8-ad3f-4657-8a5e-0b8e50458a35 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c" status: 200 len: 1266 microversion: 2.1 time: 0.159782 Apr 05 12:28:16.086920 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1919/3858] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:15 2022] GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:16.886487 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1ba85db0-7632-425a-83f4-884631259f2d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:16.887380 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1ba85db0-7632-425a-83f4-884631259f2d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:16.893666 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1ba85db0-7632-425a-83f4-884631259f2d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:16.894114 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1ba85db0-7632-425a-83f4-884631259f2d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:16.894900 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1ba85db0-7632-425a-83f4-884631259f2d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:16.895316 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1ba85db0-7632-425a-83f4-884631259f2d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:17.047361 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1ba85db0-7632-425a-83f4-884631259f2d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:17.055708 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1ba85db0-7632-425a-83f4-884631259f2d tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1758 microversion: 2.1 time: 0.173359 Apr 05 12:28:17.056315 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1940/3859] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:16 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:17.103007 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d507fd2c-4daf-43b6-a1df-63c32ad3d7e6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:17.103528 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d507fd2c-4daf-43b6-a1df-63c32ad3d7e6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:17.110313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d507fd2c-4daf-43b6-a1df-63c32ad3d7e6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:17.110762 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d507fd2c-4daf-43b6-a1df-63c32ad3d7e6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:17.111881 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d507fd2c-4daf-43b6-a1df-63c32ad3d7e6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:17.112340 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d507fd2c-4daf-43b6-a1df-63c32ad3d7e6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:17.248325 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-d507fd2c-4daf-43b6-a1df-63c32ad3d7e6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:17.259658 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d507fd2c-4daf-43b6-a1df-63c32ad3d7e6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c" status: 200 len: 1266 microversion: 2.1 time: 0.160417 Apr 05 12:28:17.260561 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1920/3860] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:17 2022] GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:18.072973 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f4cfc131-a04c-41e0-bb61-c67e7f675763 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:18.073749 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f4cfc131-a04c-41e0-bb61-c67e7f675763 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:18.080598 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f4cfc131-a04c-41e0-bb61-c67e7f675763 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:18.081321 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f4cfc131-a04c-41e0-bb61-c67e7f675763 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:18.082660 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f4cfc131-a04c-41e0-bb61-c67e7f675763 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:18.083094 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f4cfc131-a04c-41e0-bb61-c67e7f675763 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:18.258281 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-f4cfc131-a04c-41e0-bb61-c67e7f675763 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:18.269885 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f4cfc131-a04c-41e0-bb61-c67e7f675763 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1758 microversion: 2.1 time: 0.198249 Apr 05 12:28:18.277703 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1941/3861] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:18 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1758 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:18.282528 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-694cdfd2-bc8b-4311-8de0-8bfb7c54ab9e tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:18.283676 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-694cdfd2-bc8b-4311-8de0-8bfb7c54ab9e tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:18.290642 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-694cdfd2-bc8b-4311-8de0-8bfb7c54ab9e tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:18.291196 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-694cdfd2-bc8b-4311-8de0-8bfb7c54ab9e tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:18.292150 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-694cdfd2-bc8b-4311-8de0-8bfb7c54ab9e tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:18.292558 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-694cdfd2-bc8b-4311-8de0-8bfb7c54ab9e tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:18.465891 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-694cdfd2-bc8b-4311-8de0-8bfb7c54ab9e tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:18.473665 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-694cdfd2-bc8b-4311-8de0-8bfb7c54ab9e tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c" status: 200 len: 1453 microversion: 2.1 time: 0.194992 Apr 05 12:28:18.474299 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1921/3862] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:18 2022] GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c => generated 1453 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:18.490959 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6d158624-a039-4357-9576-8c826407c6f1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:18.491492 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6d158624-a039-4357-9576-8c826407c6f1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:18.497367 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6d158624-a039-4357-9576-8c826407c6f1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:18.497811 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6d158624-a039-4357-9576-8c826407c6f1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:18.498563 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6d158624-a039-4357-9576-8c826407c6f1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:18.498987 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6d158624-a039-4357-9576-8c826407c6f1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:18.632854 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6d158624-a039-4357-9576-8c826407c6f1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:18.640673 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6d158624-a039-4357-9576-8c826407c6f1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c" status: 200 len: 1453 microversion: 2.1 time: 0.153645 Apr 05 12:28:18.641229 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1942/3863] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:18 2022] GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:28:19.284871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ae239b48-1800-4d5b-874c-e454e8d2dba9 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:19.285215 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ae239b48-1800-4d5b-874c-e454e8d2dba9 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:19.291590 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae239b48-1800-4d5b-874c-e454e8d2dba9 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:19.292505 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae239b48-1800-4d5b-874c-e454e8d2dba9 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:19.293271 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae239b48-1800-4d5b-874c-e454e8d2dba9 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:19.293765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae239b48-1800-4d5b-874c-e454e8d2dba9 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:19.465688 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ae239b48-1800-4d5b-874c-e454e8d2dba9 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:19.474869 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ae239b48-1800-4d5b-874c-e454e8d2dba9 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1758 microversion: 2.1 time: 0.194214 Apr 05 12:28:19.485877 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1922/3864] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:19 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1758 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:20.482552 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-f13558a3-7662-4416-b953-27cb56c8ce6a req-70c72bb4-de09-44e7-9fa4-5046a4a605f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73459d0a-9074-4cc4-b60c-5d775163d68c", "tag": "b580678a-6fac-4cf2-80a9-30cabaf7530a"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:28:20.492365 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-f13558a3-7662-4416-b953-27cb56c8ce6a req-70c72bb4-de09-44e7-9fa4-5046a4a605f8 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:20.493132 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-f13558a3-7662-4416-b953-27cb56c8ce6a req-70c72bb4-de09-44e7-9fa4-5046a4a605f8 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:20.493678 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e6d628be-6008-4e22-a70f-2ad2aeb97565 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:20.494297 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e6d628be-6008-4e22-a70f-2ad2aeb97565 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:20.501768 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6d628be-6008-4e22-a70f-2ad2aeb97565 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:20.502231 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6d628be-6008-4e22-a70f-2ad2aeb97565 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:20.503020 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6d628be-6008-4e22-a70f-2ad2aeb97565 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:20.503447 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e6d628be-6008-4e22-a70f-2ad2aeb97565 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:20.506783 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-f13558a3-7662-4416-b953-27cb56c8ce6a req-70c72bb4-de09-44e7-9fa4-5046a4a605f8 service nova] Creating event network-changed:b580678a-6fac-4cf2-80a9-30cabaf7530a for instance 73459d0a-9074-4cc4-b60c-5d775163d68c on hv-cinder-82956 Apr 05 12:28:20.512050 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-f13558a3-7662-4416-b953-27cb56c8ce6a req-70c72bb4-de09-44e7-9fa4-5046a4a605f8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033295 Apr 05 12:28:20.513247 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1943/3865] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:28:20.755758 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e6d628be-6008-4e22-a70f-2ad2aeb97565 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:20.764501 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e6d628be-6008-4e22-a70f-2ad2aeb97565 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1758 microversion: 2.1 time: 0.275088 Apr 05 12:28:20.767572 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1923/3866] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:20 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1758 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:21.784210 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4ae124f7-97f3-47da-b9b4-6c406cd017ec tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:21.784908 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4ae124f7-97f3-47da-b9b4-6c406cd017ec tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:21.791560 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4ae124f7-97f3-47da-b9b4-6c406cd017ec tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:21.792001 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4ae124f7-97f3-47da-b9b4-6c406cd017ec tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:21.792794 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4ae124f7-97f3-47da-b9b4-6c406cd017ec tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:21.793223 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4ae124f7-97f3-47da-b9b4-6c406cd017ec tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:21.949580 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4ae124f7-97f3-47da-b9b4-6c406cd017ec tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:21.957657 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4ae124f7-97f3-47da-b9b4-6c406cd017ec tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1758 microversion: 2.1 time: 0.178343 Apr 05 12:28:21.966309 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1944/3867] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:21 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:22.974733 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-7d193b86-d46a-40e0-97ec-bc6ae0e9b8ee tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:22.975492 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-7d193b86-d46a-40e0-97ec-bc6ae0e9b8ee tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:22.982428 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7d193b86-d46a-40e0-97ec-bc6ae0e9b8ee tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:22.983016 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7d193b86-d46a-40e0-97ec-bc6ae0e9b8ee tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:22.983642 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7d193b86-d46a-40e0-97ec-bc6ae0e9b8ee tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:22.984163 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-7d193b86-d46a-40e0-97ec-bc6ae0e9b8ee tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:23.139148 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-7d193b86-d46a-40e0-97ec-bc6ae0e9b8ee tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:23.147045 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-7d193b86-d46a-40e0-97ec-bc6ae0e9b8ee tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1761 microversion: 2.1 time: 0.176177 Apr 05 12:28:23.147624 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1924/3868] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:22 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1761 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:26.245027 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-f1e8cc52-1481-46eb-9b93-8b41182d3e3b tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1469812820", "imageRef": "2b657785-cb0b-43ba-956c-1564c27fd10a", "flavorRef": "452"}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:28:26.296342 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.network.neutron [None req-f1e8cc52-1481-46eb-9b93-8b41182d3e3b tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] validate_networks() for None {{(pid=123358) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 12:28:26.577683 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-f1e8cc52-1481-46eb-9b93-8b41182d3e3b tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Flavor limits 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 12:28:26.578124 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-f1e8cc52-1481-46eb-9b93-8b41182d3e3b tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Image limits 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:28:26.578591 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-f1e8cc52-1481-46eb-9b93-8b41182d3e3b tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Flavor pref 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 12:28:26.578994 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-f1e8cc52-1481-46eb-9b93-8b41182d3e3b tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Image pref 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:28:26.579395 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-f1e8cc52-1481-46eb-9b93-8b41182d3e3b tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 12:28:26.588241 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f1e8cc52-1481-46eb-9b93-8b41182d3e3b tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:26.588683 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f1e8cc52-1481-46eb-9b93-8b41182d3e3b tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:26.589466 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f1e8cc52-1481-46eb-9b93-8b41182d3e3b tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:26.589888 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-f1e8cc52-1481-46eb-9b93-8b41182d3e3b tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:26.605887 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-f1e8cc52-1481-46eb-9b93-8b41182d3e3b tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Getting quotas for project a444cd304b2940b79a1876e330198910. Resources: {'ram', 'instances', 'cores'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 12:28:26.609736 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-f1e8cc52-1481-46eb-9b93-8b41182d3e3b tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Getting quotas for user a26f221288b749d89fb4a6984a07260e and project a444cd304b2940b79a1876e330198910. Resources: {'ram', 'instances', 'cores'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 12:28:26.621027 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f1e8cc52-1481-46eb-9b93-8b41182d3e3b tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Going to run 1 instances... {{(pid=123358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 12:28:26.623297 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-f1e8cc52-1481-46eb-9b93-8b41182d3e3b tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] [instance: 751ac6d3-11c2-42c1-adba-efe02799ef35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b657785-cb0b-43ba-956c-1564c27fd10a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 12:28:26.670841 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-f1e8cc52-1481-46eb-9b93-8b41182d3e3b tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.429622 Apr 05 12:28:26.671713 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1945/3869] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Apr 5 12:28:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 431 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 12:28:26.681863 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ca5e64bf-931e-4f59-9786-2418aa5e8d20 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:26.682553 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ca5e64bf-931e-4f59-9786-2418aa5e8d20 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] [instance: 751ac6d3-11c2-42c1-adba-efe02799ef35] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:26.733885 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ca5e64bf-931e-4f59-9786-2418aa5e8d20 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26f221288b749d89fb4a6984a07260e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444cd304b2940b79a1876e330198910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:26.740812 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ca5e64bf-931e-4f59-9786-2418aa5e8d20 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] 10.222.0.61 "GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35" status: 200 len: 1215 microversion: 2.1 time: 0.062955 Apr 05 12:28:26.741351 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1925/3870] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:26 2022] GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35 => generated 1215 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:27.758326 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-47d41bbb-b977-4766-a5cf-a9d02dd4df30 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:27.758935 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-47d41bbb-b977-4766-a5cf-a9d02dd4df30 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] [instance: 751ac6d3-11c2-42c1-adba-efe02799ef35] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:27.767697 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-47d41bbb-b977-4766-a5cf-a9d02dd4df30 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:27.768146 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-47d41bbb-b977-4766-a5cf-a9d02dd4df30 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:27.769149 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-47d41bbb-b977-4766-a5cf-a9d02dd4df30 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:27.769576 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-47d41bbb-b977-4766-a5cf-a9d02dd4df30 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:27.830358 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-47d41bbb-b977-4766-a5cf-a9d02dd4df30 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26f221288b749d89fb4a6984a07260e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444cd304b2940b79a1876e330198910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:27.838160 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-47d41bbb-b977-4766-a5cf-a9d02dd4df30 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] 10.222.0.61 "GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35" status: 200 len: 1267 microversion: 2.1 time: 0.083707 Apr 05 12:28:27.838751 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1946/3871] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:27 2022] GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35 => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:28.855082 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1ef05ed4-5ed6-47f8-9ead-ef6dcfcd0c30 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:28.856339 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1ef05ed4-5ed6-47f8-9ead-ef6dcfcd0c30 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] [instance: 751ac6d3-11c2-42c1-adba-efe02799ef35] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:28.863391 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ef05ed4-5ed6-47f8-9ead-ef6dcfcd0c30 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:28.864163 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ef05ed4-5ed6-47f8-9ead-ef6dcfcd0c30 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:28.865094 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ef05ed4-5ed6-47f8-9ead-ef6dcfcd0c30 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:28.865512 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ef05ed4-5ed6-47f8-9ead-ef6dcfcd0c30 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:29.128891 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1ef05ed4-5ed6-47f8-9ead-ef6dcfcd0c30 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26f221288b749d89fb4a6984a07260e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444cd304b2940b79a1876e330198910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:29.136264 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1ef05ed4-5ed6-47f8-9ead-ef6dcfcd0c30 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] 10.222.0.61 "GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35" status: 200 len: 1315 microversion: 2.1 time: 0.285172 Apr 05 12:28:29.136918 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1926/3872] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:28 2022] GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:29.464858 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-ad1bbf26-e090-486f-886c-e5e4184c4c1a req-a7d2db83-52c9-4ec7-86dd-c0730d2cc79a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "751ac6d3-11c2-42c1-adba-efe02799ef35", "tag": "702280b5-449d-4911-9ea2-cc02ae072b9f"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:28:29.474355 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-ad1bbf26-e090-486f-886c-e5e4184c4c1a req-a7d2db83-52c9-4ec7-86dd-c0730d2cc79a service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:29.475056 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-ad1bbf26-e090-486f-886c-e5e4184c4c1a req-a7d2db83-52c9-4ec7-86dd-c0730d2cc79a service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:29.494161 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-ad1bbf26-e090-486f-886c-e5e4184c4c1a req-a7d2db83-52c9-4ec7-86dd-c0730d2cc79a service nova] Creating event network-changed:702280b5-449d-4911-9ea2-cc02ae072b9f for instance 751ac6d3-11c2-42c1-adba-efe02799ef35 on hv-cinder-82956 Apr 05 12:28:29.502506 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-ad1bbf26-e090-486f-886c-e5e4184c4c1a req-a7d2db83-52c9-4ec7-86dd-c0730d2cc79a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041175 Apr 05 12:28:29.503753 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1947/3873] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:28:30.157208 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-17406ed1-a194-4e02-a675-5c8a1ef34876 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:30.157965 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-17406ed1-a194-4e02-a675-5c8a1ef34876 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] [instance: 751ac6d3-11c2-42c1-adba-efe02799ef35] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:30.167720 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-17406ed1-a194-4e02-a675-5c8a1ef34876 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:30.168386 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-17406ed1-a194-4e02-a675-5c8a1ef34876 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:30.169492 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-17406ed1-a194-4e02-a675-5c8a1ef34876 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:30.170076 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-17406ed1-a194-4e02-a675-5c8a1ef34876 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:30.328456 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-17406ed1-a194-4e02-a675-5c8a1ef34876 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26f221288b749d89fb4a6984a07260e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444cd304b2940b79a1876e330198910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:30.336130 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-17406ed1-a194-4e02-a675-5c8a1ef34876 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] 10.222.0.61 "GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35" status: 200 len: 1315 microversion: 2.1 time: 0.185081 Apr 05 12:28:30.336737 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1927/3874] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:30 2022] GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:31.353712 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-a22490d0-27c4-4237-91e7-8a79e1e69779 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:31.355116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-a22490d0-27c4-4237-91e7-8a79e1e69779 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] [instance: 751ac6d3-11c2-42c1-adba-efe02799ef35] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:31.363593 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a22490d0-27c4-4237-91e7-8a79e1e69779 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:31.364332 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a22490d0-27c4-4237-91e7-8a79e1e69779 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:31.365360 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a22490d0-27c4-4237-91e7-8a79e1e69779 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:31.365839 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-a22490d0-27c4-4237-91e7-8a79e1e69779 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:31.519019 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-a22490d0-27c4-4237-91e7-8a79e1e69779 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26f221288b749d89fb4a6984a07260e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444cd304b2940b79a1876e330198910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:31.526744 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-a22490d0-27c4-4237-91e7-8a79e1e69779 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] 10.222.0.61 "GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35" status: 200 len: 1315 microversion: 2.1 time: 0.177530 Apr 05 12:28:31.527327 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1948/3875] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:31 2022] GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:32.547302 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5ea967b8-c9a8-424b-8670-0f18503e82d9 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:32.548179 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5ea967b8-c9a8-424b-8670-0f18503e82d9 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] [instance: 751ac6d3-11c2-42c1-adba-efe02799ef35] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:32.555927 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5ea967b8-c9a8-424b-8670-0f18503e82d9 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:32.556438 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5ea967b8-c9a8-424b-8670-0f18503e82d9 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:32.557251 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5ea967b8-c9a8-424b-8670-0f18503e82d9 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:32.557693 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5ea967b8-c9a8-424b-8670-0f18503e82d9 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:32.697871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5ea967b8-c9a8-424b-8670-0f18503e82d9 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26f221288b749d89fb4a6984a07260e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444cd304b2940b79a1876e330198910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:32.705549 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5ea967b8-c9a8-424b-8670-0f18503e82d9 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] 10.222.0.61 "GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35" status: 200 len: 1315 microversion: 2.1 time: 0.164124 Apr 05 12:28:32.706171 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1928/3876] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:32 2022] GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:33.326116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-324ecffa-600e-4077-9a9a-ea65d9650a26 req-b8692406-b083-4a29-8029-3503b3ae484a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "751ac6d3-11c2-42c1-adba-efe02799ef35", "name": "network-vif-plugged", "status": "completed", "tag": "702280b5-449d-4911-9ea2-cc02ae072b9f"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:28:33.335118 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-324ecffa-600e-4077-9a9a-ea65d9650a26 req-b8692406-b083-4a29-8029-3503b3ae484a service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:33.335732 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-324ecffa-600e-4077-9a9a-ea65d9650a26 req-b8692406-b083-4a29-8029-3503b3ae484a service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:33.346860 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-324ecffa-600e-4077-9a9a-ea65d9650a26 req-b8692406-b083-4a29-8029-3503b3ae484a service nova] Creating event network-vif-plugged:702280b5-449d-4911-9ea2-cc02ae072b9f for instance 751ac6d3-11c2-42c1-adba-efe02799ef35 on hv-cinder-82956 Apr 05 12:28:33.352033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-324ecffa-600e-4077-9a9a-ea65d9650a26 req-b8692406-b083-4a29-8029-3503b3ae484a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029570 Apr 05 12:28:33.352743 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1949/3877] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:28:33.725932 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6ea52709-b98d-42a7-b222-cb4f4d14d59a tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:33.726680 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6ea52709-b98d-42a7-b222-cb4f4d14d59a tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] [instance: 751ac6d3-11c2-42c1-adba-efe02799ef35] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:33.735428 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6ea52709-b98d-42a7-b222-cb4f4d14d59a tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:33.736451 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6ea52709-b98d-42a7-b222-cb4f4d14d59a tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:33.737464 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6ea52709-b98d-42a7-b222-cb4f4d14d59a tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:33.738041 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6ea52709-b98d-42a7-b222-cb4f4d14d59a tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:33.880717 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6ea52709-b98d-42a7-b222-cb4f4d14d59a tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26f221288b749d89fb4a6984a07260e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444cd304b2940b79a1876e330198910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:33.888560 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6ea52709-b98d-42a7-b222-cb4f4d14d59a tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] 10.222.0.61 "GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35" status: 200 len: 1315 microversion: 2.1 time: 0.168258 Apr 05 12:28:33.889131 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1929/3878] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:33 2022] GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:34.911612 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ddfef4ab-d6cf-4bd2-9ccc-f507a7be2ff4 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:34.912662 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ddfef4ab-d6cf-4bd2-9ccc-f507a7be2ff4 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] [instance: 751ac6d3-11c2-42c1-adba-efe02799ef35] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:34.924232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ddfef4ab-d6cf-4bd2-9ccc-f507a7be2ff4 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:34.924955 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ddfef4ab-d6cf-4bd2-9ccc-f507a7be2ff4 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:34.925733 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ddfef4ab-d6cf-4bd2-9ccc-f507a7be2ff4 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:34.926169 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ddfef4ab-d6cf-4bd2-9ccc-f507a7be2ff4 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:35.055109 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ddfef4ab-d6cf-4bd2-9ccc-f507a7be2ff4 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26f221288b749d89fb4a6984a07260e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444cd304b2940b79a1876e330198910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:35.062419 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ddfef4ab-d6cf-4bd2-9ccc-f507a7be2ff4 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] 10.222.0.61 "GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35" status: 200 len: 1315 microversion: 2.1 time: 0.158873 Apr 05 12:28:35.063025 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1950/3879] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:34 2022] GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:36.080530 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c2b87345-7091-4a5c-861f-89f1054dcf2a tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:36.081248 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c2b87345-7091-4a5c-861f-89f1054dcf2a tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] [instance: 751ac6d3-11c2-42c1-adba-efe02799ef35] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:36.087580 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c2b87345-7091-4a5c-861f-89f1054dcf2a tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:36.088026 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c2b87345-7091-4a5c-861f-89f1054dcf2a tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:36.088825 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c2b87345-7091-4a5c-861f-89f1054dcf2a tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:36.089259 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c2b87345-7091-4a5c-861f-89f1054dcf2a tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:36.229407 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c2b87345-7091-4a5c-861f-89f1054dcf2a tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26f221288b749d89fb4a6984a07260e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444cd304b2940b79a1876e330198910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:36.237734 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c2b87345-7091-4a5c-861f-89f1054dcf2a tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] 10.222.0.61 "GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35" status: 200 len: 1464 microversion: 2.1 time: 0.161433 Apr 05 12:28:36.238623 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1930/3880] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:36 2022] GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35 => generated 1464 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:36.313372 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-57d9c512-70e6-48c8-b19a-73b174b7493e tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:36.313874 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-57d9c512-70e6-48c8-b19a-73b174b7493e tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] [instance: 751ac6d3-11c2-42c1-adba-efe02799ef35] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:36.321355 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-57d9c512-70e6-48c8-b19a-73b174b7493e tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:36.321914 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-57d9c512-70e6-48c8-b19a-73b174b7493e tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:36.322881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-57d9c512-70e6-48c8-b19a-73b174b7493e tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:36.323445 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-57d9c512-70e6-48c8-b19a-73b174b7493e tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:36.350336 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-57d9c512-70e6-48c8-b19a-73b174b7493e tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] [instance: 751ac6d3-11c2-42c1-adba-efe02799ef35] Going to try to terminate instance {{(pid=123358) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 12:28:36.431108 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-57d9c512-70e6-48c8-b19a-73b174b7493e tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] 10.222.0.61 "DELETE /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35" status: 204 len: 0 microversion: 2.1 time: 0.121950 Apr 05 12:28:36.431885 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1951/3881] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 12:28:36 2022] DELETE /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:28:36.440035 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1bd36e47-579e-4948-aaa7-993b54de5728 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:36.440812 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1bd36e47-579e-4948-aaa7-993b54de5728 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] [instance: 751ac6d3-11c2-42c1-adba-efe02799ef35] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:36.448929 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1bd36e47-579e-4948-aaa7-993b54de5728 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:36.449376 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1bd36e47-579e-4948-aaa7-993b54de5728 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:36.450153 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1bd36e47-579e-4948-aaa7-993b54de5728 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:36.450723 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1bd36e47-579e-4948-aaa7-993b54de5728 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:36.580707 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1bd36e47-579e-4948-aaa7-993b54de5728 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26f221288b749d89fb4a6984a07260e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444cd304b2940b79a1876e330198910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:36.588550 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1bd36e47-579e-4948-aaa7-993b54de5728 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] 10.222.0.61 "GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35" status: 200 len: 1470 microversion: 2.1 time: 0.152561 Apr 05 12:28:36.589164 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1931/3882] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:36 2022] GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:37.609564 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-968cabad-d902-404b-a52a-c716ae328dbd tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:37.610222 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-968cabad-d902-404b-a52a-c716ae328dbd tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] [instance: 751ac6d3-11c2-42c1-adba-efe02799ef35] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:37.617176 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-968cabad-d902-404b-a52a-c716ae328dbd tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:37.617619 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-968cabad-d902-404b-a52a-c716ae328dbd tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:37.618402 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-968cabad-d902-404b-a52a-c716ae328dbd tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:37.618823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-968cabad-d902-404b-a52a-c716ae328dbd tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:37.756307 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-968cabad-d902-404b-a52a-c716ae328dbd tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26f221288b749d89fb4a6984a07260e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444cd304b2940b79a1876e330198910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:37.764285 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-968cabad-d902-404b-a52a-c716ae328dbd tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] 10.222.0.61 "GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35" status: 200 len: 1470 microversion: 2.1 time: 0.159031 Apr 05 12:28:37.764859 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1952/3883] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:37 2022] GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35 => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:38.431379 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-8b3cef4e-9e9b-4b60-a0ff-42bdcad4f699 req-393ec989-3742-49df-bcc3-ad06025d3b1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "751ac6d3-11c2-42c1-adba-efe02799ef35", "name": "network-vif-deleted", "tag": "702280b5-449d-4911-9ea2-cc02ae072b9f"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:28:38.447756 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-8b3cef4e-9e9b-4b60-a0ff-42bdcad4f699 req-393ec989-3742-49df-bcc3-ad06025d3b1c service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:38.448480 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-8b3cef4e-9e9b-4b60-a0ff-42bdcad4f699 req-393ec989-3742-49df-bcc3-ad06025d3b1c service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:38.469523 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-8b3cef4e-9e9b-4b60-a0ff-42bdcad4f699 req-393ec989-3742-49df-bcc3-ad06025d3b1c service nova] Creating event network-vif-deleted:702280b5-449d-4911-9ea2-cc02ae072b9f for instance 751ac6d3-11c2-42c1-adba-efe02799ef35 on hv-cinder-82956 Apr 05 12:28:38.475846 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-8b3cef4e-9e9b-4b60-a0ff-42bdcad4f699 req-393ec989-3742-49df-bcc3-ad06025d3b1c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047722 Apr 05 12:28:38.477400 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1932/3884] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:28:38.787725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b6103977-4c46-4aba-9b31-e13e44e98866 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:38.788724 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b6103977-4c46-4aba-9b31-e13e44e98866 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] [instance: 751ac6d3-11c2-42c1-adba-efe02799ef35] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:38.798657 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6103977-4c46-4aba-9b31-e13e44e98866 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:38.799409 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6103977-4c46-4aba-9b31-e13e44e98866 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:38.800442 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6103977-4c46-4aba-9b31-e13e44e98866 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:38.800886 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6103977-4c46-4aba-9b31-e13e44e98866 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:38.830768 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6103977-4c46-4aba-9b31-e13e44e98866 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:38.831288 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b6103977-4c46-4aba-9b31-e13e44e98866 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:38.831803 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.objects.instance [None req-b6103977-4c46-4aba-9b31-e13e44e98866 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lazy-loading 'fault' on Instance uuid 751ac6d3-11c2-42c1-adba-efe02799ef35 {{(pid=123358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 12:28:38.875309 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b6103977-4c46-4aba-9b31-e13e44e98866 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26f221288b749d89fb4a6984a07260e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444cd304b2940b79a1876e330198910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:28:38.883368 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b6103977-4c46-4aba-9b31-e13e44e98866 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] 10.222.0.61 "GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35" status: 200 len: 1305 microversion: 2.1 time: 0.103113 Apr 05 12:28:38.884052 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1953/3885] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:38 2022] GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35 => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:28:39.906267 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-29fe140f-c0a3-428a-8f0a-54c46b103b29 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:28:39.907401 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-29fe140f-c0a3-428a-8f0a-54c46b103b29 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] [instance: 751ac6d3-11c2-42c1-adba-efe02799ef35] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:28:39.917487 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-29fe140f-c0a3-428a-8f0a-54c46b103b29 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:39.918113 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-29fe140f-c0a3-428a-8f0a-54c46b103b29 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:39.919395 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-29fe140f-c0a3-428a-8f0a-54c46b103b29 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:28:39.920032 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-29fe140f-c0a3-428a-8f0a-54c46b103b29 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:28:39.938860 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-29fe140f-c0a3-428a-8f0a-54c46b103b29 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] HTTP exception thrown: Instance 751ac6d3-11c2-42c1-adba-efe02799ef35 could not be found. Apr 05 12:28:39.939632 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-29fe140f-c0a3-428a-8f0a-54c46b103b29 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] Returning 404 to user: Instance 751ac6d3-11c2-42c1-adba-efe02799ef35 could not be found. {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:28:39.940864 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-29fe140f-c0a3-428a-8f0a-54c46b103b29 tempest-VolumesNegativeTest-1098308165 tempest-VolumesNegativeTest-1098308165-project] 10.222.0.61 "GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35" status: 404 len: 111 microversion: 2.1 time: 0.041308 Apr 05 12:28:39.941440 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1933/3886] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:28:39 2022] GET /compute/v2.1/servers/751ac6d3-11c2-42c1-adba-efe02799ef35 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:29:01.644799 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-32bb49af-ff2e-4d49-ae23-6833b9b6fb0f tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2021695725"}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:29:01.645617 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-32bb49af-ff2e-4d49-ae23-6833b9b6fb0f tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:29:01.654726 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-32bb49af-ff2e-4d49-ae23-6833b9b6fb0f tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:29:01.655173 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-32bb49af-ff2e-4d49-ae23-6833b9b6fb0f tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:29:01.655921 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-32bb49af-ff2e-4d49-ae23-6833b9b6fb0f tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:29:01.656388 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-32bb49af-ff2e-4d49-ae23-6833b9b6fb0f tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:29:01.793086 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.network.security_group_api [None req-32bb49af-ff2e-4d49-ae23-6833b9b6fb0f tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Removing security group 97e93c02-c527-49e7-a9c4-b626c3ba43a3 from port 55c8dfd7-0c47-40c6-800e-d5e2cfe592e1 Apr 05 12:29:02.137164 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-32bb49af-ff2e-4d49-ae23-6833b9b6fb0f tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "POST /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66/action" status: 202 len: 0 microversion: 2.1 time: 0.499007 Apr 05 12:29:02.141494 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1954/3887] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Apr 5 12:29:01 2022] POST /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:29:02.144376 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-c9e18524-ae60-465d-b1ba-4e43d43efd82 req-68a3952d-22b8-49d0-9e47-b8507ebd59a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f6fa79f-c359-456d-aad4-cbd1e1a50d66", "tag": "55c8dfd7-0c47-40c6-800e-d5e2cfe592e1"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:29:02.153558 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-c9e18524-ae60-465d-b1ba-4e43d43efd82 req-68a3952d-22b8-49d0-9e47-b8507ebd59a1 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:29:02.154005 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-c9e18524-ae60-465d-b1ba-4e43d43efd82 req-68a3952d-22b8-49d0-9e47-b8507ebd59a1 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:29:02.173287 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-c9e18524-ae60-465d-b1ba-4e43d43efd82 req-68a3952d-22b8-49d0-9e47-b8507ebd59a1 service nova] Creating event network-changed:55c8dfd7-0c47-40c6-800e-d5e2cfe592e1 for instance 2f6fa79f-c359-456d-aad4-cbd1e1a50d66 on hv-cinder-82956 Apr 05 12:29:02.179393 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-c9e18524-ae60-465d-b1ba-4e43d43efd82 req-68a3952d-22b8-49d0-9e47-b8507ebd59a1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038381 Apr 05 12:29:02.180226 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1934/3888] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:29:03.587152 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e7765834-6841-4322-bd4a-1d5ad15ec710 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:29:03.587663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e7765834-6841-4322-bd4a-1d5ad15ec710 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:29:03.593764 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e7765834-6841-4322-bd4a-1d5ad15ec710 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:29:03.594210 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e7765834-6841-4322-bd4a-1d5ad15ec710 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:29:03.594959 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e7765834-6841-4322-bd4a-1d5ad15ec710 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:29:03.595388 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e7765834-6841-4322-bd4a-1d5ad15ec710 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:29:03.671922 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.objects.instance [None req-e7765834-6841-4322-bd4a-1d5ad15ec710 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lazy-loading 'services' on Instance uuid 2f6fa79f-c359-456d-aad4-cbd1e1a50d66 {{(pid=123358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 12:29:03.745567 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e7765834-6841-4322-bd4a-1d5ad15ec710 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66/os-volume_attachments/10a3ebf4-16b2-40c2-a1f2-5152a78afa2d" status: 202 len: 0 microversion: 2.1 time: 0.162691 Apr 05 12:29:03.746360 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1955/3889] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Apr 5 12:29:03 2022] DELETE /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66/os-volume_attachments/10a3ebf4-16b2-40c2-a1f2-5152a78afa2d => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:29:03.754984 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5b9fb2e9-701f-4abb-9902-b0ff716b47b4 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:29:03.755996 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5b9fb2e9-701f-4abb-9902-b0ff716b47b4 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:29:03.763203 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5b9fb2e9-701f-4abb-9902-b0ff716b47b4 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:29:03.763826 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5b9fb2e9-701f-4abb-9902-b0ff716b47b4 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:29:03.764783 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5b9fb2e9-701f-4abb-9902-b0ff716b47b4 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:29:03.765349 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5b9fb2e9-701f-4abb-9902-b0ff716b47b4 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:29:03.807330 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5b9fb2e9-701f-4abb-9902-b0ff716b47b4 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056516 Apr 05 12:29:03.808676 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1935/3890] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:29:03 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:29:04.196244 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-60b8554b-2100-459b-8abb-5d345ecfbc8c req-e8c094c8-b759-4ed2-821d-b6222ef695cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f6fa79f-c359-456d-aad4-cbd1e1a50d66", "tag": "55c8dfd7-0c47-40c6-800e-d5e2cfe592e1"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:29:04.205044 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-60b8554b-2100-459b-8abb-5d345ecfbc8c req-e8c094c8-b759-4ed2-821d-b6222ef695cc service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:29:04.205567 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-60b8554b-2100-459b-8abb-5d345ecfbc8c req-e8c094c8-b759-4ed2-821d-b6222ef695cc service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:29:04.217344 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-60b8554b-2100-459b-8abb-5d345ecfbc8c req-e8c094c8-b759-4ed2-821d-b6222ef695cc service nova] Creating event network-changed:55c8dfd7-0c47-40c6-800e-d5e2cfe592e1 for instance 2f6fa79f-c359-456d-aad4-cbd1e1a50d66 on hv-cinder-82956 Apr 05 12:29:04.222354 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-60b8554b-2100-459b-8abb-5d345ecfbc8c req-e8c094c8-b759-4ed2-821d-b6222ef695cc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030257 Apr 05 12:29:04.223193 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1956/3891] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:29:04.819874 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-696466d5-f3cd-4c23-9307-5466d09518a5 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:29:04.820805 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-696466d5-f3cd-4c23-9307-5466d09518a5 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:29:04.827428 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-696466d5-f3cd-4c23-9307-5466d09518a5 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:29:04.827806 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-696466d5-f3cd-4c23-9307-5466d09518a5 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:29:04.828585 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-696466d5-f3cd-4c23-9307-5466d09518a5 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:29:04.828981 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-696466d5-f3cd-4c23-9307-5466d09518a5 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:29:04.856323 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-696466d5-f3cd-4c23-9307-5466d09518a5 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040412 Apr 05 12:29:04.856867 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1936/3892] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Apr 5 12:29:04 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 12:29:04.869099 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-72374805-a271-4953-bf35-a2bb4e86cd98 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:29:04.869682 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-72374805-a271-4953-bf35-a2bb4e86cd98 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:29:04.875975 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-72374805-a271-4953-bf35-a2bb4e86cd98 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:29:04.876471 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-72374805-a271-4953-bf35-a2bb4e86cd98 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:29:04.877224 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-72374805-a271-4953-bf35-a2bb4e86cd98 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:29:04.877654 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-72374805-a271-4953-bf35-a2bb4e86cd98 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:29:04.949200 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.wsgi [None req-72374805-a271-4953-bf35-a2bb4e86cd98 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] HTTP exception thrown: Instance 2f6fa79f-c359-456d-aad4-cbd1e1a50d66 is not attached to volume 10a3ebf4-16b2-40c2-a1f2-5152a78afa2d Apr 05 12:29:04.949796 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-72374805-a271-4953-bf35-a2bb4e86cd98 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Returning 404 to user: Instance 2f6fa79f-c359-456d-aad4-cbd1e1a50d66 is not attached to volume 10a3ebf4-16b2-40c2-a1f2-5152a78afa2d {{(pid=123358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:29:04.950649 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-72374805-a271-4953-bf35-a2bb4e86cd98 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66/os-volume_attachments/10a3ebf4-16b2-40c2-a1f2-5152a78afa2d" status: 404 len: 154 microversion: 2.1 time: 0.086569 Apr 05 12:29:04.951203 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1957/3893] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Apr 5 12:29:04 2022] DELETE /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66/os-volume_attachments/10a3ebf4-16b2-40c2-a1f2-5152a78afa2d => generated 154 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:29:06.106378 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-75895630-8396-4722-841b-de4536e86c08 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:29:06.106905 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-75895630-8396-4722-841b-de4536e86c08 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:29:06.113912 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-75895630-8396-4722-841b-de4536e86c08 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:29:06.114365 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-75895630-8396-4722-841b-de4536e86c08 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:29:06.115139 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-75895630-8396-4722-841b-de4536e86c08 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:29:06.115568 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-75895630-8396-4722-841b-de4536e86c08 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:29:06.141333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-75895630-8396-4722-841b-de4536e86c08 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Going to try to terminate instance {{(pid=123357) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 12:29:06.218629 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-75895630-8396-4722-841b-de4536e86c08 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 204 len: 0 microversion: 2.1 time: 0.115925 Apr 05 12:29:06.219495 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1937/3894] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 12:29:06 2022] DELETE /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:29:06.227492 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8799bb1d-c2f9-42aa-a202-39fd5125c223 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:29:06.228131 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8799bb1d-c2f9-42aa-a202-39fd5125c223 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:29:06.234363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8799bb1d-c2f9-42aa-a202-39fd5125c223 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:29:06.234799 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8799bb1d-c2f9-42aa-a202-39fd5125c223 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:29:06.235911 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8799bb1d-c2f9-42aa-a202-39fd5125c223 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:29:06.236375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8799bb1d-c2f9-42aa-a202-39fd5125c223 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:29:06.378657 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8799bb1d-c2f9-42aa-a202-39fd5125c223 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:29:06.386488 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8799bb1d-c2f9-42aa-a202-39fd5125c223 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1555 microversion: 2.1 time: 0.162838 Apr 05 12:29:06.387059 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1958/3895] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:29:06 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:29:07.412789 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-67ad4609-a425-45e1-8851-e5fe823be01f tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:29:07.413948 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-67ad4609-a425-45e1-8851-e5fe823be01f tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:29:07.422004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-67ad4609-a425-45e1-8851-e5fe823be01f tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:29:07.422451 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-67ad4609-a425-45e1-8851-e5fe823be01f tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:29:07.423240 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-67ad4609-a425-45e1-8851-e5fe823be01f tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:29:07.423671 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-67ad4609-a425-45e1-8851-e5fe823be01f tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:29:07.570026 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-67ad4609-a425-45e1-8851-e5fe823be01f tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:29:07.578085 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-67ad4609-a425-45e1-8851-e5fe823be01f tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1555 microversion: 2.1 time: 0.172338 Apr 05 12:29:07.578655 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1938/3896] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:29:07 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:29:08.341057 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-56ab7d73-d08a-4924-920f-262716970be9 req-38bf59a0-cf42-4cb1-a8b5-ba006acad20c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6fa79f-c359-456d-aad4-cbd1e1a50d66", "name": "network-vif-deleted", "tag": "55c8dfd7-0c47-40c6-800e-d5e2cfe592e1"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:29:08.349255 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-56ab7d73-d08a-4924-920f-262716970be9 req-38bf59a0-cf42-4cb1-a8b5-ba006acad20c service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:29:08.349689 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-56ab7d73-d08a-4924-920f-262716970be9 req-38bf59a0-cf42-4cb1-a8b5-ba006acad20c service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:29:08.361809 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-56ab7d73-d08a-4924-920f-262716970be9 req-38bf59a0-cf42-4cb1-a8b5-ba006acad20c service nova] Creating event network-vif-deleted:55c8dfd7-0c47-40c6-800e-d5e2cfe592e1 for instance 2f6fa79f-c359-456d-aad4-cbd1e1a50d66 on hv-cinder-82956 Apr 05 12:29:08.367060 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-56ab7d73-d08a-4924-920f-262716970be9 req-38bf59a0-cf42-4cb1-a8b5-ba006acad20c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029707 Apr 05 12:29:08.367663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1959/3897] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:29:08.599648 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a827f378-f74a-4a98-8f3a-1897bf329375 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:29:08.600605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a827f378-f74a-4a98-8f3a-1897bf329375 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:29:08.611521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a827f378-f74a-4a98-8f3a-1897bf329375 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:29:08.612418 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a827f378-f74a-4a98-8f3a-1897bf329375 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:29:08.613635 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a827f378-f74a-4a98-8f3a-1897bf329375 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:29:08.614337 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a827f378-f74a-4a98-8f3a-1897bf329375 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:29:08.648044 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a827f378-f74a-4a98-8f3a-1897bf329375 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:29:08.648506 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a827f378-f74a-4a98-8f3a-1897bf329375 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:29:08.648976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.objects.instance [None req-a827f378-f74a-4a98-8f3a-1897bf329375 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lazy-loading 'fault' on Instance uuid 2f6fa79f-c359-456d-aad4-cbd1e1a50d66 {{(pid=123357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 12:29:08.692585 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a827f378-f74a-4a98-8f3a-1897bf329375 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfacec410f7479ea4c67de6dd530bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec1a4f50e74ff5929d5ca1b5244926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:29:08.701029 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a827f378-f74a-4a98-8f3a-1897bf329375 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 200 len: 1349 microversion: 2.1 time: 0.107902 Apr 05 12:29:08.701651 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1939/3898] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:29:08 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 1349 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:29:09.724634 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-efefa3ae-53a7-4a6d-8930-4801fcca8428 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:29:09.725834 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-efefa3ae-53a7-4a6d-8930-4801fcca8428 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] [instance: 2f6fa79f-c359-456d-aad4-cbd1e1a50d66] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:29:09.734033 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-efefa3ae-53a7-4a6d-8930-4801fcca8428 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:29:09.734542 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-efefa3ae-53a7-4a6d-8930-4801fcca8428 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:29:09.735661 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-efefa3ae-53a7-4a6d-8930-4801fcca8428 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:29:09.736230 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-efefa3ae-53a7-4a6d-8930-4801fcca8428 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:29:09.749600 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.wsgi [None req-efefa3ae-53a7-4a6d-8930-4801fcca8428 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] HTTP exception thrown: Instance 2f6fa79f-c359-456d-aad4-cbd1e1a50d66 could not be found. Apr 05 12:29:09.750193 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-efefa3ae-53a7-4a6d-8930-4801fcca8428 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Returning 404 to user: Instance 2f6fa79f-c359-456d-aad4-cbd1e1a50d66 could not be found. {{(pid=123358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:29:09.751136 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-efefa3ae-53a7-4a6d-8930-4801fcca8428 tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66" status: 404 len: 111 microversion: 2.1 time: 0.034506 Apr 05 12:29:09.751685 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1960/3899] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:29:09 2022] GET /compute/v2.1/servers/2f6fa79f-c359-456d-aad4-cbd1e1a50d66 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:29:09.760097 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c0213366-8a4e-4d0a-8d39-d1cac5e2e43c tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] Calling method '.version_select at 0x7f16200e2a60>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:29:09.780548 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c0213366-8a4e-4d0a-8d39-d1cac5e2e43c tempest-TestMinimumBasicScenario-193826777 tempest-TestMinimumBasicScenario-193826777-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1735914795" status: 202 len: 0 microversion: 2.1 time: 0.024209 Apr 05 12:29:09.785223 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1940/3900] 10.222.0.61 () {58 vars in 1271 bytes} [Tue Apr 5 12:29:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1735914795 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:30:18.796030 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ac884bef-01fd-437d-b7bb-d47daf2af501 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:18.796979 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ac884bef-01fd-437d-b7bb-d47daf2af501 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:30:18.803680 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ac884bef-01fd-437d-b7bb-d47daf2af501 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:18.804167 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ac884bef-01fd-437d-b7bb-d47daf2af501 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:18.804926 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ac884bef-01fd-437d-b7bb-d47daf2af501 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:18.805366 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ac884bef-01fd-437d-b7bb-d47daf2af501 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:18.831543 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ac884bef-01fd-437d-b7bb-d47daf2af501 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] Going to try to terminate instance {{(pid=123358) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 12:30:18.910668 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ac884bef-01fd-437d-b7bb-d47daf2af501 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "DELETE /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c" status: 204 len: 0 microversion: 2.1 time: 0.122781 Apr 05 12:30:18.911484 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1961/3901] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 12:30:18 2022] DELETE /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:30:18.921674 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-15135501-7fb6-4d72-81d1-ae9d7e9593b5 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:18.922608 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-15135501-7fb6-4d72-81d1-ae9d7e9593b5 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:30:18.929249 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-15135501-7fb6-4d72-81d1-ae9d7e9593b5 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:18.929769 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-15135501-7fb6-4d72-81d1-ae9d7e9593b5 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:18.930611 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-15135501-7fb6-4d72-81d1-ae9d7e9593b5 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:18.931045 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-15135501-7fb6-4d72-81d1-ae9d7e9593b5 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:19.068590 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-15135501-7fb6-4d72-81d1-ae9d7e9593b5 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:30:19.075977 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-15135501-7fb6-4d72-81d1-ae9d7e9593b5 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c" status: 200 len: 1578 microversion: 2.1 time: 0.159972 Apr 05 12:30:19.076559 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1941/3902] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:30:18 2022] GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:30:20.098794 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4eb12f26-4620-4386-ab30-8b34fb191739 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:20.099782 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4eb12f26-4620-4386-ab30-8b34fb191739 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:30:20.110989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4eb12f26-4620-4386-ab30-8b34fb191739 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:20.111676 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4eb12f26-4620-4386-ab30-8b34fb191739 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:20.112993 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4eb12f26-4620-4386-ab30-8b34fb191739 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:20.113716 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4eb12f26-4620-4386-ab30-8b34fb191739 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:20.263235 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4eb12f26-4620-4386-ab30-8b34fb191739 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:30:20.270844 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4eb12f26-4620-4386-ab30-8b34fb191739 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c" status: 200 len: 1578 microversion: 2.1 time: 0.179503 Apr 05 12:30:20.271417 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1962/3903] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:30:20 2022] GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c => generated 1578 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:30:21.288664 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5f3a696e-5ecf-4095-a57a-350e7eca43a9 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:21.289289 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5f3a696e-5ecf-4095-a57a-350e7eca43a9 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:30:21.296219 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5f3a696e-5ecf-4095-a57a-350e7eca43a9 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:21.296692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5f3a696e-5ecf-4095-a57a-350e7eca43a9 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:21.297544 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5f3a696e-5ecf-4095-a57a-350e7eca43a9 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:21.297940 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5f3a696e-5ecf-4095-a57a-350e7eca43a9 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:21.339658 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-00b6fb32-1849-4eed-83a2-64575cacb99d req-882937ea-a658-4c6b-b18e-7aa3d20ae717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73459d0a-9074-4cc4-b60c-5d775163d68c", "name": "network-vif-deleted", "tag": "b580678a-6fac-4cf2-80a9-30cabaf7530a"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:30:21.348688 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-00b6fb32-1849-4eed-83a2-64575cacb99d req-882937ea-a658-4c6b-b18e-7aa3d20ae717 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:21.349288 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-00b6fb32-1849-4eed-83a2-64575cacb99d req-882937ea-a658-4c6b-b18e-7aa3d20ae717 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:21.376220 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-00b6fb32-1849-4eed-83a2-64575cacb99d req-882937ea-a658-4c6b-b18e-7aa3d20ae717 service nova] Creating event network-vif-deleted:b580678a-6fac-4cf2-80a9-30cabaf7530a for instance 73459d0a-9074-4cc4-b60c-5d775163d68c on hv-cinder-82956 Apr 05 12:30:21.376970 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5f3a696e-5ecf-4095-a57a-350e7eca43a9 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:30:21.386276 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5f3a696e-5ecf-4095-a57a-350e7eca43a9 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c" status: 200 len: 1510 microversion: 2.1 time: 0.101042 Apr 05 12:30:21.387338 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1942/3904] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:30:21 2022] GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c => generated 1510 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:30:21.393153 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-00b6fb32-1849-4eed-83a2-64575cacb99d req-882937ea-a658-4c6b-b18e-7aa3d20ae717 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052209 Apr 05 12:30:21.394175 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1963/3905] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:30:22.402989 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d524bc99-77f8-4cb1-9619-c7e4bd723831 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:22.403595 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-d524bc99-77f8-4cb1-9619-c7e4bd723831 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:30:22.409934 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d524bc99-77f8-4cb1-9619-c7e4bd723831 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:22.410414 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d524bc99-77f8-4cb1-9619-c7e4bd723831 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:22.411159 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d524bc99-77f8-4cb1-9619-c7e4bd723831 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:22.412357 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-d524bc99-77f8-4cb1-9619-c7e4bd723831 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:22.425654 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-d524bc99-77f8-4cb1-9619-c7e4bd723831 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] HTTP exception thrown: Instance 73459d0a-9074-4cc4-b60c-5d775163d68c could not be found. Apr 05 12:30:22.426228 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d524bc99-77f8-4cb1-9619-c7e4bd723831 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Returning 404 to user: Instance 73459d0a-9074-4cc4-b60c-5d775163d68c could not be found. {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:30:22.427047 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d524bc99-77f8-4cb1-9619-c7e4bd723831 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c" status: 404 len: 111 microversion: 2.1 time: 0.027982 Apr 05 12:30:22.427589 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1943/3906] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:30:22 2022] GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:30:22.526124 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1b803283-fae1-459a-84a3-3d2f1c9a5ee7 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1700995556", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-800585948", "security_groups": [{"name": "tempest-secgroup-smoke-1198763209"}], "block_device_mapping_v2": [{"uuid": "c81bdd52-a070-4b29-996d-f7d7b2403084", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "356d48a5-4799-4934-9c4e-ecbb87dec2b3"}]}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:30:22.636734 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.network.neutron [None req-1b803283-fae1-459a-84a3-3d2f1c9a5ee7 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] validate_networks() for [('356d48a5-4799-4934-9c4e-ecbb87dec2b3', None, None, None, None, None)] {{(pid=123358) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 12:30:23.123621 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-1b803283-fae1-459a-84a3-3d2f1c9a5ee7 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Flavor limits 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 12:30:23.124047 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-1b803283-fae1-459a-84a3-3d2f1c9a5ee7 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Image limits 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:30:23.124571 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-1b803283-fae1-459a-84a3-3d2f1c9a5ee7 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Flavor pref 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 12:30:23.124969 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-1b803283-fae1-459a-84a3-3d2f1c9a5ee7 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Image pref 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:30:23.125417 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-1b803283-fae1-459a-84a3-3d2f1c9a5ee7 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 12:30:23.134909 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1b803283-fae1-459a-84a3-3d2f1c9a5ee7 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:23.135349 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1b803283-fae1-459a-84a3-3d2f1c9a5ee7 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:23.136144 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1b803283-fae1-459a-84a3-3d2f1c9a5ee7 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:23.136596 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1b803283-fae1-459a-84a3-3d2f1c9a5ee7 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:23.153061 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-1b803283-fae1-459a-84a3-3d2f1c9a5ee7 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Getting quotas for project ff211be298de4a89afdcf4b57bdbc6bb. Resources: {'ram', 'instances', 'cores'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 12:30:23.157366 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-1b803283-fae1-459a-84a3-3d2f1c9a5ee7 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Getting quotas for user d4c19b3319804327be025ce4ae75279e and project ff211be298de4a89afdcf4b57bdbc6bb. Resources: {'ram', 'instances', 'cores'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 12:30:23.216893 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1b803283-fae1-459a-84a3-3d2f1c9a5ee7 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Going to run 1 instances... {{(pid=123358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 12:30:23.219948 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1b803283-fae1-459a-84a3-3d2f1c9a5ee7 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: a03ec7e6-4c14-4cac-ab24-61cfc2133cb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c81bdd52-a070-4b29-996d-f7d7b2403084',volume_size=None,volume_type=None)] {{(pid=123358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 12:30:23.350561 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1b803283-fae1-459a-84a3-3d2f1c9a5ee7 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.828957 Apr 05 12:30:23.351196 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1964/3907] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Apr 5 12:30:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 12:30:23.361595 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-9df59598-29f6-4c20-a6a1-bd7e38d17e5c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:23.362229 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-9df59598-29f6-4c20-a6a1-bd7e38d17e5c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: a03ec7e6-4c14-4cac-ab24-61cfc2133cb3] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:30:23.415648 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-9df59598-29f6-4c20-a6a1-bd7e38d17e5c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:30:23.422862 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-9df59598-29f6-4c20-a6a1-bd7e38d17e5c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3" status: 200 len: 1094 microversion: 2.1 time: 0.065393 Apr 05 12:30:23.423418 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1944/3908] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:30:23 2022] GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:30:23.700403 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1e294be4-7972-4346-907e-ab2facf88f0d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:23.700917 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1e294be4-7972-4346-907e-ab2facf88f0d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 64db0811-1092-48cb-b6aa-9018da662bfc] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:30:23.709352 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1e294be4-7972-4346-907e-ab2facf88f0d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:23.709853 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1e294be4-7972-4346-907e-ab2facf88f0d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:23.710619 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1e294be4-7972-4346-907e-ab2facf88f0d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:23.716149 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1e294be4-7972-4346-907e-ab2facf88f0d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:23.727329 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.wsgi [None req-1e294be4-7972-4346-907e-ab2facf88f0d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] HTTP exception thrown: Instance 64db0811-1092-48cb-b6aa-9018da662bfc could not be found. Apr 05 12:30:23.727920 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1e294be4-7972-4346-907e-ab2facf88f0d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Returning 404 to user: Instance 64db0811-1092-48cb-b6aa-9018da662bfc could not be found. {{(pid=123358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:30:23.728778 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1e294be4-7972-4346-907e-ab2facf88f0d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "DELETE /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc" status: 404 len: 111 microversion: 2.20 time: 0.032624 Apr 05 12:30:23.729336 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1965/3909] 10.222.0.61 () {60 vars in 1279 bytes} [Tue Apr 5 12:30:23 2022] DELETE /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 05 12:30:23.738897 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fbef0200-428e-423b-92e1-d7deecafd9a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:23.739502 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fbef0200-428e-423b-92e1-d7deecafd9a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 64db0811-1092-48cb-b6aa-9018da662bfc] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:30:23.747373 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fbef0200-428e-423b-92e1-d7deecafd9a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:23.748027 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fbef0200-428e-423b-92e1-d7deecafd9a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:23.748836 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fbef0200-428e-423b-92e1-d7deecafd9a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:23.749254 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fbef0200-428e-423b-92e1-d7deecafd9a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:23.763686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-fbef0200-428e-423b-92e1-d7deecafd9a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] HTTP exception thrown: Instance 64db0811-1092-48cb-b6aa-9018da662bfc could not be found. Apr 05 12:30:23.764319 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fbef0200-428e-423b-92e1-d7deecafd9a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Returning 404 to user: Instance 64db0811-1092-48cb-b6aa-9018da662bfc could not be found. {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:30:23.765148 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fbef0200-428e-423b-92e1-d7deecafd9a3 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc" status: 404 len: 111 microversion: 2.20 time: 0.030593 Apr 05 12:30:23.765921 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1945/3910] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:30:23 2022] GET /compute/v2.1/servers/64db0811-1092-48cb-b6aa-9018da662bfc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 05 12:30:24.443519 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-114c9ea4-bfde-4d6f-ba71-e46d742588f2 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:24.444387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-114c9ea4-bfde-4d6f-ba71-e46d742588f2 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: a03ec7e6-4c14-4cac-ab24-61cfc2133cb3] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:30:24.450635 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-114c9ea4-bfde-4d6f-ba71-e46d742588f2 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:24.451197 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-114c9ea4-bfde-4d6f-ba71-e46d742588f2 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:24.452067 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-114c9ea4-bfde-4d6f-ba71-e46d742588f2 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:24.452907 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-114c9ea4-bfde-4d6f-ba71-e46d742588f2 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:24.512630 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-114c9ea4-bfde-4d6f-ba71-e46d742588f2 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:30:24.519982 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-114c9ea4-bfde-4d6f-ba71-e46d742588f2 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3" status: 200 len: 1210 microversion: 2.1 time: 0.084703 Apr 05 12:30:24.520822 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1966/3911] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:30:24 2022] GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:30:24.904696 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-12ca91a8-5c05-4d7c-bb1a-a3e51c1c864d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:24.905206 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-12ca91a8-5c05-4d7c-bb1a-a3e51c1c864d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:30:24.911770 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-12ca91a8-5c05-4d7c-bb1a-a3e51c1c864d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:24.911770 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-12ca91a8-5c05-4d7c-bb1a-a3e51c1c864d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:24.912571 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-12ca91a8-5c05-4d7c-bb1a-a3e51c1c864d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:24.913118 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-12ca91a8-5c05-4d7c-bb1a-a3e51c1c864d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:24.931645 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-12ca91a8-5c05-4d7c-bb1a-a3e51c1c864d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] HTTP exception thrown: Instance 98a3437c-94c0-4133-a629-9386b4639a2d could not be found. Apr 05 12:30:24.932534 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-12ca91a8-5c05-4d7c-bb1a-a3e51c1c864d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Returning 404 to user: Instance 98a3437c-94c0-4133-a629-9386b4639a2d could not be found. {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:30:24.933469 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-12ca91a8-5c05-4d7c-bb1a-a3e51c1c864d tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "DELETE /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 404 len: 111 microversion: 2.20 time: 0.032692 Apr 05 12:30:24.934234 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1946/3912] 10.222.0.61 () {60 vars in 1279 bytes} [Tue Apr 5 12:30:24 2022] DELETE /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 05 12:30:24.942903 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-65642478-4d56-4e73-85bf-2ce91e813989 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:24.943425 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-65642478-4d56-4e73-85bf-2ce91e813989 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] [instance: 98a3437c-94c0-4133-a629-9386b4639a2d] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:30:24.949419 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-65642478-4d56-4e73-85bf-2ce91e813989 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:24.950116 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-65642478-4d56-4e73-85bf-2ce91e813989 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:24.950884 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-65642478-4d56-4e73-85bf-2ce91e813989 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:24.951318 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-65642478-4d56-4e73-85bf-2ce91e813989 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:24.965616 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.wsgi [None req-65642478-4d56-4e73-85bf-2ce91e813989 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] HTTP exception thrown: Instance 98a3437c-94c0-4133-a629-9386b4639a2d could not be found. Apr 05 12:30:24.965983 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-65642478-4d56-4e73-85bf-2ce91e813989 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] Returning 404 to user: Instance 98a3437c-94c0-4133-a629-9386b4639a2d could not be found. {{(pid=123358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:30:24.966822 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-65642478-4d56-4e73-85bf-2ce91e813989 tempest-AttachVolumeShelveTestJSON-1195787764 tempest-AttachVolumeShelveTestJSON-1195787764-project] 10.222.0.61 "GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d" status: 404 len: 111 microversion: 2.20 time: 0.028541 Apr 05 12:30:24.967381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1967/3913] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Apr 5 12:30:24 2022] GET /compute/v2.1/servers/98a3437c-94c0-4133-a629-9386b4639a2d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 05 12:30:25.537516 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-62eb92f3-6a17-4000-b3f2-93aa9b4b3c3b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:25.538552 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-62eb92f3-6a17-4000-b3f2-93aa9b4b3c3b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: a03ec7e6-4c14-4cac-ab24-61cfc2133cb3] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:30:25.545011 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-62eb92f3-6a17-4000-b3f2-93aa9b4b3c3b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:25.545797 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-62eb92f3-6a17-4000-b3f2-93aa9b4b3c3b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:25.546818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-62eb92f3-6a17-4000-b3f2-93aa9b4b3c3b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:25.547443 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-62eb92f3-6a17-4000-b3f2-93aa9b4b3c3b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:25.647619 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-35012b7a-3551-4678-bbce-5b428f34c77d req-60e04ea6-b255-4a61-bf70-4d66221ed1fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a03ec7e6-4c14-4cac-ab24-61cfc2133cb3", "tag": "1b5e9d60-f8ba-4088-b208-5e663b8d9f10"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:30:25.668846 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-35012b7a-3551-4678-bbce-5b428f34c77d req-60e04ea6-b255-4a61-bf70-4d66221ed1fa service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:25.669542 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-35012b7a-3551-4678-bbce-5b428f34c77d req-60e04ea6-b255-4a61-bf70-4d66221ed1fa service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:25.691579 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-35012b7a-3551-4678-bbce-5b428f34c77d req-60e04ea6-b255-4a61-bf70-4d66221ed1fa service nova] Creating event network-changed:1b5e9d60-f8ba-4088-b208-5e663b8d9f10 for instance a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 on hv-cinder-82956 Apr 05 12:30:25.697666 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-35012b7a-3551-4678-bbce-5b428f34c77d req-60e04ea6-b255-4a61-bf70-4d66221ed1fa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053721 Apr 05 12:30:25.699416 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1968/3914] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:30:25.988536 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-62eb92f3-6a17-4000-b3f2-93aa9b4b3c3b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:30:26.010442 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-62eb92f3-6a17-4000-b3f2-93aa9b4b3c3b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3" status: 200 len: 1266 microversion: 2.1 time: 0.476958 Apr 05 12:30:26.013061 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1947/3915] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:30:25 2022] GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 => generated 1266 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:30:27.032746 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-dc4c780e-10a7-4887-9038-2387b84abeb1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:27.033592 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-dc4c780e-10a7-4887-9038-2387b84abeb1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: a03ec7e6-4c14-4cac-ab24-61cfc2133cb3] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:30:27.043034 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dc4c780e-10a7-4887-9038-2387b84abeb1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:27.043761 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dc4c780e-10a7-4887-9038-2387b84abeb1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:27.044764 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dc4c780e-10a7-4887-9038-2387b84abeb1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:27.045395 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dc4c780e-10a7-4887-9038-2387b84abeb1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:27.197045 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-dc4c780e-10a7-4887-9038-2387b84abeb1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:30:27.204554 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-dc4c780e-10a7-4887-9038-2387b84abeb1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3" status: 200 len: 1266 microversion: 2.1 time: 0.178241 Apr 05 12:30:27.205584 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1969/3916] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:30:27 2022] GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:30:28.223941 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-31c17953-fcd6-4da7-83aa-8d0f839271a1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:28.224960 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-31c17953-fcd6-4da7-83aa-8d0f839271a1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: a03ec7e6-4c14-4cac-ab24-61cfc2133cb3] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:30:28.234663 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-31c17953-fcd6-4da7-83aa-8d0f839271a1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:28.235083 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-31c17953-fcd6-4da7-83aa-8d0f839271a1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:28.236003 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-31c17953-fcd6-4da7-83aa-8d0f839271a1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:28.236328 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-31c17953-fcd6-4da7-83aa-8d0f839271a1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:28.490928 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-31c17953-fcd6-4da7-83aa-8d0f839271a1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:30:28.502093 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-31c17953-fcd6-4da7-83aa-8d0f839271a1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3" status: 200 len: 1266 microversion: 2.1 time: 0.283655 Apr 05 12:30:28.512124 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1948/3917] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:30:28 2022] GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 => generated 1266 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:30:29.518888 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-70ddb4d3-3a24-4e86-aac1-336592d8caf1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:29.519572 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-70ddb4d3-3a24-4e86-aac1-336592d8caf1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: a03ec7e6-4c14-4cac-ab24-61cfc2133cb3] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:30:29.526146 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-70ddb4d3-3a24-4e86-aac1-336592d8caf1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:29.526628 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-70ddb4d3-3a24-4e86-aac1-336592d8caf1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:29.527417 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-70ddb4d3-3a24-4e86-aac1-336592d8caf1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:29.527848 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-70ddb4d3-3a24-4e86-aac1-336592d8caf1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:29.663978 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-70ddb4d3-3a24-4e86-aac1-336592d8caf1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:30:29.671505 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-70ddb4d3-3a24-4e86-aac1-336592d8caf1 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3" status: 200 len: 1266 microversion: 2.1 time: 0.156531 Apr 05 12:30:29.672044 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1970/3918] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:30:29 2022] GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:30:30.692104 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ebad5e36-e23b-4366-9266-643dcba00cfb tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:30.692686 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ebad5e36-e23b-4366-9266-643dcba00cfb tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: a03ec7e6-4c14-4cac-ab24-61cfc2133cb3] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:30:30.699311 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ebad5e36-e23b-4366-9266-643dcba00cfb tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:30.699756 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ebad5e36-e23b-4366-9266-643dcba00cfb tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:30.700551 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ebad5e36-e23b-4366-9266-643dcba00cfb tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:30.700989 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ebad5e36-e23b-4366-9266-643dcba00cfb tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:30.843608 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ebad5e36-e23b-4366-9266-643dcba00cfb tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:30:30.851792 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ebad5e36-e23b-4366-9266-643dcba00cfb tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3" status: 200 len: 1266 microversion: 2.1 time: 0.165650 Apr 05 12:30:30.852387 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1949/3919] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:30:30 2022] GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:30:31.154253 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-dde13161-097b-4f49-ba73-bc130ff5a9fa tempest-VolumesTestJSON-944675638 tempest-VolumesTestJSON-944675638-project] Calling method '.version_select at 0x7f161c33dd30>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:31.203872 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-dde13161-097b-4f49-ba73-bc130ff5a9fa tempest-VolumesTestJSON-944675638 tempest-VolumesTestJSON-944675638-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/a6b7ceb9-13ee-4d7d-8d72-21ef63ff581e" status: 200 len: 350 microversion: 2.1 time: 0.053393 Apr 05 12:30:31.204463 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1971/3920] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Apr 5 12:30:31 2022] GET /compute/v2.1/os-volumes/a6b7ceb9-13ee-4d7d-8d72-21ef63ff581e => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:30:31.871976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-df002dd8-8648-472d-b064-3a0325d25c3b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:31.872867 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-df002dd8-8648-472d-b064-3a0325d25c3b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: a03ec7e6-4c14-4cac-ab24-61cfc2133cb3] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:30:31.882026 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-df002dd8-8648-472d-b064-3a0325d25c3b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:31.882666 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-df002dd8-8648-472d-b064-3a0325d25c3b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:31.883740 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-df002dd8-8648-472d-b064-3a0325d25c3b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:31.884413 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-df002dd8-8648-472d-b064-3a0325d25c3b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:32.024409 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-df002dd8-8648-472d-b064-3a0325d25c3b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:30:32.032261 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-df002dd8-8648-472d-b064-3a0325d25c3b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3" status: 200 len: 1266 microversion: 2.1 time: 0.165902 Apr 05 12:30:32.032857 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1950/3921] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:30:31 2022] GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:30:32.535964 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-914d742f-05fa-4d53-9168-7a19694ec625 tempest-VolumesTestJSON-944675638 tempest-VolumesTestJSON-944675638-project] Calling method '.version_select at 0x7f161c105f70>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:32.582588 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-914d742f-05fa-4d53-9168-7a19694ec625 tempest-VolumesTestJSON-944675638 tempest-VolumesTestJSON-944675638-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b7c7d9c9-ed7e-4c67-8a80-bebff5bcb73c" status: 200 len: 350 microversion: 2.1 time: 0.050899 Apr 05 12:30:32.583314 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1972/3922] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Apr 5 12:30:32 2022] GET /compute/v2.1/os-volumes/b7c7d9c9-ed7e-4c67-8a80-bebff5bcb73c => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:30:33.053735 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-660b0b5f-c76e-4887-9d63-10660dfdfd57 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:33.054583 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-660b0b5f-c76e-4887-9d63-10660dfdfd57 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: a03ec7e6-4c14-4cac-ab24-61cfc2133cb3] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:30:33.066584 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-660b0b5f-c76e-4887-9d63-10660dfdfd57 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:33.067100 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-660b0b5f-c76e-4887-9d63-10660dfdfd57 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:33.068004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-660b0b5f-c76e-4887-9d63-10660dfdfd57 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:33.068530 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-660b0b5f-c76e-4887-9d63-10660dfdfd57 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:33.207959 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-660b0b5f-c76e-4887-9d63-10660dfdfd57 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:30:33.215701 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-660b0b5f-c76e-4887-9d63-10660dfdfd57 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3" status: 200 len: 1266 microversion: 2.1 time: 0.168632 Apr 05 12:30:33.216260 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1951/3923] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:30:33 2022] GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:30:33.899100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-70ac830b-813b-4a2b-9762-adbb716cadf4 tempest-VolumesTestJSON-944675638 tempest-VolumesTestJSON-944675638-project] Calling method '.version_select at 0x7f16202b0310>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:33.946232 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-70ac830b-813b-4a2b-9762-adbb716cadf4 tempest-VolumesTestJSON-944675638 tempest-VolumesTestJSON-944675638-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/439a4832-1895-48bc-8beb-74051f5515f8" status: 200 len: 351 microversion: 2.1 time: 0.052207 Apr 05 12:30:33.946812 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1973/3924] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Apr 5 12:30:33 2022] GET /compute/v2.1/os-volumes/439a4832-1895-48bc-8beb-74051f5515f8 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:30:33.957843 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a74391b5-ea03-416a-b3d0-86af15527b4f tempest-VolumesTestJSON-944675638 tempest-VolumesTestJSON-944675638-project] Calling method '.version_select at 0x7f1620114280>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:34.053567 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a74391b5-ea03-416a-b3d0-86af15527b4f tempest-VolumesTestJSON-944675638 tempest-VolumesTestJSON-944675638-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.099394 Apr 05 12:30:34.054084 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1952/3925] 10.222.0.61 () {58 vars in 1133 bytes} [Tue Apr 5 12:30:33 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:30:34.066283 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-be9c7330-2083-4adf-b727-4470022ec302 tempest-VolumesTestJSON-944675638 tempest-VolumesTestJSON-944675638-project] Calling method '.version_select at 0x7f161c384310>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:34.146285 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-be9c7330-2083-4adf-b727-4470022ec302 tempest-VolumesTestJSON-944675638 tempest-VolumesTestJSON-944675638-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083803 Apr 05 12:30:34.146865 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1974/3926] 10.222.0.61 () {58 vars in 1148 bytes} [Tue Apr 5 12:30:34 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:30:34.158833 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-63f9e928-99b3-42df-82ad-782f31b47f4a tempest-VolumesTestJSON-944675638 tempest-VolumesTestJSON-944675638-project] Calling method '.version_select at 0x7f16200f14c0>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:34.237394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-1912740f-cc96-4859-8b8d-c20968cb8831 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:34.238008 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-1912740f-cc96-4859-8b8d-c20968cb8831 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: a03ec7e6-4c14-4cac-ab24-61cfc2133cb3] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:30:34.238794 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-63f9e928-99b3-42df-82ad-782f31b47f4a tempest-VolumesTestJSON-944675638 tempest-VolumesTestJSON-944675638-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.084057 Apr 05 12:30:34.239395 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1953/3927] 10.222.0.61 () {58 vars in 1133 bytes} [Tue Apr 5 12:30:34 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:30:34.244338 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1912740f-cc96-4859-8b8d-c20968cb8831 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:34.244781 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1912740f-cc96-4859-8b8d-c20968cb8831 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:34.245505 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1912740f-cc96-4859-8b8d-c20968cb8831 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:34.246076 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-1912740f-cc96-4859-8b8d-c20968cb8831 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:34.251498 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8b900518-83de-43f3-85dc-9c72ba9fa5d3 tempest-VolumesTestJSON-944675638 tempest-VolumesTestJSON-944675638-project] Calling method '.version_select at 0x7f16200f1820>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:34.332153 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8b900518-83de-43f3-85dc-9c72ba9fa5d3 tempest-VolumesTestJSON-944675638 tempest-VolumesTestJSON-944675638-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084760 Apr 05 12:30:34.332731 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1954/3928] 10.222.0.61 () {58 vars in 1166 bytes} [Tue Apr 5 12:30:34 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:30:34.343884 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c1d677ad-0c08-43bd-bd3d-0c67a75ab3a3 tempest-VolumesTestJSON-944675638 tempest-VolumesTestJSON-944675638-project] Calling method '.version_select at 0x7f1620114430>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:34.379666 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-1912740f-cc96-4859-8b8d-c20968cb8831 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:30:34.387083 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-1912740f-cc96-4859-8b8d-c20968cb8831 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3" status: 200 len: 1266 microversion: 2.1 time: 0.154221 Apr 05 12:30:34.387662 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1975/3929] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:30:34 2022] GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:30:34.603469 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c1d677ad-0c08-43bd-bd3d-0c67a75ab3a3 tempest-VolumesTestJSON-944675638 tempest-VolumesTestJSON-944675638-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.263167 Apr 05 12:30:34.604060 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1955/3930] 10.222.0.61 () {58 vars in 1169 bytes} [Tue Apr 5 12:30:34 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:30:34.616668 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-896ba7da-22db-45d2-b1ca-286cdead5437 tempest-VolumesTestJSON-944675638 tempest-VolumesTestJSON-944675638-project] Calling method '.version_select at 0x7f161c33da60>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:34.699994 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-896ba7da-22db-45d2-b1ca-286cdead5437 tempest-VolumesTestJSON-944675638 tempest-VolumesTestJSON-944675638-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087047 Apr 05 12:30:34.700606 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1976/3931] 10.222.0.61 () {58 vars in 1154 bytes} [Tue Apr 5 12:30:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:30:34.715484 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8fb8b71d-b03b-4865-8db3-0e7e04770b90 tempest-VolumesTestJSON-944675638 tempest-VolumesTestJSON-944675638-project] Calling method '.version_select at 0x7f161c193430>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:34.798603 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8fb8b71d-b03b-4865-8db3-0e7e04770b90 tempest-VolumesTestJSON-944675638 tempest-VolumesTestJSON-944675638-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086500 Apr 05 12:30:34.799548 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1956/3932] 10.222.0.61 () {58 vars in 1187 bytes} [Tue Apr 5 12:30:34 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:30:34.811317 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-cfed803a-c89e-45ef-a576-5cc794b0e839 tempest-VolumesTestJSON-944675638 tempest-VolumesTestJSON-944675638-project] Calling method '.version_select at 0x7f161c0f11f0>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:34.902412 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-cfed803a-c89e-45ef-a576-5cc794b0e839 tempest-VolumesTestJSON-944675638 tempest-VolumesTestJSON-944675638-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.094446 Apr 05 12:30:34.903261 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1977/3933] 10.222.0.61 () {58 vars in 1154 bytes} [Tue Apr 5 12:30:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:30:35.408724 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-926b9a32-24d5-4b11-bbdf-40f368c7f1cd tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:35.409687 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-926b9a32-24d5-4b11-bbdf-40f368c7f1cd tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: a03ec7e6-4c14-4cac-ab24-61cfc2133cb3] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:30:35.416646 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-926b9a32-24d5-4b11-bbdf-40f368c7f1cd tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:35.417112 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-926b9a32-24d5-4b11-bbdf-40f368c7f1cd tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:35.417867 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-926b9a32-24d5-4b11-bbdf-40f368c7f1cd tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:35.418295 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-926b9a32-24d5-4b11-bbdf-40f368c7f1cd tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:35.556426 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-926b9a32-24d5-4b11-bbdf-40f368c7f1cd tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:30:35.564208 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-926b9a32-24d5-4b11-bbdf-40f368c7f1cd tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3" status: 200 len: 1266 microversion: 2.1 time: 0.162642 Apr 05 12:30:35.564769 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1957/3934] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:30:35 2022] GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:30:35.877006 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-a9023acb-d555-411f-9c7e-50259d0cf5ff req-e841378b-12a2-4a85-9b2d-af23eb095d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a03ec7e6-4c14-4cac-ab24-61cfc2133cb3", "name": "network-vif-plugged", "status": "completed", "tag": "1b5e9d60-f8ba-4088-b208-5e663b8d9f10"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:30:35.885420 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-a9023acb-d555-411f-9c7e-50259d0cf5ff req-e841378b-12a2-4a85-9b2d-af23eb095d82 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:35.885850 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-a9023acb-d555-411f-9c7e-50259d0cf5ff req-e841378b-12a2-4a85-9b2d-af23eb095d82 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:35.896858 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-a9023acb-d555-411f-9c7e-50259d0cf5ff req-e841378b-12a2-4a85-9b2d-af23eb095d82 service nova] Creating event network-vif-plugged:1b5e9d60-f8ba-4088-b208-5e663b8d9f10 for instance a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 on hv-cinder-82956 Apr 05 12:30:35.901819 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-a9023acb-d555-411f-9c7e-50259d0cf5ff req-e841378b-12a2-4a85-9b2d-af23eb095d82 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028603 Apr 05 12:30:35.902395 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1978/3935] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:30:36.581359 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-5d0465da-e7c8-4906-9111-b1ece40279e6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:36.581980 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-5d0465da-e7c8-4906-9111-b1ece40279e6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: a03ec7e6-4c14-4cac-ab24-61cfc2133cb3] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:30:36.588677 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d0465da-e7c8-4906-9111-b1ece40279e6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:36.589074 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d0465da-e7c8-4906-9111-b1ece40279e6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:36.589958 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d0465da-e7c8-4906-9111-b1ece40279e6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:36.590507 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-5d0465da-e7c8-4906-9111-b1ece40279e6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:36.750692 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-5d0465da-e7c8-4906-9111-b1ece40279e6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:30:36.758462 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-5d0465da-e7c8-4906-9111-b1ece40279e6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3" status: 200 len: 1266 microversion: 2.1 time: 0.181124 Apr 05 12:30:36.759028 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1958/3936] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:30:36 2022] GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:30:37.781212 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-7295a6d3-5185-4227-8588-f0cec3828ef4 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:37.782212 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-7295a6d3-5185-4227-8588-f0cec3828ef4 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: a03ec7e6-4c14-4cac-ab24-61cfc2133cb3] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:30:37.792776 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7295a6d3-5185-4227-8588-f0cec3828ef4 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:37.793508 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7295a6d3-5185-4227-8588-f0cec3828ef4 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:37.794744 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7295a6d3-5185-4227-8588-f0cec3828ef4 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:37.795450 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-7295a6d3-5185-4227-8588-f0cec3828ef4 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:37.935802 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-7295a6d3-5185-4227-8588-f0cec3828ef4 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:30:37.943324 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-7295a6d3-5185-4227-8588-f0cec3828ef4 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3" status: 200 len: 1453 microversion: 2.1 time: 0.170005 Apr 05 12:30:37.943881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1979/3937] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:30:37 2022] GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:30:37.959647 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-85a27caa-37a8-484e-91c2-9eb39c174b73 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:30:37.960291 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-85a27caa-37a8-484e-91c2-9eb39c174b73 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: a03ec7e6-4c14-4cac-ab24-61cfc2133cb3] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:30:37.966938 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85a27caa-37a8-484e-91c2-9eb39c174b73 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:37.967433 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85a27caa-37a8-484e-91c2-9eb39c174b73 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:37.968223 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85a27caa-37a8-484e-91c2-9eb39c174b73 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:37.968664 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-85a27caa-37a8-484e-91c2-9eb39c174b73 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:38.107916 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-85a27caa-37a8-484e-91c2-9eb39c174b73 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:30:38.119708 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-85a27caa-37a8-484e-91c2-9eb39c174b73 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3" status: 200 len: 1453 microversion: 2.1 time: 0.163801 Apr 05 12:30:38.120277 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1959/3938] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:30:37 2022] GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:30:39.891093 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-1ceeadea-c5d9-4005-a286-5f2e8fbe295e req-3250ca52-710f-453e-b479-51988697d320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a03ec7e6-4c14-4cac-ab24-61cfc2133cb3", "tag": "1b5e9d60-f8ba-4088-b208-5e663b8d9f10"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:30:39.896209 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-1ceeadea-c5d9-4005-a286-5f2e8fbe295e req-3250ca52-710f-453e-b479-51988697d320 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:30:39.896822 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-1ceeadea-c5d9-4005-a286-5f2e8fbe295e req-3250ca52-710f-453e-b479-51988697d320 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:30:39.908592 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-1ceeadea-c5d9-4005-a286-5f2e8fbe295e req-3250ca52-710f-453e-b479-51988697d320 service nova] Creating event network-changed:1b5e9d60-f8ba-4088-b208-5e663b8d9f10 for instance a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 on hv-cinder-82956 Apr 05 12:30:39.913831 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-1ceeadea-c5d9-4005-a286-5f2e8fbe295e req-3250ca52-710f-453e-b479-51988697d320 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029872 Apr 05 12:30:39.914531 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1980/3939] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:30:53.816521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:30:53.817048 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Tue Apr 5 12:30:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:31:17.178063 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:31:17.178575 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Tue Apr 5 12:31:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:31:29.234826 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-d1cf6009-e5da-4f36-a918-a4550b81aff4 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Action: 'create', calling method: .version_select at 0x7f16200f14c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-306513671"}} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:31:29.248205 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-d1cf6009-e5da-4f36-a918-a4550b81aff4 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Getting quotas for project af4da1a94d31489081ca968e1b9d1a20. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 12:31:29.251879 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-d1cf6009-e5da-4f36-a918-a4550b81aff4 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Getting quotas for user 977f428c4b6a43cb87dee153056d19b0 and project af4da1a94d31489081ca968e1b9d1a20. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 12:31:29.486262 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-d1cf6009-e5da-4f36-a918-a4550b81aff4 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Getting quotas for project af4da1a94d31489081ca968e1b9d1a20. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 12:31:29.490551 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.quota [None req-d1cf6009-e5da-4f36-a918-a4550b81aff4 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Getting quotas for user 977f428c4b6a43cb87dee153056d19b0 and project af4da1a94d31489081ca968e1b9d1a20. Resources: {'key_pairs'} {{(pid=123357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 12:31:29.504305 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-d1cf6009-e5da-4f36-a918-a4550b81aff4 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.430667 Apr 05 12:31:29.504901 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1960/3940] 10.222.0.61 () {60 vars in 1157 bytes} [Tue Apr 5 12:31:29 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:31:45.667383 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c3300e7c-0fda-489a-8043-0bf36bc4e6b2 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-538090299", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-306513671", "security_groups": [{"name": "tempest-secgroup-smoke-671795781"}], "networks": [{"uuid": "d12637fe-bed4-4497-8f0d-ed04d307231a"}], "block_device_mapping_v2": [{"uuid": "e294b628-1528-44a5-8960-d5b7567f60c4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:31:45.782375 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.network.neutron [None req-c3300e7c-0fda-489a-8043-0bf36bc4e6b2 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] validate_networks() for [('d12637fe-bed4-4497-8f0d-ed04d307231a', None, None, None, None, None)] {{(pid=123358) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 12:31:46.165207 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-c3300e7c-0fda-489a-8043-0bf36bc4e6b2 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Flavor limits 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 12:31:46.165720 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-c3300e7c-0fda-489a-8043-0bf36bc4e6b2 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Image limits 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:31:46.166194 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-c3300e7c-0fda-489a-8043-0bf36bc4e6b2 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Flavor pref 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 12:31:46.166596 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-c3300e7c-0fda-489a-8043-0bf36bc4e6b2 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Image pref 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:31:46.167006 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-c3300e7c-0fda-489a-8043-0bf36bc4e6b2 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 12:31:46.176370 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c3300e7c-0fda-489a-8043-0bf36bc4e6b2 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:31:46.176819 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c3300e7c-0fda-489a-8043-0bf36bc4e6b2 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:31:46.177603 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c3300e7c-0fda-489a-8043-0bf36bc4e6b2 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:31:46.178036 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c3300e7c-0fda-489a-8043-0bf36bc4e6b2 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:31:46.195062 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-c3300e7c-0fda-489a-8043-0bf36bc4e6b2 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Getting quotas for project af4da1a94d31489081ca968e1b9d1a20. Resources: {'ram', 'instances', 'cores'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 12:31:46.199446 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-c3300e7c-0fda-489a-8043-0bf36bc4e6b2 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Getting quotas for user 977f428c4b6a43cb87dee153056d19b0 and project af4da1a94d31489081ca968e1b9d1a20. Resources: {'ram', 'instances', 'cores'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 12:31:46.257577 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c3300e7c-0fda-489a-8043-0bf36bc4e6b2 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Going to run 1 instances... {{(pid=123358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 12:31:46.259832 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c3300e7c-0fda-489a-8043-0bf36bc4e6b2 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e294b628-1528-44a5-8960-d5b7567f60c4',volume_size=None,volume_type=None)] {{(pid=123358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 12:31:46.389649 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c3300e7c-0fda-489a-8043-0bf36bc4e6b2 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.727759 Apr 05 12:31:46.390294 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1981/3941] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Apr 5 12:31:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 12:31:46.400814 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ab550ff0-cbbd-4946-a016-5383da520310 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:31:46.401421 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ab550ff0-cbbd-4946-a016-5383da520310 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:31:46.458729 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ab550ff0-cbbd-4946-a016-5383da520310 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:31:46.465320 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ab550ff0-cbbd-4946-a016-5383da520310 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1087 microversion: 2.1 time: 0.068443 Apr 05 12:31:46.465862 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1961/3942] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:31:46 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1087 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:31:47.482937 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e4cb5818-97bd-4af7-8419-2d1ce986c6bd tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:31:47.483834 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e4cb5818-97bd-4af7-8419-2d1ce986c6bd tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:31:47.491070 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e4cb5818-97bd-4af7-8419-2d1ce986c6bd tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:31:47.491739 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e4cb5818-97bd-4af7-8419-2d1ce986c6bd tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:31:47.492692 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e4cb5818-97bd-4af7-8419-2d1ce986c6bd tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:31:47.493262 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e4cb5818-97bd-4af7-8419-2d1ce986c6bd tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:31:47.559124 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e4cb5818-97bd-4af7-8419-2d1ce986c6bd tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:31:47.566666 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e4cb5818-97bd-4af7-8419-2d1ce986c6bd tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1203 microversion: 2.1 time: 0.088026 Apr 05 12:31:47.567238 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1982/3943] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:31:47 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1203 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:31:48.584039 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1ea917d3-d260-43b1-a8ce-ff727cfd4683 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:31:48.585378 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1ea917d3-d260-43b1-a8ce-ff727cfd4683 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:31:48.592305 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ea917d3-d260-43b1-a8ce-ff727cfd4683 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:31:48.592844 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ea917d3-d260-43b1-a8ce-ff727cfd4683 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:31:48.593711 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ea917d3-d260-43b1-a8ce-ff727cfd4683 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:31:48.594208 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1ea917d3-d260-43b1-a8ce-ff727cfd4683 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:31:48.767475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-ad63ebcd-8fff-432c-b327-8ac53d8d95c2 req-36914e98-bbe1-449c-bf7c-e22b86b7f194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff6f9052-573c-42bf-b792-89cedff3455b", "tag": "afa360b5-75a7-4767-9234-8b0a059162c9"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:31:48.777014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-ad63ebcd-8fff-432c-b327-8ac53d8d95c2 req-36914e98-bbe1-449c-bf7c-e22b86b7f194 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:31:48.777476 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-ad63ebcd-8fff-432c-b327-8ac53d8d95c2 req-36914e98-bbe1-449c-bf7c-e22b86b7f194 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:31:48.789622 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-ad63ebcd-8fff-432c-b327-8ac53d8d95c2 req-36914e98-bbe1-449c-bf7c-e22b86b7f194 service nova] Creating event network-changed:afa360b5-75a7-4767-9234-8b0a059162c9 for instance ff6f9052-573c-42bf-b792-89cedff3455b on hv-cinder-82956 Apr 05 12:31:48.795663 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-ad63ebcd-8fff-432c-b327-8ac53d8d95c2 req-36914e98-bbe1-449c-bf7c-e22b86b7f194 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108396 Apr 05 12:31:48.796982 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1983/3944] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:31:48.864920 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1ea917d3-d260-43b1-a8ce-ff727cfd4683 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:31:48.872513 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1ea917d3-d260-43b1-a8ce-ff727cfd4683 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1258 microversion: 2.1 time: 0.292241 Apr 05 12:31:48.874266 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1962/3945] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:31:48 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1258 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:31:49.890420 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-ac01ab13-d92b-46fe-b1a4-82ade927cbc1 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:31:49.891113 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-ac01ab13-d92b-46fe-b1a4-82ade927cbc1 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:31:49.898130 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ac01ab13-d92b-46fe-b1a4-82ade927cbc1 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:31:49.898575 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ac01ab13-d92b-46fe-b1a4-82ade927cbc1 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:31:49.899372 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ac01ab13-d92b-46fe-b1a4-82ade927cbc1 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:31:49.899801 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-ac01ab13-d92b-46fe-b1a4-82ade927cbc1 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:31:50.038934 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-ac01ab13-d92b-46fe-b1a4-82ade927cbc1 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:31:50.048013 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-ac01ab13-d92b-46fe-b1a4-82ade927cbc1 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1258 microversion: 2.1 time: 0.161843 Apr 05 12:31:50.048630 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1984/3946] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:31:49 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:31:51.069017 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-eee0cfcc-4b3b-4858-a67f-4ca49dc1d670 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:31:51.069994 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-eee0cfcc-4b3b-4858-a67f-4ca49dc1d670 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:31:51.077699 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eee0cfcc-4b3b-4858-a67f-4ca49dc1d670 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:31:51.078162 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eee0cfcc-4b3b-4858-a67f-4ca49dc1d670 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:31:51.078919 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eee0cfcc-4b3b-4858-a67f-4ca49dc1d670 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:31:51.079350 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-eee0cfcc-4b3b-4858-a67f-4ca49dc1d670 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:31:51.214834 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-eee0cfcc-4b3b-4858-a67f-4ca49dc1d670 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:31:51.222936 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-eee0cfcc-4b3b-4858-a67f-4ca49dc1d670 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1258 microversion: 2.1 time: 0.160616 Apr 05 12:31:51.223500 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1963/3947] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:31:51 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:31:52.244131 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4e0dbad9-2c08-4da7-9e64-48310bda2245 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:31:52.245166 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4e0dbad9-2c08-4da7-9e64-48310bda2245 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:31:52.256028 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e0dbad9-2c08-4da7-9e64-48310bda2245 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:31:52.256828 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e0dbad9-2c08-4da7-9e64-48310bda2245 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:31:52.258081 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e0dbad9-2c08-4da7-9e64-48310bda2245 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:31:52.258852 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4e0dbad9-2c08-4da7-9e64-48310bda2245 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:31:52.418226 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-4e0dbad9-2c08-4da7-9e64-48310bda2245 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:31:52.425985 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4e0dbad9-2c08-4da7-9e64-48310bda2245 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1258 microversion: 2.1 time: 0.188266 Apr 05 12:31:52.426549 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1985/3948] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:31:52 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1258 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:31:53.446822 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-00e08f95-9d03-43e9-92ea-893471853939 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:31:53.447665 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-00e08f95-9d03-43e9-92ea-893471853939 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:31:53.458355 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00e08f95-9d03-43e9-92ea-893471853939 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:31:53.459074 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00e08f95-9d03-43e9-92ea-893471853939 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:31:53.460422 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00e08f95-9d03-43e9-92ea-893471853939 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:31:53.461128 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-00e08f95-9d03-43e9-92ea-893471853939 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:31:53.876755 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-00e08f95-9d03-43e9-92ea-893471853939 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:31:53.887873 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-00e08f95-9d03-43e9-92ea-893471853939 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1258 microversion: 2.1 time: 0.447698 Apr 05 12:31:53.888466 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1964/3949] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:31:53 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1258 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:31:54.908991 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-19e116a0-1f8a-4cd7-8149-a402ed5bf5d5 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:31:54.909938 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-19e116a0-1f8a-4cd7-8149-a402ed5bf5d5 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:31:54.920592 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-19e116a0-1f8a-4cd7-8149-a402ed5bf5d5 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:31:54.921321 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-19e116a0-1f8a-4cd7-8149-a402ed5bf5d5 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:31:54.922554 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-19e116a0-1f8a-4cd7-8149-a402ed5bf5d5 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:31:54.923259 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-19e116a0-1f8a-4cd7-8149-a402ed5bf5d5 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:31:55.070767 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-19e116a0-1f8a-4cd7-8149-a402ed5bf5d5 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:31:55.082849 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-19e116a0-1f8a-4cd7-8149-a402ed5bf5d5 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1258 microversion: 2.1 time: 0.180431 Apr 05 12:31:55.083630 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1986/3950] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:31:54 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1258 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:31:56.108737 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-2629cbb7-35cd-47e9-acf3-25ee8aacd8a3 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:31:56.108737 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-2629cbb7-35cd-47e9-acf3-25ee8aacd8a3 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:31:56.117871 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2629cbb7-35cd-47e9-acf3-25ee8aacd8a3 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:31:56.118615 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2629cbb7-35cd-47e9-acf3-25ee8aacd8a3 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:31:56.119861 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2629cbb7-35cd-47e9-acf3-25ee8aacd8a3 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:31:56.120795 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-2629cbb7-35cd-47e9-acf3-25ee8aacd8a3 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:31:56.268433 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-2629cbb7-35cd-47e9-acf3-25ee8aacd8a3 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:31:56.276690 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-2629cbb7-35cd-47e9-acf3-25ee8aacd8a3 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1258 microversion: 2.1 time: 0.177030 Apr 05 12:31:56.277230 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1965/3951] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:31:56 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:31:57.298098 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c12220b8-f454-442c-9115-2ff2710ebec2 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:31:57.299098 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c12220b8-f454-442c-9115-2ff2710ebec2 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:31:57.309424 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c12220b8-f454-442c-9115-2ff2710ebec2 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:31:57.309876 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c12220b8-f454-442c-9115-2ff2710ebec2 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:31:57.310661 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c12220b8-f454-442c-9115-2ff2710ebec2 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:31:57.311091 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c12220b8-f454-442c-9115-2ff2710ebec2 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:31:57.450098 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c12220b8-f454-442c-9115-2ff2710ebec2 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:31:57.458018 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c12220b8-f454-442c-9115-2ff2710ebec2 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1258 microversion: 2.1 time: 0.166789 Apr 05 12:31:57.458595 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1987/3952] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:31:57 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:31:58.475018 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-381de945-06cc-4cea-9839-f18c9def712a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:31:58.475597 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-381de945-06cc-4cea-9839-f18c9def712a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:31:58.482952 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-381de945-06cc-4cea-9839-f18c9def712a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:31:58.483395 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-381de945-06cc-4cea-9839-f18c9def712a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:31:58.484268 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-381de945-06cc-4cea-9839-f18c9def712a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:31:58.484635 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-381de945-06cc-4cea-9839-f18c9def712a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:31:58.628188 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-381de945-06cc-4cea-9839-f18c9def712a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:31:58.635689 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-381de945-06cc-4cea-9839-f18c9def712a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1258 microversion: 2.1 time: 0.164611 Apr 05 12:31:58.636318 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1966/3953] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:31:58 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:31:59.653619 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-090c1961-76a0-4b72-8bc4-7864e5b7af97 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:31:59.654346 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-090c1961-76a0-4b72-8bc4-7864e5b7af97 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:31:59.663566 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-090c1961-76a0-4b72-8bc4-7864e5b7af97 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:31:59.664205 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-090c1961-76a0-4b72-8bc4-7864e5b7af97 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:31:59.665240 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-090c1961-76a0-4b72-8bc4-7864e5b7af97 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:31:59.665848 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-090c1961-76a0-4b72-8bc4-7864e5b7af97 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:31:59.823673 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-090c1961-76a0-4b72-8bc4-7864e5b7af97 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:31:59.831751 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-090c1961-76a0-4b72-8bc4-7864e5b7af97 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1258 microversion: 2.1 time: 0.182601 Apr 05 12:31:59.832369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1988/3954] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:31:59 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1258 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:32:00.364459 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-b658b356-eba0-4fb5-bf22-004fe2de8c84 req-2c2507b5-66f1-4875-950d-0eee7d87553f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff6f9052-573c-42bf-b792-89cedff3455b", "name": "network-vif-plugged", "status": "completed", "tag": "afa360b5-75a7-4767-9234-8b0a059162c9"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:32:00.373668 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-b658b356-eba0-4fb5-bf22-004fe2de8c84 req-2c2507b5-66f1-4875-950d-0eee7d87553f service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:00.374265 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-b658b356-eba0-4fb5-bf22-004fe2de8c84 req-2c2507b5-66f1-4875-950d-0eee7d87553f service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:00.385112 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-b658b356-eba0-4fb5-bf22-004fe2de8c84 req-2c2507b5-66f1-4875-950d-0eee7d87553f service nova] Creating event network-vif-plugged:afa360b5-75a7-4767-9234-8b0a059162c9 for instance ff6f9052-573c-42bf-b792-89cedff3455b on hv-cinder-82956 Apr 05 12:32:00.390231 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-b658b356-eba0-4fb5-bf22-004fe2de8c84 req-2c2507b5-66f1-4875-950d-0eee7d87553f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030002 Apr 05 12:32:00.390786 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1967/3955] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:32:00.852627 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-34412a12-5bd5-4537-a616-490b4997d702 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:32:00.853633 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-34412a12-5bd5-4537-a616-490b4997d702 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:32:00.864844 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34412a12-5bd5-4537-a616-490b4997d702 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:00.865599 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34412a12-5bd5-4537-a616-490b4997d702 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:00.866844 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34412a12-5bd5-4537-a616-490b4997d702 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:00.867564 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-34412a12-5bd5-4537-a616-490b4997d702 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:01.014637 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-34412a12-5bd5-4537-a616-490b4997d702 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:32:01.022067 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-34412a12-5bd5-4537-a616-490b4997d702 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1258 microversion: 2.1 time: 0.175961 Apr 05 12:32:01.022638 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1989/3956] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:32:00 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:32:02.044302 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e85183ba-27de-41b5-b7ac-ceead3616de9 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:32:02.045139 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e85183ba-27de-41b5-b7ac-ceead3616de9 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:32:02.052045 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e85183ba-27de-41b5-b7ac-ceead3616de9 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:02.052548 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e85183ba-27de-41b5-b7ac-ceead3616de9 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:02.053334 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e85183ba-27de-41b5-b7ac-ceead3616de9 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:02.053782 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e85183ba-27de-41b5-b7ac-ceead3616de9 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:02.193049 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e85183ba-27de-41b5-b7ac-ceead3616de9 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:32:02.200596 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e85183ba-27de-41b5-b7ac-ceead3616de9 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1442 microversion: 2.1 time: 0.164055 Apr 05 12:32:02.201157 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1968/3957] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:32:02 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1442 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:32:02.216760 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-59ac48ec-a886-49a0-96e3-1e16b0cc7cc8 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:32:02.217370 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-59ac48ec-a886-49a0-96e3-1e16b0cc7cc8 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:32:02.223905 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-59ac48ec-a886-49a0-96e3-1e16b0cc7cc8 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:02.224387 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-59ac48ec-a886-49a0-96e3-1e16b0cc7cc8 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:02.225150 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-59ac48ec-a886-49a0-96e3-1e16b0cc7cc8 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:02.225582 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-59ac48ec-a886-49a0-96e3-1e16b0cc7cc8 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:02.371941 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-59ac48ec-a886-49a0-96e3-1e16b0cc7cc8 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:32:02.379546 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-59ac48ec-a886-49a0-96e3-1e16b0cc7cc8 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1442 microversion: 2.1 time: 0.166671 Apr 05 12:32:02.380142 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1990/3958] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:32:02 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1442 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:32:04.131284 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-61128820-b0b8-4a0b-8319-8a32257a80b2 req-b0a29392-2f2d-47af-a8d7-8fdc13838ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff6f9052-573c-42bf-b792-89cedff3455b", "tag": "afa360b5-75a7-4767-9234-8b0a059162c9"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:32:04.139631 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-61128820-b0b8-4a0b-8319-8a32257a80b2 req-b0a29392-2f2d-47af-a8d7-8fdc13838ee2 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:04.140111 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-61128820-b0b8-4a0b-8319-8a32257a80b2 req-b0a29392-2f2d-47af-a8d7-8fdc13838ee2 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:04.150856 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-61128820-b0b8-4a0b-8319-8a32257a80b2 req-b0a29392-2f2d-47af-a8d7-8fdc13838ee2 service nova] Creating event network-changed:afa360b5-75a7-4767-9234-8b0a059162c9 for instance ff6f9052-573c-42bf-b792-89cedff3455b on hv-cinder-82956 Apr 05 12:32:04.156120 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-61128820-b0b8-4a0b-8319-8a32257a80b2 req-b0a29392-2f2d-47af-a8d7-8fdc13838ee2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028658 Apr 05 12:32:04.156722 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1969/3959] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:32:22.868880 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8617dc7e-bf06-4a50-a5c8-b1cbcb7228b8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1226827259", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-800585948", "security_groups": [{"name": "tempest-secgroup-smoke-1198763209"}], "block_device_mapping_v2": [{"uuid": "f347c29d-ec1c-4e34-b4b9-d9b884825751", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "356d48a5-4799-4934-9c4e-ecbb87dec2b3"}]}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:32:22.981671 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.network.neutron [None req-8617dc7e-bf06-4a50-a5c8-b1cbcb7228b8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] validate_networks() for [('356d48a5-4799-4934-9c4e-ecbb87dec2b3', None, None, None, None, None)] {{(pid=123358) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 12:32:23.363014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-8617dc7e-bf06-4a50-a5c8-b1cbcb7228b8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Flavor limits 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 12:32:23.363610 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-8617dc7e-bf06-4a50-a5c8-b1cbcb7228b8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Image limits 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:32:23.364291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-8617dc7e-bf06-4a50-a5c8-b1cbcb7228b8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Flavor pref 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 12:32:23.364858 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-8617dc7e-bf06-4a50-a5c8-b1cbcb7228b8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Image pref 0:0:0 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:32:23.365438 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.virt.hardware [None req-8617dc7e-bf06-4a50-a5c8-b1cbcb7228b8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 12:32:23.379670 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8617dc7e-bf06-4a50-a5c8-b1cbcb7228b8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:23.380115 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8617dc7e-bf06-4a50-a5c8-b1cbcb7228b8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:23.380925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8617dc7e-bf06-4a50-a5c8-b1cbcb7228b8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:23.381357 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8617dc7e-bf06-4a50-a5c8-b1cbcb7228b8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:23.399038 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-8617dc7e-bf06-4a50-a5c8-b1cbcb7228b8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Getting quotas for project ff211be298de4a89afdcf4b57bdbc6bb. Resources: {'ram', 'instances', 'cores'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 12:32:23.403405 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.quota [None req-8617dc7e-bf06-4a50-a5c8-b1cbcb7228b8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Getting quotas for user d4c19b3319804327be025ce4ae75279e and project ff211be298de4a89afdcf4b57bdbc6bb. Resources: {'ram', 'instances', 'cores'} {{(pid=123358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 12:32:23.462586 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8617dc7e-bf06-4a50-a5c8-b1cbcb7228b8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Going to run 1 instances... {{(pid=123358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 12:32:23.464723 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8617dc7e-bf06-4a50-a5c8-b1cbcb7228b8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: f6278191-a0b7-4e89-8232-94c1df38c3df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f347c29d-ec1c-4e34-b4b9-d9b884825751',volume_size=None,volume_type=None)] {{(pid=123358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 12:32:23.608325 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8617dc7e-bf06-4a50-a5c8-b1cbcb7228b8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.743543 Apr 05 12:32:23.608963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1991/3960] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Apr 5 12:32:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 12:32:23.620315 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-b7e83bed-91c2-4959-8878-464adac13299 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:32:23.621043 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-b7e83bed-91c2-4959-8878-464adac13299 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: f6278191-a0b7-4e89-8232-94c1df38c3df] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:32:23.674638 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-b7e83bed-91c2-4959-8878-464adac13299 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:32:23.681236 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-b7e83bed-91c2-4959-8878-464adac13299 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df" status: 200 len: 1094 microversion: 2.1 time: 0.065733 Apr 05 12:32:23.681805 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1970/3961] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:32:23 2022] GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:32:24.699939 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-48fa8949-fbf5-47e9-8ff9-0b06a3be5ea2 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:32:24.701272 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-48fa8949-fbf5-47e9-8ff9-0b06a3be5ea2 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: f6278191-a0b7-4e89-8232-94c1df38c3df] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:32:24.707410 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-48fa8949-fbf5-47e9-8ff9-0b06a3be5ea2 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:24.708082 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-48fa8949-fbf5-47e9-8ff9-0b06a3be5ea2 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:24.708864 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-48fa8949-fbf5-47e9-8ff9-0b06a3be5ea2 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:24.709304 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-48fa8949-fbf5-47e9-8ff9-0b06a3be5ea2 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:24.772012 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-48fa8949-fbf5-47e9-8ff9-0b06a3be5ea2 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:32:24.780100 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-48fa8949-fbf5-47e9-8ff9-0b06a3be5ea2 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df" status: 200 len: 1200 microversion: 2.1 time: 0.085375 Apr 05 12:32:24.780913 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1992/3962] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:32:24 2022] GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df => generated 1200 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:32:25.798305 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-841ac93a-c77c-4e90-a4d1-ed6ae3437708 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:32:25.798965 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-841ac93a-c77c-4e90-a4d1-ed6ae3437708 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: f6278191-a0b7-4e89-8232-94c1df38c3df] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:32:25.805985 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-841ac93a-c77c-4e90-a4d1-ed6ae3437708 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:25.806441 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-841ac93a-c77c-4e90-a4d1-ed6ae3437708 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:25.807209 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-841ac93a-c77c-4e90-a4d1-ed6ae3437708 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:25.807646 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-841ac93a-c77c-4e90-a4d1-ed6ae3437708 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:26.054593 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-841ac93a-c77c-4e90-a4d1-ed6ae3437708 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:32:26.063521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-841ac93a-c77c-4e90-a4d1-ed6ae3437708 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df" status: 200 len: 1266 microversion: 2.1 time: 0.269067 Apr 05 12:32:26.064252 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1971/3963] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:32:25 2022] GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:32:26.211571 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-24302361-0d05-438f-ab9c-b697f5565bb9 req-a575d87b-2ac6-4e65-a7e2-f4ff87098a10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6278191-a0b7-4e89-8232-94c1df38c3df", "tag": "4463a44a-b80d-4211-837d-480e33ea348a"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:32:26.227772 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-24302361-0d05-438f-ab9c-b697f5565bb9 req-a575d87b-2ac6-4e65-a7e2-f4ff87098a10 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:26.228263 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-24302361-0d05-438f-ab9c-b697f5565bb9 req-a575d87b-2ac6-4e65-a7e2-f4ff87098a10 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:26.248718 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-24302361-0d05-438f-ab9c-b697f5565bb9 req-a575d87b-2ac6-4e65-a7e2-f4ff87098a10 service nova] Creating event network-changed:4463a44a-b80d-4211-837d-480e33ea348a for instance f6278191-a0b7-4e89-8232-94c1df38c3df on hv-cinder-82956 Apr 05 12:32:26.255956 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-24302361-0d05-438f-ab9c-b697f5565bb9 req-a575d87b-2ac6-4e65-a7e2-f4ff87098a10 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047764 Apr 05 12:32:26.257515 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1993/3964] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:32:27.081213 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-28547190-5654-4903-90b9-525f06df592c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:32:27.082038 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-28547190-5654-4903-90b9-525f06df592c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: f6278191-a0b7-4e89-8232-94c1df38c3df] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:32:27.088758 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-28547190-5654-4903-90b9-525f06df592c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:27.089452 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-28547190-5654-4903-90b9-525f06df592c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:27.090227 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-28547190-5654-4903-90b9-525f06df592c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:27.090654 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-28547190-5654-4903-90b9-525f06df592c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:27.281078 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-28547190-5654-4903-90b9-525f06df592c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:32:27.288872 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-28547190-5654-4903-90b9-525f06df592c tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df" status: 200 len: 1266 microversion: 2.1 time: 0.211592 Apr 05 12:32:27.289576 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1972/3965] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:32:27 2022] GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:32:28.310895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c4bfc4d6-4f9b-4dfe-8954-06be1701e92e tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:32:28.312025 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c4bfc4d6-4f9b-4dfe-8954-06be1701e92e tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: f6278191-a0b7-4e89-8232-94c1df38c3df] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:32:28.321661 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c4bfc4d6-4f9b-4dfe-8954-06be1701e92e tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:28.322106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c4bfc4d6-4f9b-4dfe-8954-06be1701e92e tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:28.322861 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c4bfc4d6-4f9b-4dfe-8954-06be1701e92e tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:28.323297 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c4bfc4d6-4f9b-4dfe-8954-06be1701e92e tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:28.467832 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c4bfc4d6-4f9b-4dfe-8954-06be1701e92e tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:32:28.475725 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c4bfc4d6-4f9b-4dfe-8954-06be1701e92e tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df" status: 200 len: 1266 microversion: 2.1 time: 0.171822 Apr 05 12:32:28.476331 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1994/3966] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:32:28 2022] GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:32:29.493180 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-957db9b7-5981-46bb-9c95-1a8d3ffe2428 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:32:29.493802 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-957db9b7-5981-46bb-9c95-1a8d3ffe2428 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: f6278191-a0b7-4e89-8232-94c1df38c3df] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:32:29.501135 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-957db9b7-5981-46bb-9c95-1a8d3ffe2428 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:29.501625 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-957db9b7-5981-46bb-9c95-1a8d3ffe2428 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:29.502444 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-957db9b7-5981-46bb-9c95-1a8d3ffe2428 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:29.502915 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-957db9b7-5981-46bb-9c95-1a8d3ffe2428 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:29.639861 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-957db9b7-5981-46bb-9c95-1a8d3ffe2428 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:32:29.647539 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-957db9b7-5981-46bb-9c95-1a8d3ffe2428 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df" status: 200 len: 1266 microversion: 2.1 time: 0.158284 Apr 05 12:32:29.648081 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1973/3967] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:32:29 2022] GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:32:30.668653 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-e1f18f1d-4358-452b-bffe-312cb2af21af tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:32:30.669624 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-e1f18f1d-4358-452b-bffe-312cb2af21af tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: f6278191-a0b7-4e89-8232-94c1df38c3df] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:32:30.680359 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e1f18f1d-4358-452b-bffe-312cb2af21af tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:30.681106 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e1f18f1d-4358-452b-bffe-312cb2af21af tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:30.682353 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e1f18f1d-4358-452b-bffe-312cb2af21af tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:30.683218 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-e1f18f1d-4358-452b-bffe-312cb2af21af tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:30.827881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-e1f18f1d-4358-452b-bffe-312cb2af21af tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:32:30.836925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-e1f18f1d-4358-452b-bffe-312cb2af21af tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df" status: 200 len: 1266 microversion: 2.1 time: 0.174946 Apr 05 12:32:30.837749 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1995/3968] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:32:30 2022] GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:32:31.867778 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-bb1347b9-65b4-4ccf-9cfd-9dd6214b897f tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:32:31.868798 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-bb1347b9-65b4-4ccf-9cfd-9dd6214b897f tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: f6278191-a0b7-4e89-8232-94c1df38c3df] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:32:31.879522 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bb1347b9-65b4-4ccf-9cfd-9dd6214b897f tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:31.880323 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bb1347b9-65b4-4ccf-9cfd-9dd6214b897f tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:31.881588 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bb1347b9-65b4-4ccf-9cfd-9dd6214b897f tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:31.882305 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-bb1347b9-65b4-4ccf-9cfd-9dd6214b897f tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:32.026898 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-bb1347b9-65b4-4ccf-9cfd-9dd6214b897f tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:32:32.038793 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-bb1347b9-65b4-4ccf-9cfd-9dd6214b897f tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df" status: 200 len: 1266 microversion: 2.1 time: 0.178744 Apr 05 12:32:32.039363 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1974/3969] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:32:31 2022] GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:32:33.056223 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-fe25b5f6-3a64-443d-b172-849148f67b9e tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:32:33.056837 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-fe25b5f6-3a64-443d-b172-849148f67b9e tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: f6278191-a0b7-4e89-8232-94c1df38c3df] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:32:33.063259 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fe25b5f6-3a64-443d-b172-849148f67b9e tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:33.063703 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fe25b5f6-3a64-443d-b172-849148f67b9e tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:33.064476 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fe25b5f6-3a64-443d-b172-849148f67b9e tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:33.064903 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-fe25b5f6-3a64-443d-b172-849148f67b9e tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:33.201555 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-fe25b5f6-3a64-443d-b172-849148f67b9e tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:32:33.209133 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-fe25b5f6-3a64-443d-b172-849148f67b9e tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df" status: 200 len: 1266 microversion: 2.1 time: 0.156891 Apr 05 12:32:33.209693 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1996/3970] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:32:33 2022] GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:32:34.230200 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-399db8ef-29c9-44f7-9ad0-13fe5cecdadf tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:32:34.231513 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-399db8ef-29c9-44f7-9ad0-13fe5cecdadf tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: f6278191-a0b7-4e89-8232-94c1df38c3df] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:32:34.242578 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-399db8ef-29c9-44f7-9ad0-13fe5cecdadf tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:34.243019 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-399db8ef-29c9-44f7-9ad0-13fe5cecdadf tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:34.243810 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-399db8ef-29c9-44f7-9ad0-13fe5cecdadf tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:34.244290 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-399db8ef-29c9-44f7-9ad0-13fe5cecdadf tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:34.385783 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-399db8ef-29c9-44f7-9ad0-13fe5cecdadf tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:32:34.396963 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-399db8ef-29c9-44f7-9ad0-13fe5cecdadf tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df" status: 200 len: 1266 microversion: 2.1 time: 0.172976 Apr 05 12:32:34.397724 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1975/3971] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:32:34 2022] GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:32:35.423197 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-709fa98a-cf2c-40c3-8cf5-861439024df9 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:32:35.424153 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-709fa98a-cf2c-40c3-8cf5-861439024df9 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: f6278191-a0b7-4e89-8232-94c1df38c3df] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:32:35.433369 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-709fa98a-cf2c-40c3-8cf5-861439024df9 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:35.433814 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-709fa98a-cf2c-40c3-8cf5-861439024df9 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:35.434561 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-709fa98a-cf2c-40c3-8cf5-861439024df9 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:35.434986 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-709fa98a-cf2c-40c3-8cf5-861439024df9 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:35.572052 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-709fa98a-cf2c-40c3-8cf5-861439024df9 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:32:35.579446 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-709fa98a-cf2c-40c3-8cf5-861439024df9 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df" status: 200 len: 1266 microversion: 2.1 time: 0.162816 Apr 05 12:32:35.580010 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1997/3972] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:32:35 2022] GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:32:36.596591 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-800e2e3e-910d-4466-89d7-243cf1f74452 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:32:36.597278 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-800e2e3e-910d-4466-89d7-243cf1f74452 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: f6278191-a0b7-4e89-8232-94c1df38c3df] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:32:36.604111 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-800e2e3e-910d-4466-89d7-243cf1f74452 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:36.604556 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-800e2e3e-910d-4466-89d7-243cf1f74452 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:36.605313 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-800e2e3e-910d-4466-89d7-243cf1f74452 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:36.606108 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-800e2e3e-910d-4466-89d7-243cf1f74452 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:36.722008 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-a557698a-a26f-424d-8c34-3ee50a6aac8a req-0ad9f6b6-9064-4e1b-8d80-5c74c44d50c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6278191-a0b7-4e89-8232-94c1df38c3df", "name": "network-vif-plugged", "status": "completed", "tag": "4463a44a-b80d-4211-837d-480e33ea348a"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:32:36.737873 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-a557698a-a26f-424d-8c34-3ee50a6aac8a req-0ad9f6b6-9064-4e1b-8d80-5c74c44d50c0 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:36.738307 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-a557698a-a26f-424d-8c34-3ee50a6aac8a req-0ad9f6b6-9064-4e1b-8d80-5c74c44d50c0 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:36.746914 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-800e2e3e-910d-4466-89d7-243cf1f74452 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:32:36.749257 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-a557698a-a26f-424d-8c34-3ee50a6aac8a req-0ad9f6b6-9064-4e1b-8d80-5c74c44d50c0 service nova] Creating event network-vif-plugged:4463a44a-b80d-4211-837d-480e33ea348a for instance f6278191-a0b7-4e89-8232-94c1df38c3df on hv-cinder-82956 Apr 05 12:32:36.754240 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-a557698a-a26f-424d-8c34-3ee50a6aac8a req-0ad9f6b6-9064-4e1b-8d80-5c74c44d50c0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100415 Apr 05 12:32:36.754373 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-800e2e3e-910d-4466-89d7-243cf1f74452 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df" status: 200 len: 1266 microversion: 2.1 time: 0.161678 Apr 05 12:32:36.754823 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1998/3973] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:32:36.756196 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1976/3974] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:32:36 2022] GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:32:37.777254 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-53bc50fe-4f7a-467c-b300-1d073787aca8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:32:37.778330 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-53bc50fe-4f7a-467c-b300-1d073787aca8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: f6278191-a0b7-4e89-8232-94c1df38c3df] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:32:37.788925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-53bc50fe-4f7a-467c-b300-1d073787aca8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:37.789690 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-53bc50fe-4f7a-467c-b300-1d073787aca8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:37.790944 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-53bc50fe-4f7a-467c-b300-1d073787aca8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:37.791689 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-53bc50fe-4f7a-467c-b300-1d073787aca8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:37.945918 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-53bc50fe-4f7a-467c-b300-1d073787aca8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:32:37.953753 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-53bc50fe-4f7a-467c-b300-1d073787aca8 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df" status: 200 len: 1266 microversion: 2.1 time: 0.184613 Apr 05 12:32:37.954300 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 1999/3975] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:32:37 2022] GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:32:38.971340 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0ae0013c-9c92-4cb1-8c99-7c13f02f405b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:32:38.971942 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0ae0013c-9c92-4cb1-8c99-7c13f02f405b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: f6278191-a0b7-4e89-8232-94c1df38c3df] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:32:38.979083 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0ae0013c-9c92-4cb1-8c99-7c13f02f405b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:38.979671 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0ae0013c-9c92-4cb1-8c99-7c13f02f405b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:38.980818 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0ae0013c-9c92-4cb1-8c99-7c13f02f405b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:38.981255 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0ae0013c-9c92-4cb1-8c99-7c13f02f405b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:39.132324 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0ae0013c-9c92-4cb1-8c99-7c13f02f405b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:32:39.143697 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0ae0013c-9c92-4cb1-8c99-7c13f02f405b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df" status: 200 len: 1453 microversion: 2.1 time: 0.176277 Apr 05 12:32:39.144541 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1977/3976] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:32:38 2022] GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df => generated 1453 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:32:39.162273 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-d4d3acc2-e55e-44ce-aee1-078e4f76203d tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:32:39.162838 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-d4d3acc2-e55e-44ce-aee1-078e4f76203d tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: f6278191-a0b7-4e89-8232-94c1df38c3df] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:32:39.168866 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d4d3acc2-e55e-44ce-aee1-078e4f76203d tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:39.169302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d4d3acc2-e55e-44ce-aee1-078e4f76203d tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:39.170020 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d4d3acc2-e55e-44ce-aee1-078e4f76203d tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:39.170446 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-d4d3acc2-e55e-44ce-aee1-078e4f76203d tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:39.307976 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-d4d3acc2-e55e-44ce-aee1-078e4f76203d tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:32:39.315739 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-d4d3acc2-e55e-44ce-aee1-078e4f76203d tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df" status: 200 len: 1453 microversion: 2.1 time: 0.157691 Apr 05 12:32:39.316381 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2000/3977] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:32:39 2022] GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:32:41.284492 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-bbec237d-80f8-4029-abdb-915291b22291 req-ada09460-3019-4fcf-bbc5-8aa89e0ec824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6278191-a0b7-4e89-8232-94c1df38c3df", "tag": "4463a44a-b80d-4211-837d-480e33ea348a"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:32:41.293579 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-bbec237d-80f8-4029-abdb-915291b22291 req-ada09460-3019-4fcf-bbc5-8aa89e0ec824 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:32:41.294023 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-bbec237d-80f8-4029-abdb-915291b22291 req-ada09460-3019-4fcf-bbc5-8aa89e0ec824 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:32:41.308038 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-bbec237d-80f8-4029-abdb-915291b22291 req-ada09460-3019-4fcf-bbc5-8aa89e0ec824 service nova] Creating event network-changed:4463a44a-b80d-4211-837d-480e33ea348a for instance f6278191-a0b7-4e89-8232-94c1df38c3df on hv-cinder-82956 Apr 05 12:32:41.313185 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-bbec237d-80f8-4029-abdb-915291b22291 req-ada09460-3019-4fcf-bbc5-8aa89e0ec824 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032922 Apr 05 12:32:41.313776 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1978/3978] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:34:00.465431 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-614f7223-1a9a-46fb-9c98-0b92ea931764 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:34:00.466025 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-614f7223-1a9a-46fb-9c98-0b92ea931764 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:00.472496 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-614f7223-1a9a-46fb-9c98-0b92ea931764 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:00.472959 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-614f7223-1a9a-46fb-9c98-0b92ea931764 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:00.473709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-614f7223-1a9a-46fb-9c98-0b92ea931764 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:00.474141 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-614f7223-1a9a-46fb-9c98-0b92ea931764 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:00.497192 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.objects.instance [None req-614f7223-1a9a-46fb-9c98-0b92ea931764 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lazy-loading 'flavor' on Instance uuid ff6f9052-573c-42bf-b792-89cedff3455b {{(pid=123358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 12:34:00.573027 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-614f7223-1a9a-46fb-9c98-0b92ea931764 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "POST /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b/action" status: 202 len: 0 microversion: 2.1 time: 0.112220 Apr 05 12:34:00.573720 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2001/3979] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Apr 5 12:34:00 2022] POST /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:34:00.581156 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7afe3204-24fe-4ee1-974f-df11476e2406] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 05 12:34:00.585180 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4953ddf9-99a3-4167-a1b3-84e0d21ce9a5 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:00.585859 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4953ddf9-99a3-4167-a1b3-84e0d21ce9a5 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:00.592543 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4953ddf9-99a3-4167-a1b3-84e0d21ce9a5 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:00.594118 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4953ddf9-99a3-4167-a1b3-84e0d21ce9a5 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:00.595384 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4953ddf9-99a3-4167-a1b3-84e0d21ce9a5 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:00.595815 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4953ddf9-99a3-4167-a1b3-84e0d21ce9a5 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:00.784940 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4953ddf9-99a3-4167-a1b3-84e0d21ce9a5 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:00.793104 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4953ddf9-99a3-4167-a1b3-84e0d21ce9a5 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1566 microversion: 2.1 time: 0.214933 Apr 05 12:34:00.793671 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1979/3980] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:00 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1566 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:01.817447 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-dd02911d-6e88-4b53-a574-56190c648d72 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:01.818470 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-dd02911d-6e88-4b53-a574-56190c648d72 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:01.829242 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dd02911d-6e88-4b53-a574-56190c648d72 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:01.829937 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dd02911d-6e88-4b53-a574-56190c648d72 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:01.831180 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dd02911d-6e88-4b53-a574-56190c648d72 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:01.831895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-dd02911d-6e88-4b53-a574-56190c648d72 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:02.030935 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-dd02911d-6e88-4b53-a574-56190c648d72 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:02.039173 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-dd02911d-6e88-4b53-a574-56190c648d72 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1566 microversion: 2.1 time: 0.229981 Apr 05 12:34:02.039738 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2002/3981] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:01 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1566 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:03.060616 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ec6a2bb2-df91-4269-be55-fae7213839ef tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:03.061569 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ec6a2bb2-df91-4269-be55-fae7213839ef tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:03.069860 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec6a2bb2-df91-4269-be55-fae7213839ef tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:03.070349 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec6a2bb2-df91-4269-be55-fae7213839ef tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:03.071181 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec6a2bb2-df91-4269-be55-fae7213839ef tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:03.071652 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ec6a2bb2-df91-4269-be55-fae7213839ef tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:03.076948 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] [7afe3204-24fe-4ee1-974f-df11476e2406] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 34980. Apr 05 12:34:03.211223 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ec6a2bb2-df91-4269-be55-fae7213839ef tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:03.219069 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ec6a2bb2-df91-4269-be55-fae7213839ef tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1566 microversion: 2.1 time: 0.165059 Apr 05 12:34:03.219637 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1980/3982] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:03 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:04.237514 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-c797c1c1-c82c-4e8a-b35f-3dfafaf3d481 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:04.238152 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-c797c1c1-c82c-4e8a-b35f-3dfafaf3d481 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:04.244851 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c797c1c1-c82c-4e8a-b35f-3dfafaf3d481 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:04.245291 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c797c1c1-c82c-4e8a-b35f-3dfafaf3d481 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:04.246039 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c797c1c1-c82c-4e8a-b35f-3dfafaf3d481 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:04.246465 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-c797c1c1-c82c-4e8a-b35f-3dfafaf3d481 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:04.383286 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-c797c1c1-c82c-4e8a-b35f-3dfafaf3d481 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:04.391149 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-c797c1c1-c82c-4e8a-b35f-3dfafaf3d481 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1566 microversion: 2.1 time: 0.157674 Apr 05 12:34:04.391735 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2003/3983] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:04 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:05.412706 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-1dc693a4-5dbf-4cdf-8066-5391baeb128a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:05.413527 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-1dc693a4-5dbf-4cdf-8066-5391baeb128a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:05.424270 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1dc693a4-5dbf-4cdf-8066-5391baeb128a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:05.425004 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1dc693a4-5dbf-4cdf-8066-5391baeb128a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:05.426250 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1dc693a4-5dbf-4cdf-8066-5391baeb128a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:05.426992 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-1dc693a4-5dbf-4cdf-8066-5391baeb128a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:05.574976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-1dc693a4-5dbf-4cdf-8066-5391baeb128a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:05.586999 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-1dc693a4-5dbf-4cdf-8066-5391baeb128a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1566 microversion: 2.1 time: 0.180774 Apr 05 12:34:05.587811 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1981/3984] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:05 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:06.609318 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-0bf758d1-937f-4c00-946f-e3822c18b357 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:06.610332 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-0bf758d1-937f-4c00-946f-e3822c18b357 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:06.621223 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0bf758d1-937f-4c00-946f-e3822c18b357 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:06.621982 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0bf758d1-937f-4c00-946f-e3822c18b357 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:06.623240 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0bf758d1-937f-4c00-946f-e3822c18b357 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:06.623963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-0bf758d1-937f-4c00-946f-e3822c18b357 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:06.769178 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-0bf758d1-937f-4c00-946f-e3822c18b357 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:06.776804 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-0bf758d1-937f-4c00-946f-e3822c18b357 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1566 microversion: 2.1 time: 0.174521 Apr 05 12:34:06.777409 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2004/3985] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:06 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:07.796239 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-6d5fb048-5d7e-4ce6-939b-7a74296527d0 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:07.796931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-6d5fb048-5d7e-4ce6-939b-7a74296527d0 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:07.805456 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6d5fb048-5d7e-4ce6-939b-7a74296527d0 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:07.806046 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6d5fb048-5d7e-4ce6-939b-7a74296527d0 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:07.807054 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6d5fb048-5d7e-4ce6-939b-7a74296527d0 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:07.807635 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-6d5fb048-5d7e-4ce6-939b-7a74296527d0 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:07.943249 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-6d5fb048-5d7e-4ce6-939b-7a74296527d0 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:07.950681 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-6d5fb048-5d7e-4ce6-939b-7a74296527d0 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1566 microversion: 2.1 time: 0.159829 Apr 05 12:34:07.951252 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1982/3986] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:07 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:08.972474 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-02fdb1aa-fa54-4689-92eb-fd89a7feaed8 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:08.973490 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-02fdb1aa-fa54-4689-92eb-fd89a7feaed8 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:08.983597 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-02fdb1aa-fa54-4689-92eb-fd89a7feaed8 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:08.984025 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-02fdb1aa-fa54-4689-92eb-fd89a7feaed8 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:08.984812 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-02fdb1aa-fa54-4689-92eb-fd89a7feaed8 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:08.985252 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-02fdb1aa-fa54-4689-92eb-fd89a7feaed8 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:09.128126 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-02fdb1aa-fa54-4689-92eb-fd89a7feaed8 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:09.139178 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-02fdb1aa-fa54-4689-92eb-fd89a7feaed8 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1566 microversion: 2.1 time: 0.173256 Apr 05 12:34:09.139953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2005/3987] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:08 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:10.166035 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-fb9272cc-734d-4190-884d-87e2e2c3f6ef tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:10.167086 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-fb9272cc-734d-4190-884d-87e2e2c3f6ef tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:10.175141 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fb9272cc-734d-4190-884d-87e2e2c3f6ef tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:10.175591 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fb9272cc-734d-4190-884d-87e2e2c3f6ef tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:10.176385 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fb9272cc-734d-4190-884d-87e2e2c3f6ef tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:10.176822 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-fb9272cc-734d-4190-884d-87e2e2c3f6ef tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:10.336700 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-fb9272cc-734d-4190-884d-87e2e2c3f6ef tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:10.348666 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-fb9272cc-734d-4190-884d-87e2e2c3f6ef tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1566 microversion: 2.1 time: 0.188938 Apr 05 12:34:10.349444 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1983/3988] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:10 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:11.366400 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-5fa84f06-5317-4ff0-a973-31f7b140bf35 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:11.366987 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-5fa84f06-5317-4ff0-a973-31f7b140bf35 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:11.373829 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5fa84f06-5317-4ff0-a973-31f7b140bf35 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:11.374280 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5fa84f06-5317-4ff0-a973-31f7b140bf35 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:11.375031 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5fa84f06-5317-4ff0-a973-31f7b140bf35 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:11.375459 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-5fa84f06-5317-4ff0-a973-31f7b140bf35 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:11.594290 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-5fa84f06-5317-4ff0-a973-31f7b140bf35 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:11.602093 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-5fa84f06-5317-4ff0-a973-31f7b140bf35 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1566 microversion: 2.1 time: 0.239532 Apr 05 12:34:11.602639 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2006/3989] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:11 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1566 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:12.560022 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-060d7351-b942-49b4-9aa8-78c7bb814f3b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:12.560563 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-060d7351-b942-49b4-9aa8-78c7bb814f3b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: f6278191-a0b7-4e89-8232-94c1df38c3df] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:12.562306 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-716ef708-51ea-4b8c-9a14-4cc143e24511 req-df8912b4-d1f9-4047-8c90-ce7009a8644b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6278191-a0b7-4e89-8232-94c1df38c3df", "tag": "4463a44a-b80d-4211-837d-480e33ea348a"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:34:12.566912 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-060d7351-b942-49b4-9aa8-78c7bb814f3b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:12.567561 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-060d7351-b942-49b4-9aa8-78c7bb814f3b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:12.568357 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-060d7351-b942-49b4-9aa8-78c7bb814f3b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:12.568788 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-060d7351-b942-49b4-9aa8-78c7bb814f3b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:12.570843 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-716ef708-51ea-4b8c-9a14-4cc143e24511 req-df8912b4-d1f9-4047-8c90-ce7009a8644b service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:12.571293 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-716ef708-51ea-4b8c-9a14-4cc143e24511 req-df8912b4-d1f9-4047-8c90-ce7009a8644b service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:12.582394 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-716ef708-51ea-4b8c-9a14-4cc143e24511 req-df8912b4-d1f9-4047-8c90-ce7009a8644b service nova] Creating event network-changed:4463a44a-b80d-4211-837d-480e33ea348a for instance f6278191-a0b7-4e89-8232-94c1df38c3df on hv-cinder-82956 Apr 05 12:34:12.587680 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-716ef708-51ea-4b8c-9a14-4cc143e24511 req-df8912b4-d1f9-4047-8c90-ce7009a8644b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029160 Apr 05 12:34:12.588556 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2007/3990] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:34:12.593389 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-060d7351-b942-49b4-9aa8-78c7bb814f3b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: f6278191-a0b7-4e89-8232-94c1df38c3df] Going to try to terminate instance {{(pid=123357) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 12:34:12.620029 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-9c334582-d735-4dc7-99c3-2b4431d66771 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:12.621860 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-9c334582-d735-4dc7-99c3-2b4431d66771 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:12.628887 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9c334582-d735-4dc7-99c3-2b4431d66771 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:12.629363 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9c334582-d735-4dc7-99c3-2b4431d66771 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:12.630247 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9c334582-d735-4dc7-99c3-2b4431d66771 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:12.630686 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-9c334582-d735-4dc7-99c3-2b4431d66771 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:12.676490 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-060d7351-b942-49b4-9aa8-78c7bb814f3b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df" status: 204 len: 0 microversion: 2.1 time: 0.119842 Apr 05 12:34:12.680248 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1984/3991] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 12:34:12 2022] DELETE /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:34:12.685843 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-0379c919-9a2d-4eeb-86db-e4352a71535b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:12.686561 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-0379c919-9a2d-4eeb-86db-e4352a71535b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: f6278191-a0b7-4e89-8232-94c1df38c3df] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:12.692812 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0379c919-9a2d-4eeb-86db-e4352a71535b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:12.693751 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0379c919-9a2d-4eeb-86db-e4352a71535b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:12.694947 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0379c919-9a2d-4eeb-86db-e4352a71535b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:12.694947 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-0379c919-9a2d-4eeb-86db-e4352a71535b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:12.798899 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-9c334582-d735-4dc7-99c3-2b4431d66771 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:12.806681 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-9c334582-d735-4dc7-99c3-2b4431d66771 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1566 microversion: 2.1 time: 0.191598 Apr 05 12:34:12.807622 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2008/3992] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:12 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1566 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:34:12.837280 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-0379c919-9a2d-4eeb-86db-e4352a71535b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:12.844841 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-0379c919-9a2d-4eeb-86db-e4352a71535b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df" status: 200 len: 1576 microversion: 2.1 time: 0.163257 Apr 05 12:34:12.845412 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1985/3993] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:12 2022] GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:34:13.824475 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-bd99cffd-57fa-4ea9-925b-27d94ce95a8b tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:13.825141 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-bd99cffd-57fa-4ea9-925b-27d94ce95a8b tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:13.825661 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:34:13.826104 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Tue Apr 5 12:34:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:34:13.832111 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bd99cffd-57fa-4ea9-925b-27d94ce95a8b tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:13.832599 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bd99cffd-57fa-4ea9-925b-27d94ce95a8b tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:13.833393 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bd99cffd-57fa-4ea9-925b-27d94ce95a8b tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:13.833824 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-bd99cffd-57fa-4ea9-925b-27d94ce95a8b tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:13.862663 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-586e8317-142c-470e-b692-f221a5496921 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:13.863462 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-586e8317-142c-470e-b692-f221a5496921 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: f6278191-a0b7-4e89-8232-94c1df38c3df] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:13.870228 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-586e8317-142c-470e-b692-f221a5496921 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:13.870674 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-586e8317-142c-470e-b692-f221a5496921 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:13.871414 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-586e8317-142c-470e-b692-f221a5496921 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:13.871848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-586e8317-142c-470e-b692-f221a5496921 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:14.002332 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-bd99cffd-57fa-4ea9-925b-27d94ce95a8b tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:14.010508 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-bd99cffd-57fa-4ea9-925b-27d94ce95a8b tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1566 microversion: 2.1 time: 0.189952 Apr 05 12:34:14.021060 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2009/3994] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:13 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1566 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:14.023831 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-586e8317-142c-470e-b692-f221a5496921 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:14.031374 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-586e8317-142c-470e-b692-f221a5496921 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df" status: 200 len: 1576 microversion: 2.1 time: 0.172567 Apr 05 12:34:14.032158 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1986/3995] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:13 2022] GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:14.698009 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-4bfda212-3c96-4b3c-be9f-1cb1873c3bc8 req-524b0980-d7b5-420d-8f6d-1c48e43c0e50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6278191-a0b7-4e89-8232-94c1df38c3df", "name": "network-vif-deleted", "tag": "4463a44a-b80d-4211-837d-480e33ea348a"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:34:14.706316 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-4bfda212-3c96-4b3c-be9f-1cb1873c3bc8 req-524b0980-d7b5-420d-8f6d-1c48e43c0e50 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:14.706746 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-4bfda212-3c96-4b3c-be9f-1cb1873c3bc8 req-524b0980-d7b5-420d-8f6d-1c48e43c0e50 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:14.717787 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-4bfda212-3c96-4b3c-be9f-1cb1873c3bc8 req-524b0980-d7b5-420d-8f6d-1c48e43c0e50 service nova] Creating event network-vif-deleted:4463a44a-b80d-4211-837d-480e33ea348a for instance f6278191-a0b7-4e89-8232-94c1df38c3df on hv-cinder-82956 Apr 05 12:34:14.722621 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-4bfda212-3c96-4b3c-be9f-1cb1873c3bc8 req-524b0980-d7b5-420d-8f6d-1c48e43c0e50 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028469 Apr 05 12:34:14.723184 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2010/3996] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:34:15.028159 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e34cafa5-de8c-4954-8d26-a3ab003813dd tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:15.029205 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e34cafa5-de8c-4954-8d26-a3ab003813dd tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:15.036593 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e34cafa5-de8c-4954-8d26-a3ab003813dd tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:15.037502 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e34cafa5-de8c-4954-8d26-a3ab003813dd tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:15.038513 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e34cafa5-de8c-4954-8d26-a3ab003813dd tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:15.039177 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e34cafa5-de8c-4954-8d26-a3ab003813dd tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:15.049532 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-88ab10eb-0984-4258-97e0-c00991c600d6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:15.050869 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-88ab10eb-0984-4258-97e0-c00991c600d6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: f6278191-a0b7-4e89-8232-94c1df38c3df] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:15.057715 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-88ab10eb-0984-4258-97e0-c00991c600d6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:15.058486 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-88ab10eb-0984-4258-97e0-c00991c600d6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:15.059253 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-88ab10eb-0984-4258-97e0-c00991c600d6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:15.059836 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-88ab10eb-0984-4258-97e0-c00991c600d6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:15.094473 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-88ab10eb-0984-4258-97e0-c00991c600d6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:15.095173 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-88ab10eb-0984-4258-97e0-c00991c600d6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:15.095769 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.objects.instance [None req-88ab10eb-0984-4258-97e0-c00991c600d6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lazy-loading 'fault' on Instance uuid f6278191-a0b7-4e89-8232-94c1df38c3df {{(pid=123358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 12:34:15.149014 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-88ab10eb-0984-4258-97e0-c00991c600d6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:15.156963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-88ab10eb-0984-4258-97e0-c00991c600d6 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df" status: 200 len: 1230 microversion: 2.1 time: 0.112220 Apr 05 12:34:15.157545 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2011/3997] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:15 2022] GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df => generated 1230 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:34:15.190853 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e34cafa5-de8c-4954-8d26-a3ab003813dd tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:15.198270 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e34cafa5-de8c-4954-8d26-a3ab003813dd tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1507 microversion: 2.1 time: 0.174203 Apr 05 12:34:15.198829 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1987/3998] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:15 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:15.214923 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-deebfd1e-71d4-4492-8034-d1cdf2270128 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:34:15.215501 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-deebfd1e-71d4-4492-8034-d1cdf2270128 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:15.221855 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-deebfd1e-71d4-4492-8034-d1cdf2270128 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:15.222331 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-deebfd1e-71d4-4492-8034-d1cdf2270128 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:15.223136 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-deebfd1e-71d4-4492-8034-d1cdf2270128 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:15.223518 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-deebfd1e-71d4-4492-8034-d1cdf2270128 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:15.318746 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-deebfd1e-71d4-4492-8034-d1cdf2270128 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "POST /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b/action" status: 202 len: 0 microversion: 2.1 time: 0.107653 Apr 05 12:34:15.319510 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2012/3999] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Apr 5 12:34:15 2022] POST /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 12:34:15.327677 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e8d7409b-bad2-4234-b48f-fbde304b257e tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:15.328309 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e8d7409b-bad2-4234-b48f-fbde304b257e tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:15.334959 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e8d7409b-bad2-4234-b48f-fbde304b257e tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:15.335710 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e8d7409b-bad2-4234-b48f-fbde304b257e tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:15.336742 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e8d7409b-bad2-4234-b48f-fbde304b257e tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:15.337393 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e8d7409b-bad2-4234-b48f-fbde304b257e tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:15.526737 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e8d7409b-bad2-4234-b48f-fbde304b257e tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:15.534512 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e8d7409b-bad2-4234-b48f-fbde304b257e tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1515 microversion: 2.1 time: 0.210708 Apr 05 12:34:15.535073 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1988/4000] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:15 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1515 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:16.178523 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4cec8b38-560d-48cc-a81c-cc94fd05400b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:16.179599 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-4cec8b38-560d-48cc-a81c-cc94fd05400b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: f6278191-a0b7-4e89-8232-94c1df38c3df] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:16.190199 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cec8b38-560d-48cc-a81c-cc94fd05400b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:16.190944 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cec8b38-560d-48cc-a81c-cc94fd05400b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:16.192353 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cec8b38-560d-48cc-a81c-cc94fd05400b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:16.193097 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-4cec8b38-560d-48cc-a81c-cc94fd05400b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:16.210221 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.wsgi [None req-4cec8b38-560d-48cc-a81c-cc94fd05400b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] HTTP exception thrown: Instance f6278191-a0b7-4e89-8232-94c1df38c3df could not be found. Apr 05 12:34:16.210814 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-4cec8b38-560d-48cc-a81c-cc94fd05400b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Returning 404 to user: Instance f6278191-a0b7-4e89-8232-94c1df38c3df could not be found. {{(pid=123358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:34:16.211707 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-4cec8b38-560d-48cc-a81c-cc94fd05400b tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df" status: 404 len: 111 microversion: 2.1 time: 0.039940 Apr 05 12:34:16.212196 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2013/4001] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:16 2022] GET /compute/v2.1/servers/f6278191-a0b7-4e89-8232-94c1df38c3df => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:34:16.551371 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c4eaeef0-3851-4c43-8c29-10db65541a0f tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:16.551982 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c4eaeef0-3851-4c43-8c29-10db65541a0f tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:16.558537 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c4eaeef0-3851-4c43-8c29-10db65541a0f tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:16.558870 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c4eaeef0-3851-4c43-8c29-10db65541a0f tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:16.559639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c4eaeef0-3851-4c43-8c29-10db65541a0f tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:16.560064 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c4eaeef0-3851-4c43-8c29-10db65541a0f tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:16.693176 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c4eaeef0-3851-4c43-8c29-10db65541a0f tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:16.705679 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c4eaeef0-3851-4c43-8c29-10db65541a0f tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1515 microversion: 2.1 time: 0.158176 Apr 05 12:34:16.706257 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1989/4002] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:16 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:16.914547 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-e8cf24d5-a457-463b-946f-29c77b9f3a88 req-db8cdc57-e9bc-4132-a702-7d4f997940c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff6f9052-573c-42bf-b792-89cedff3455b", "name": "network-vif-unplugged", "status": "completed", "tag": "afa360b5-75a7-4767-9234-8b0a059162c9"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:34:16.923417 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-e8cf24d5-a457-463b-946f-29c77b9f3a88 req-db8cdc57-e9bc-4132-a702-7d4f997940c1 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:16.923895 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-e8cf24d5-a457-463b-946f-29c77b9f3a88 req-db8cdc57-e9bc-4132-a702-7d4f997940c1 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:16.936364 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.compute.server_external_events [req-e8cf24d5-a457-463b-946f-29c77b9f3a88 req-db8cdc57-e9bc-4132-a702-7d4f997940c1 service nova] Unable to find a host for instance ff6f9052-573c-42bf-b792-89cedff3455b. Dropping event network-vif-unplugged {{(pid=123358) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 05 12:34:16.937292 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-e8cf24d5-a457-463b-946f-29c77b9f3a88 req-db8cdc57-e9bc-4132-a702-7d4f997940c1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026751 Apr 05 12:34:16.937903 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2014/4003] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 05 12:34:17.728161 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-269f723b-1df9-42a8-b140-eb2535929d4a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:17.729225 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-269f723b-1df9-42a8-b140-eb2535929d4a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:17.735858 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-269f723b-1df9-42a8-b140-eb2535929d4a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:17.736556 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-269f723b-1df9-42a8-b140-eb2535929d4a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:17.737396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-269f723b-1df9-42a8-b140-eb2535929d4a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:17.737816 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-269f723b-1df9-42a8-b140-eb2535929d4a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:17.872090 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-269f723b-1df9-42a8-b140-eb2535929d4a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:17.880268 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-269f723b-1df9-42a8-b140-eb2535929d4a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1515 microversion: 2.1 time: 0.157095 Apr 05 12:34:17.880888 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1990/4004] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:17 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:18.896550 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-45b67a79-d5a4-4405-9a16-30bd75a3ea16 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:18.897144 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-45b67a79-d5a4-4405-9a16-30bd75a3ea16 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:18.903450 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-45b67a79-d5a4-4405-9a16-30bd75a3ea16 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:18.903925 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-45b67a79-d5a4-4405-9a16-30bd75a3ea16 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:18.904669 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-45b67a79-d5a4-4405-9a16-30bd75a3ea16 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:18.905102 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-45b67a79-d5a4-4405-9a16-30bd75a3ea16 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:19.148845 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-45b67a79-d5a4-4405-9a16-30bd75a3ea16 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:19.156666 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-45b67a79-d5a4-4405-9a16-30bd75a3ea16 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1515 microversion: 2.1 time: 0.264008 Apr 05 12:34:19.157246 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2015/4005] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:18 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1515 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:19.411298 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-8001bbb4-b612-4306-a94a-57e358064219 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:19.411847 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8001bbb4-b612-4306-a94a-57e358064219 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: a03ec7e6-4c14-4cac-ab24-61cfc2133cb3] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:19.418463 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8001bbb4-b612-4306-a94a-57e358064219 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:19.419088 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8001bbb4-b612-4306-a94a-57e358064219 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:19.419930 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8001bbb4-b612-4306-a94a-57e358064219 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:19.420440 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-8001bbb4-b612-4306-a94a-57e358064219 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:19.451525 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-8001bbb4-b612-4306-a94a-57e358064219 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: a03ec7e6-4c14-4cac-ab24-61cfc2133cb3] Going to try to terminate instance {{(pid=123357) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 12:34:19.481411 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-d1acbd9e-6f0c-4b6f-836a-75ebbb319c28 req-874b51c9-34ec-4684-b826-be05e654ee57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a03ec7e6-4c14-4cac-ab24-61cfc2133cb3", "tag": "1b5e9d60-f8ba-4088-b208-5e663b8d9f10"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:34:19.489758 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-d1acbd9e-6f0c-4b6f-836a-75ebbb319c28 req-874b51c9-34ec-4684-b826-be05e654ee57 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:19.490200 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-d1acbd9e-6f0c-4b6f-836a-75ebbb319c28 req-874b51c9-34ec-4684-b826-be05e654ee57 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:19.502133 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-d1acbd9e-6f0c-4b6f-836a-75ebbb319c28 req-874b51c9-34ec-4684-b826-be05e654ee57 service nova] Creating event network-changed:1b5e9d60-f8ba-4088-b208-5e663b8d9f10 for instance a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 on hv-cinder-82956 Apr 05 12:34:19.507519 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-d1acbd9e-6f0c-4b6f-836a-75ebbb319c28 req-874b51c9-34ec-4684-b826-be05e654ee57 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091456 Apr 05 12:34:19.508136 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2016/4006] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:34:19.548481 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-8001bbb4-b612-4306-a94a-57e358064219 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3" status: 204 len: 0 microversion: 2.1 time: 0.140727 Apr 05 12:34:19.549333 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1991/4007] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 12:34:19 2022] DELETE /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:34:19.557892 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-282eff30-34cf-425f-82c5-5c8d1bea7b72 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:19.558752 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-282eff30-34cf-425f-82c5-5c8d1bea7b72 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: a03ec7e6-4c14-4cac-ab24-61cfc2133cb3] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:19.565182 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-282eff30-34cf-425f-82c5-5c8d1bea7b72 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:19.565766 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-282eff30-34cf-425f-82c5-5c8d1bea7b72 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:19.566640 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-282eff30-34cf-425f-82c5-5c8d1bea7b72 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:19.567463 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-282eff30-34cf-425f-82c5-5c8d1bea7b72 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:19.704532 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-282eff30-34cf-425f-82c5-5c8d1bea7b72 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:19.711981 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-282eff30-34cf-425f-82c5-5c8d1bea7b72 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3" status: 200 len: 1578 microversion: 2.1 time: 0.158278 Apr 05 12:34:19.712597 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2017/4008] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:19 2022] GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:34:20.176472 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3fee7d41-e000-45f8-8394-564b4b6c0592 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:20.177163 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3fee7d41-e000-45f8-8394-564b4b6c0592 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:20.183638 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3fee7d41-e000-45f8-8394-564b4b6c0592 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:20.184181 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3fee7d41-e000-45f8-8394-564b4b6c0592 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:20.185014 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3fee7d41-e000-45f8-8394-564b4b6c0592 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:20.185510 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3fee7d41-e000-45f8-8394-564b4b6c0592 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:20.324953 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3fee7d41-e000-45f8-8394-564b4b6c0592 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:20.332809 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3fee7d41-e000-45f8-8394-564b4b6c0592 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1515 microversion: 2.1 time: 0.161934 Apr 05 12:34:20.333394 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1992/4009] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:20 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:20.729928 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6b5d2da0-4349-4985-ad4f-92c4cec34a2f tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:20.730432 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6b5d2da0-4349-4985-ad4f-92c4cec34a2f tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: a03ec7e6-4c14-4cac-ab24-61cfc2133cb3] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:20.737230 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6b5d2da0-4349-4985-ad4f-92c4cec34a2f tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:20.737681 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6b5d2da0-4349-4985-ad4f-92c4cec34a2f tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:20.738577 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6b5d2da0-4349-4985-ad4f-92c4cec34a2f tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:20.739037 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6b5d2da0-4349-4985-ad4f-92c4cec34a2f tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:20.880821 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6b5d2da0-4349-4985-ad4f-92c4cec34a2f tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:20.888174 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6b5d2da0-4349-4985-ad4f-92c4cec34a2f tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3" status: 200 len: 1578 microversion: 2.1 time: 0.162590 Apr 05 12:34:20.888740 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2018/4010] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:20 2022] GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:21.354399 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-a9519735-d1d5-4c55-9275-7e1875b6a754 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:21.355011 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-a9519735-d1d5-4c55-9275-7e1875b6a754 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:21.361865 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a9519735-d1d5-4c55-9275-7e1875b6a754 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:21.362589 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a9519735-d1d5-4c55-9275-7e1875b6a754 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:21.363587 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a9519735-d1d5-4c55-9275-7e1875b6a754 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:21.364194 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-a9519735-d1d5-4c55-9275-7e1875b6a754 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:21.521515 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [req-0ce97c73-5c24-42ac-a71b-206661a845a7 req-e3a066d5-e906-4293-b219-d2e23c4dc4a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a03ec7e6-4c14-4cac-ab24-61cfc2133cb3", "name": "network-vif-deleted", "tag": "1b5e9d60-f8ba-4088-b208-5e663b8d9f10"}]} {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:34:21.529521 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-0ce97c73-5c24-42ac-a71b-206661a845a7 req-e3a066d5-e906-4293-b219-d2e23c4dc4a4 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:21.530038 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [req-0ce97c73-5c24-42ac-a71b-206661a845a7 req-e3a066d5-e906-4293-b219-d2e23c4dc4a4 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:21.540839 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.compute.server_external_events [req-0ce97c73-5c24-42ac-a71b-206661a845a7 req-e3a066d5-e906-4293-b219-d2e23c4dc4a4 service nova] Creating event network-vif-deleted:1b5e9d60-f8ba-4088-b208-5e663b8d9f10 for instance a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 on hv-cinder-82956 Apr 05 12:34:21.544127 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-a9519735-d1d5-4c55-9275-7e1875b6a754 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:21.545999 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [req-0ce97c73-5c24-42ac-a71b-206661a845a7 req-e3a066d5-e906-4293-b219-d2e23c4dc4a4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028199 Apr 05 12:34:21.546634 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2019/4011] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:34:21.551909 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-a9519735-d1d5-4c55-9275-7e1875b6a754 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1573 microversion: 2.1 time: 0.201958 Apr 05 12:34:21.552509 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1993/4012] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:21 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1573 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:21.907273 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-8edadffb-e3ef-4cf4-9fd3-237e6ba66e7d tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:21.907944 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-8edadffb-e3ef-4cf4-9fd3-237e6ba66e7d tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: a03ec7e6-4c14-4cac-ab24-61cfc2133cb3] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:21.914903 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8edadffb-e3ef-4cf4-9fd3-237e6ba66e7d tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:21.915597 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8edadffb-e3ef-4cf4-9fd3-237e6ba66e7d tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:21.916405 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8edadffb-e3ef-4cf4-9fd3-237e6ba66e7d tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:21.916844 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8edadffb-e3ef-4cf4-9fd3-237e6ba66e7d tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:21.949569 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8edadffb-e3ef-4cf4-9fd3-237e6ba66e7d tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:21.950015 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-8edadffb-e3ef-4cf4-9fd3-237e6ba66e7d tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:21.950455 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.objects.instance [None req-8edadffb-e3ef-4cf4-9fd3-237e6ba66e7d tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lazy-loading 'fault' on Instance uuid a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 {{(pid=123358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 12:34:21.991385 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-8edadffb-e3ef-4cf4-9fd3-237e6ba66e7d tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c19b3319804327be025ce4ae75279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff211be298de4a89afdcf4b57bdbc6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:21.999393 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-8edadffb-e3ef-4cf4-9fd3-237e6ba66e7d tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3" status: 200 len: 1230 microversion: 2.1 time: 0.097229 Apr 05 12:34:21.999952 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2020/4013] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:21 2022] GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:22.573722 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-aa0e247e-2b28-47bb-8347-9dde39d8822a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:22.574761 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-aa0e247e-2b28-47bb-8347-9dde39d8822a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:22.585532 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aa0e247e-2b28-47bb-8347-9dde39d8822a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:22.586321 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aa0e247e-2b28-47bb-8347-9dde39d8822a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:22.587580 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aa0e247e-2b28-47bb-8347-9dde39d8822a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:22.588356 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-aa0e247e-2b28-47bb-8347-9dde39d8822a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:22.730005 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-aa0e247e-2b28-47bb-8347-9dde39d8822a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:22.741122 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-aa0e247e-2b28-47bb-8347-9dde39d8822a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1573 microversion: 2.1 time: 0.173940 Apr 05 12:34:22.741848 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1994/4014] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:22 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1573 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:23.018356 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6f99368b-06a1-4e52-95b5-87f604379f25 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:23.018989 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6f99368b-06a1-4e52-95b5-87f604379f25 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: a03ec7e6-4c14-4cac-ab24-61cfc2133cb3] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:23.026464 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f99368b-06a1-4e52-95b5-87f604379f25 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:23.026963 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f99368b-06a1-4e52-95b5-87f604379f25 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:23.027802 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f99368b-06a1-4e52-95b5-87f604379f25 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:23.028330 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6f99368b-06a1-4e52-95b5-87f604379f25 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:23.043311 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.wsgi [None req-6f99368b-06a1-4e52-95b5-87f604379f25 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] HTTP exception thrown: Instance a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 could not be found. Apr 05 12:34:23.043962 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6f99368b-06a1-4e52-95b5-87f604379f25 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Returning 404 to user: Instance a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 could not be found. {{(pid=123358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:34:23.044905 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6f99368b-06a1-4e52-95b5-87f604379f25 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3" status: 404 len: 111 microversion: 2.1 time: 0.030909 Apr 05 12:34:23.045472 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2021/4015] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:23 2022] GET /compute/v2.1/servers/a03ec7e6-4c14-4cac-ab24-61cfc2133cb3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:34:23.510142 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-54854dc6-a6ca-47c4-a989-bf3684a40025 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:23.510633 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-54854dc6-a6ca-47c4-a989-bf3684a40025 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:23.517102 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54854dc6-a6ca-47c4-a989-bf3684a40025 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:23.517557 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54854dc6-a6ca-47c4-a989-bf3684a40025 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:23.518331 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54854dc6-a6ca-47c4-a989-bf3684a40025 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:23.518762 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-54854dc6-a6ca-47c4-a989-bf3684a40025 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:23.532161 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-54854dc6-a6ca-47c4-a989-bf3684a40025 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] HTTP exception thrown: Instance 73459d0a-9074-4cc4-b60c-5d775163d68c could not be found. Apr 05 12:34:23.532682 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-54854dc6-a6ca-47c4-a989-bf3684a40025 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Returning 404 to user: Instance 73459d0a-9074-4cc4-b60c-5d775163d68c could not be found. {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:34:23.533598 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-54854dc6-a6ca-47c4-a989-bf3684a40025 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "DELETE /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c" status: 404 len: 111 microversion: 2.1 time: 0.027505 Apr 05 12:34:23.534127 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1995/4016] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 12:34:23 2022] DELETE /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:34:23.542362 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2302834b-3e00-4bfe-b2ab-4fa3b14f7629 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:23.542978 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-2302834b-3e00-4bfe-b2ab-4fa3b14f7629 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [instance: 73459d0a-9074-4cc4-b60c-5d775163d68c] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:23.549392 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2302834b-3e00-4bfe-b2ab-4fa3b14f7629 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:23.549845 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2302834b-3e00-4bfe-b2ab-4fa3b14f7629 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:23.550608 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2302834b-3e00-4bfe-b2ab-4fa3b14f7629 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:23.551050 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-2302834b-3e00-4bfe-b2ab-4fa3b14f7629 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:23.565083 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.wsgi [None req-2302834b-3e00-4bfe-b2ab-4fa3b14f7629 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] HTTP exception thrown: Instance 73459d0a-9074-4cc4-b60c-5d775163d68c could not be found. Apr 05 12:34:23.565662 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-2302834b-3e00-4bfe-b2ab-4fa3b14f7629 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Returning 404 to user: Instance 73459d0a-9074-4cc4-b60c-5d775163d68c could not be found. {{(pid=123358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:34:23.566476 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-2302834b-3e00-4bfe-b2ab-4fa3b14f7629 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c" status: 404 len: 111 microversion: 2.1 time: 0.028021 Apr 05 12:34:23.567008 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2022/4017] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:23 2022] GET /compute/v2.1/servers/73459d0a-9074-4cc4-b60c-5d775163d68c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:34:23.766132 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-c06c026f-4779-40f8-af9a-87f491d95ed4 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:23.767509 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-c06c026f-4779-40f8-af9a-87f491d95ed4 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:23.774479 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c06c026f-4779-40f8-af9a-87f491d95ed4 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:23.774931 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c06c026f-4779-40f8-af9a-87f491d95ed4 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:23.775773 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c06c026f-4779-40f8-af9a-87f491d95ed4 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:23.776249 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-c06c026f-4779-40f8-af9a-87f491d95ed4 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:23.919093 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-c06c026f-4779-40f8-af9a-87f491d95ed4 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:23.926883 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-c06c026f-4779-40f8-af9a-87f491d95ed4 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1573 microversion: 2.1 time: 0.167408 Apr 05 12:34:23.927448 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1996/4018] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:23 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1573 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:24.870390 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6de12e58-3b29-4c6e-8a43-1068a01f9275 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] Calling method '.version_select at 0x7f161c109af0>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:24.873798 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6de12e58-3b29-4c6e-8a43-1068a01f9275 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [7573541a-9397-4faf-90a4-8bd8940d8345] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 05 12:34:24.946373 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-200bbb22-d81b-405b-b7f1-7baebe2f225a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:24.947136 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-200bbb22-d81b-405b-b7f1-7baebe2f225a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:24.956954 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-200bbb22-d81b-405b-b7f1-7baebe2f225a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:24.957687 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-200bbb22-d81b-405b-b7f1-7baebe2f225a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:24.958891 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-200bbb22-d81b-405b-b7f1-7baebe2f225a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:24.959509 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-200bbb22-d81b-405b-b7f1-7baebe2f225a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:25.111272 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-200bbb22-d81b-405b-b7f1-7baebe2f225a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:25.119266 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-200bbb22-d81b-405b-b7f1-7baebe2f225a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1573 microversion: 2.1 time: 0.178638 Apr 05 12:34:25.119853 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1997/4019] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:24 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1573 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:25.882969 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [None req-6de12e58-3b29-4c6e-8a43-1068a01f9275 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] [7573541a-9397-4faf-90a4-8bd8940d8345] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 35116. Apr 05 12:34:25.906985 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6de12e58-3b29-4c6e-8a43-1068a01f9275 tempest-TestVolumeBootPattern-229036394 tempest-TestVolumeBootPattern-229036394-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-800585948" status: 202 len: 0 microversion: 2.1 time: 1.040524 Apr 05 12:34:25.907588 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2023/4020] 10.222.0.61 () {58 vars in 1259 bytes} [Tue Apr 5 12:34:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-800585948 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 12:34:26.141976 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-3ad5c91c-9d7d-4e70-bef9-a7345caf37b4 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:26.142765 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-3ad5c91c-9d7d-4e70-bef9-a7345caf37b4 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:26.149498 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3ad5c91c-9d7d-4e70-bef9-a7345caf37b4 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:26.149952 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3ad5c91c-9d7d-4e70-bef9-a7345caf37b4 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:26.150719 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3ad5c91c-9d7d-4e70-bef9-a7345caf37b4 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:26.151156 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-3ad5c91c-9d7d-4e70-bef9-a7345caf37b4 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:26.293643 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-3ad5c91c-9d7d-4e70-bef9-a7345caf37b4 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:26.301513 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-3ad5c91c-9d7d-4e70-bef9-a7345caf37b4 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1573 microversion: 2.1 time: 0.163571 Apr 05 12:34:26.302115 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1998/4021] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:26 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:27.319687 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-39dcbdea-95cc-4c57-ba9d-d8bfab85dde8 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:27.320273 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-39dcbdea-95cc-4c57-ba9d-d8bfab85dde8 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:27.326983 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-39dcbdea-95cc-4c57-ba9d-d8bfab85dde8 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:27.327434 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-39dcbdea-95cc-4c57-ba9d-d8bfab85dde8 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:27.328245 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-39dcbdea-95cc-4c57-ba9d-d8bfab85dde8 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:27.328673 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-39dcbdea-95cc-4c57-ba9d-d8bfab85dde8 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:27.717053 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-39dcbdea-95cc-4c57-ba9d-d8bfab85dde8 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:27.725449 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-39dcbdea-95cc-4c57-ba9d-d8bfab85dde8 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1573 microversion: 2.1 time: 0.410293 Apr 05 12:34:27.726284 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2024/4022] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:27 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1573 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:28.743653 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-20f49483-aee2-4516-b7ff-2dec45055b8c tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:28.744381 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-20f49483-aee2-4516-b7ff-2dec45055b8c tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:28.752539 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-20f49483-aee2-4516-b7ff-2dec45055b8c tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:28.752989 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-20f49483-aee2-4516-b7ff-2dec45055b8c tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:28.753759 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-20f49483-aee2-4516-b7ff-2dec45055b8c tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:28.754185 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-20f49483-aee2-4516-b7ff-2dec45055b8c tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:29.030396 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-20f49483-aee2-4516-b7ff-2dec45055b8c tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:29.038892 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-20f49483-aee2-4516-b7ff-2dec45055b8c tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1573 microversion: 2.1 time: 0.299278 Apr 05 12:34:29.039479 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 1999/4023] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:28 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1573 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:30.056455 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-59341149-c164-4210-a393-b104497bfacd tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:30.057639 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-59341149-c164-4210-a393-b104497bfacd tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:30.064538 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-59341149-c164-4210-a393-b104497bfacd tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:30.065012 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-59341149-c164-4210-a393-b104497bfacd tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:30.065733 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-59341149-c164-4210-a393-b104497bfacd tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:30.066325 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-59341149-c164-4210-a393-b104497bfacd tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:30.312704 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-59341149-c164-4210-a393-b104497bfacd tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:30.320709 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-59341149-c164-4210-a393-b104497bfacd tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1573 microversion: 2.1 time: 0.268268 Apr 05 12:34:30.321251 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2025/4024] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:30 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1573 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:31.337966 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-e9f1faaf-5b40-4262-8a62-118c5a80f187 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:31.339274 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-e9f1faaf-5b40-4262-8a62-118c5a80f187 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:31.346744 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e9f1faaf-5b40-4262-8a62-118c5a80f187 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:31.347390 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e9f1faaf-5b40-4262-8a62-118c5a80f187 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:31.348355 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e9f1faaf-5b40-4262-8a62-118c5a80f187 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:31.349059 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-e9f1faaf-5b40-4262-8a62-118c5a80f187 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:31.516615 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-e9f1faaf-5b40-4262-8a62-118c5a80f187 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:31.524458 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-e9f1faaf-5b40-4262-8a62-118c5a80f187 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1573 microversion: 2.1 time: 0.190824 Apr 05 12:34:31.525231 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 2000/4025] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:31 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1573 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:32.544296 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-6993f326-29df-4826-a00e-b22f1f5183f6 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:32.546295 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-6993f326-29df-4826-a00e-b22f1f5183f6 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:32.553294 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6993f326-29df-4826-a00e-b22f1f5183f6 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:32.553821 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6993f326-29df-4826-a00e-b22f1f5183f6 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:32.554508 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6993f326-29df-4826-a00e-b22f1f5183f6 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:32.554936 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-6993f326-29df-4826-a00e-b22f1f5183f6 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:32.728593 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-6993f326-29df-4826-a00e-b22f1f5183f6 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:32.737832 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-6993f326-29df-4826-a00e-b22f1f5183f6 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1573 microversion: 2.1 time: 0.199395 Apr 05 12:34:32.738500 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2026/4026] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:32 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1573 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:33.143603 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-8568a978-84b3-498a-9b0a-ddb81af73f14 req-1be5aafa-4510-4a66-a010-88e5da9cb912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff6f9052-573c-42bf-b792-89cedff3455b", "name": "network-vif-plugged", "status": "completed", "tag": "afa360b5-75a7-4767-9234-8b0a059162c9"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:34:33.152800 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-8568a978-84b3-498a-9b0a-ddb81af73f14 req-1be5aafa-4510-4a66-a010-88e5da9cb912 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:33.153616 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-8568a978-84b3-498a-9b0a-ddb81af73f14 req-1be5aafa-4510-4a66-a010-88e5da9cb912 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:33.169965 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-8568a978-84b3-498a-9b0a-ddb81af73f14 req-1be5aafa-4510-4a66-a010-88e5da9cb912 service nova] Creating event network-vif-plugged:afa360b5-75a7-4767-9234-8b0a059162c9 for instance ff6f9052-573c-42bf-b792-89cedff3455b on hv-cinder-82956 Apr 05 12:34:33.178958 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-8568a978-84b3-498a-9b0a-ddb81af73f14 req-1be5aafa-4510-4a66-a010-88e5da9cb912 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037746 Apr 05 12:34:33.179823 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 2001/4027] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:34:33.754833 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-b918be6c-177d-4231-865b-9cbe6faf11ca tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:33.755535 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-b918be6c-177d-4231-865b-9cbe6faf11ca tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:33.761676 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b918be6c-177d-4231-865b-9cbe6faf11ca tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:33.762111 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b918be6c-177d-4231-865b-9cbe6faf11ca tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:33.762862 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b918be6c-177d-4231-865b-9cbe6faf11ca tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:33.763312 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-b918be6c-177d-4231-865b-9cbe6faf11ca tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:33.902390 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-b918be6c-177d-4231-865b-9cbe6faf11ca tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:33.910047 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-b918be6c-177d-4231-865b-9cbe6faf11ca tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1573 microversion: 2.1 time: 0.159143 Apr 05 12:34:33.910615 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2027/4028] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:33 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:34:34.933232 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-ae1e1738-2b80-4bcf-9382-c6202534ccea tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:34:34.934236 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-ae1e1738-2b80-4bcf-9382-c6202534ccea tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:34:34.944779 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae1e1738-2b80-4bcf-9382-c6202534ccea tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:34.945521 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae1e1738-2b80-4bcf-9382-c6202534ccea tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:34.946904 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae1e1738-2b80-4bcf-9382-c6202534ccea tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:34:34.947609 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-ae1e1738-2b80-4bcf-9382-c6202534ccea tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:34:35.089605 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-ae1e1738-2b80-4bcf-9382-c6202534ccea tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:34:35.097443 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-ae1e1738-2b80-4bcf-9382-c6202534ccea tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1560 microversion: 2.1 time: 0.172466 Apr 05 12:34:35.098025 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 2002/4029] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:34:34 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:35:48.979867 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-16028c2f-a5dc-43b8-a9ef-55de6bb45709 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:35:48.980436 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-16028c2f-a5dc-43b8-a9ef-55de6bb45709 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:35:48.985256 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-345bb894-3734-45b3-83f7-cd6c6195bbfd req-de148ccd-64f0-493e-b417-f15e86221219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff6f9052-573c-42bf-b792-89cedff3455b", "tag": "afa360b5-75a7-4767-9234-8b0a059162c9"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:35:48.986358 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-16028c2f-a5dc-43b8-a9ef-55de6bb45709 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:35:48.986995 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-16028c2f-a5dc-43b8-a9ef-55de6bb45709 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:35:48.987746 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-16028c2f-a5dc-43b8-a9ef-55de6bb45709 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:35:48.988218 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-16028c2f-a5dc-43b8-a9ef-55de6bb45709 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:35:48.993852 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-345bb894-3734-45b3-83f7-cd6c6195bbfd req-de148ccd-64f0-493e-b417-f15e86221219 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:35:48.994547 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-345bb894-3734-45b3-83f7-cd6c6195bbfd req-de148ccd-64f0-493e-b417-f15e86221219 service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:35:49.006153 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-345bb894-3734-45b3-83f7-cd6c6195bbfd req-de148ccd-64f0-493e-b417-f15e86221219 service nova] Creating event network-changed:afa360b5-75a7-4767-9234-8b0a059162c9 for instance ff6f9052-573c-42bf-b792-89cedff3455b on hv-cinder-82956 Apr 05 12:35:49.012119 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-345bb894-3734-45b3-83f7-cd6c6195bbfd req-de148ccd-64f0-493e-b417-f15e86221219 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031806 Apr 05 12:35:49.013272 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 2003/4030] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:35:49.014428 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-16028c2f-a5dc-43b8-a9ef-55de6bb45709 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Going to try to terminate instance {{(pid=123358) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 12:35:49.104607 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-16028c2f-a5dc-43b8-a9ef-55de6bb45709 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 204 len: 0 microversion: 2.1 time: 0.129746 Apr 05 12:35:49.105319 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2028/4031] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Apr 5 12:35:48 2022] DELETE /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:35:49.114493 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-4e3bf74c-e059-4480-b47c-d6a644cd20fc tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:35:49.115827 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-4e3bf74c-e059-4480-b47c-d6a644cd20fc tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:35:49.122183 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4e3bf74c-e059-4480-b47c-d6a644cd20fc tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:35:49.122756 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4e3bf74c-e059-4480-b47c-d6a644cd20fc tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:35:49.123585 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4e3bf74c-e059-4480-b47c-d6a644cd20fc tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:35:49.124112 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-4e3bf74c-e059-4480-b47c-d6a644cd20fc tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:35:49.279748 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.policy [None req-4e3bf74c-e059-4480-b47c-d6a644cd20fc tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123357) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:35:49.287364 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-4e3bf74c-e059-4480-b47c-d6a644cd20fc tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1566 microversion: 2.1 time: 0.177509 Apr 05 12:35:49.288039 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 2004/4032] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:35:49 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:35:50.305844 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-018ad48d-b3bf-4ffa-87b1-72502cb343a9 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:35:50.306492 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-018ad48d-b3bf-4ffa-87b1-72502cb343a9 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:35:50.313598 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-018ad48d-b3bf-4ffa-87b1-72502cb343a9 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:35:50.314011 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-018ad48d-b3bf-4ffa-87b1-72502cb343a9 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:35:50.314786 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-018ad48d-b3bf-4ffa-87b1-72502cb343a9 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:35:50.315205 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-018ad48d-b3bf-4ffa-87b1-72502cb343a9 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:35:50.478513 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-018ad48d-b3bf-4ffa-87b1-72502cb343a9 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:35:50.486715 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-018ad48d-b3bf-4ffa-87b1-72502cb343a9 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1566 microversion: 2.1 time: 0.185222 Apr 05 12:35:50.487302 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2029/4033] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:35:50 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1566 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:35:51.082557 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [req-d0de1f85-ebed-4e75-bacd-faca16ba5c35 req-df1f9aae-b59b-447e-b61b-608579eef65b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff6f9052-573c-42bf-b792-89cedff3455b", "name": "network-vif-deleted", "tag": "afa360b5-75a7-4767-9234-8b0a059162c9"}]} {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:35:51.091142 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-d0de1f85-ebed-4e75-bacd-faca16ba5c35 req-df1f9aae-b59b-447e-b61b-608579eef65b service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:35:51.091585 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [req-d0de1f85-ebed-4e75-bacd-faca16ba5c35 req-df1f9aae-b59b-447e-b61b-608579eef65b service nova] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:35:51.103523 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.compute.server_external_events [req-d0de1f85-ebed-4e75-bacd-faca16ba5c35 req-df1f9aae-b59b-447e-b61b-608579eef65b service nova] Creating event network-vif-deleted:afa360b5-75a7-4767-9234-8b0a059162c9 for instance ff6f9052-573c-42bf-b792-89cedff3455b on hv-cinder-82956 Apr 05 12:35:51.109601 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [req-d0de1f85-ebed-4e75-bacd-faca16ba5c35 req-df1f9aae-b59b-447e-b61b-608579eef65b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030758 Apr 05 12:35:51.110199 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 2005/4034] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Apr 5 12:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:35:51.504744 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-3d26302a-6d74-4f46-a3d9-aff771aa803c tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:35:51.506031 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.compute.api [None req-3d26302a-6d74-4f46-a3d9-aff771aa803c tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123358) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:35:51.513579 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3d26302a-6d74-4f46-a3d9-aff771aa803c tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:35:51.514028 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3d26302a-6d74-4f46-a3d9-aff771aa803c tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:35:51.514791 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3d26302a-6d74-4f46-a3d9-aff771aa803c tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:35:51.515274 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3d26302a-6d74-4f46-a3d9-aff771aa803c tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:35:51.546601 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3d26302a-6d74-4f46-a3d9-aff771aa803c tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:35:51.547315 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG oslo_concurrency.lockutils [None req-3d26302a-6d74-4f46-a3d9-aff771aa803c tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:35:51.547759 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.objects.instance [None req-3d26302a-6d74-4f46-a3d9-aff771aa803c tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lazy-loading 'fault' on Instance uuid ff6f9052-573c-42bf-b792-89cedff3455b {{(pid=123358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 12:35:51.591312 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.policy [None req-3d26302a-6d74-4f46-a3d9-aff771aa803c tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f428c4b6a43cb87dee153056d19b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4da1a94d31489081ca968e1b9d1a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123358) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 12:35:51.599294 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-3d26302a-6d74-4f46-a3d9-aff771aa803c tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 200 len: 1223 microversion: 2.1 time: 0.098410 Apr 05 12:35:51.599836 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2030/4035] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:35:51 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 1223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:35:52.621620 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-776981a7-b947-492d-8299-0b4eb5e59f1a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '>' {{(pid=123357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:35:52.622757 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.compute.api [None req-776981a7-b947-492d-8299-0b4eb5e59f1a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] [instance: ff6f9052-573c-42bf-b792-89cedff3455b] Fetching instance by UUID {{(pid=123357) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 12:35:52.633618 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-776981a7-b947-492d-8299-0b4eb5e59f1a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:35:52.634425 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-776981a7-b947-492d-8299-0b4eb5e59f1a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:35:52.635201 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-776981a7-b947-492d-8299-0b4eb5e59f1a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 12:35:52.635629 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG oslo_concurrency.lockutils [None req-776981a7-b947-492d-8299-0b4eb5e59f1a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Lock "c02b48b4-c051-4569-8fb4-e9dd7f34ad69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 12:35:52.649446 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.wsgi [None req-776981a7-b947-492d-8299-0b4eb5e59f1a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] HTTP exception thrown: Instance ff6f9052-573c-42bf-b792-89cedff3455b could not be found. Apr 05 12:35:52.650263 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: DEBUG nova.api.openstack.wsgi [None req-776981a7-b947-492d-8299-0b4eb5e59f1a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Returning 404 to user: Instance ff6f9052-573c-42bf-b792-89cedff3455b could not be found. {{(pid=123357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 12:35:52.651191 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO nova.api.openstack.requestlog [None req-776981a7-b947-492d-8299-0b4eb5e59f1a tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b" status: 404 len: 111 microversion: 2.1 time: 0.036903 Apr 05 12:35:52.651715 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: [pid: 123357|app: 0|req: 2006/4036] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Apr 5 12:35:52 2022] GET /compute/v2.1/servers/ff6f9052-573c-42bf-b792-89cedff3455b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:35:52.832225 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: DEBUG nova.api.openstack.wsgi [None req-26ee0a9f-3a13-437f-812d-ad9258756685 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] Calling method '.version_select at 0x7f161c39c8b0>' {{(pid=123358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 12:35:52.852818 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO nova.api.openstack.requestlog [None req-26ee0a9f-3a13-437f-812d-ad9258756685 tempest-TestShelveInstance-111209459 tempest-TestShelveInstance-111209459-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-306513671" status: 202 len: 0 microversion: 2.1 time: 0.024652 Apr 05 12:35:52.853856 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: [pid: 123358|app: 0|req: 2031/4037] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Apr 5 12:35:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-306513671 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:37:33.835805 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:37:33.836427 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Tue Apr 5 12:37:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:37:44.739550 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:37:44.740720 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Tue Apr 5 12:37:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:38:01.744827 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:38:01.745885 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Tue Apr 5 12:38:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:39:44.365309 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:39:44.366127 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Tue Apr 5 12:39:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:40:53.845639 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:40:53.846475 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Tue Apr 5 12:40:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:41:04.753208 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:41:04.754133 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Tue Apr 5 12:41:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:41:14.584105 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:41:14.584953 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Tue Apr 5 12:41:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:41:17.198898 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:41:17.199881 dv-cinder-829565-3-iscsi devstack@n-api.service[123358]: Tue Apr 5 12:41:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:41:21.757444 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:41:21.758033 dv-cinder-829565-3-iscsi devstack@n-api.service[123357]: Tue Apr 5 12:41:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!